Bobertus t1_iydl57u wrote on November 30, 2022 at 4:45 PM

Reply to comment by nszceta in Practice words containing your weakest trigrams using AI by nszceta

I've heard about the concept of search and exploit/multi armed bandit. But only superficially, and I never heard of Thompson sampling.

I'm wondering if you could make the "dynamic component" model the forgetting curve such that data points that probably aren't forgotten yet are weighted higher, giving you a new kind of spaced repetition algorithm.

I've been thinking of experimenting with creating spaced repetition software and I had the idea for a typing trainer using some kind of spaced repetition algorithm.

nszceta OP t1_iydqz0t wrote on November 30, 2022 at 5:22 PM

Spaced repetition algorithms are a minefield. I have developed and partially validated an unpublished (so far) SR algo. The biggest failure of existing SR algorithms and something which has been studied in literature since 2016 a phenomemon in the human brain where retrieval performance of an item you want to learn becomes easier and harder seemingly at random. It turns out that there are three distinct phases of memory and your brain switches between them over time as it consolidates things you learn. A regression of performance over time becomes complicated. There are ways to deal with this using regime switching markov decision processes, but it is incredibly easy to get it all wrong. Another essential component of spaced repetitions so many algorithms get wrong is ignoring the spacing effect.