Markov Chains: the grandparents of LLMs

If you have been on social media in the past few years, it feels like people believe that AI started in 2022 when ChatGPT was released. Out of a sudden, OpenAI, a company unknown to many, released this groundbreaking service that felt surprisingly smart. But before that, many things happened that led to the current level of AI research, and here I will talk about one very old method that managed to do something very similar: Markov chains.

More …