The Memory Problem and Continuity of LLMs
I was wondering why memory prices are increasing so much. I noticed that memory companies suddenly became market darlings, with their share prices rising sharply around their quarterly results. Their profits were increasing, their order books were full, and everyone seemed to be pointing towards AI. At the same time, the cellphone and laptop manufacturers have to deal with the same rising memory costs while competing with deep-pocketed AI companies for memory capacity. So I started wondering: why does AI need so much memory? I don’t have a definitive answer. This is just where my curiosity took me. I was chatting with an LLM about behavioural economics, particularly Daniel Kahneman’s Thinking, Fast and Slow. The conversation was actually quite useful. The system gave me perspectives that helped me understand some of the concepts more deeply. A few days later, I went back to the LLM for something else. The conversation naturally drifted towards behavioural e...