As someone with a productive AI app built with LLMs, I certainly don’t agree with this:

RAG is fundamentally flawed approach. human memory doesn’t refer back to original source material and re-infer connections between everything whenever you think

But I do love this response:

That’s because sleep is our daily finetuning job which incorporates the day’s data into our weights

James R. Hull @jhull