As someone with a productive AI app built with LLMs, I certainly don’t agree with this:
RAG is fundamentally flawed approach. human memory doesn’t refer back to original source material and re-infer connections between everything whenever you think
But I do love this response:
That’s because sleep is our daily finetuning job which incorporates the day’s data into our weights