RAG is nowhere near obselete. Model performance on enormous sequences degrades h...

		alansaber 25 days ago \| parent \| context \| favorite \| on: From zero to a RAG system: successes and failures RAG is nowhere near obselete. Model performance on enormous sequences degrades hugely as they are not well represented in training and non quadratic attention approximations are not amazing