Idea I had concerning model knowledge

Instead of training knowledge, would it be possible to just store a bunch of training data and then have the model be able to search that data instead? It seems to me like this would be much more compute efficient wouldn’t it?