I'm looking for language models that are pure next-token predictors, i.e. the LM has not undergone a subsequent alignment/instruction finetuning/preference finetuning stage after being trained at the basic next word prediction task. Obviously these models would be highly prone to hallucinations, misunderstanding user intent, etc but that does not matter.
Please note that I'm not merely asking for LMs that 'have the least amount of censorship' or 'models you can easily uncensor with X prompt', I'm strictly looking for LMs where absolutely no post-training processing has been applied. Accuracy or intelligence of the model is not at issue here (in fact I would prefer lighter models)

