The Difference Between a Base LLM and an Instruction-Tuned LLM »

Introduction Large language models (LLMs) can behave very differently depending on how they were trained. BaseLLMs are trained purely on next-token prediction over a large corpus of text. Instruction-tuned LLMs, by contrast, are further trained to follow prompts in a more helpful …