Pre-training
The first, heavy training phase of an LLM — the model reads the entire internet and learns language.
Different from fine-tuning (targeted later adaptation) and RLHF (learning to answer helpfully). Pre-training is where the magic happens: almost all knowledge comes from here. Costs millions of $ for big models.