EasyDeepLearn
← All categories
LLMs & GenAI
Interview · flashcards

LLMs & GenAI

Large language models: pretraining, fine-tuning, RAG, hallucinations, and evaluation.

← LessonStart quiz →
easyfundamentals

What is a large language model, in one paragraph?

Click, press Space or use the button below to reveal the answer
Interview-style answer
  • An LLM is a large transformer trained on massive text (and often code/multimodal data) to predict the next token given the previous ones.
  • Scale of parameters and data lets it acquire broad linguistic and world knowledge.
  • After pretraining, it is typically instruction-tuned and aligned (SFT + preference optimization such as RLHF or DPO) to behave as a helpful assistant.
  • At inference it generates tokens autoregressively from a prompt.
Click again to flip back
1 / 214

Shortcuts: Space/Enter flip · ← / → navigate · K = known · R = review