Modern LLMs ★ 0.000

Engineering course on modern LLMs—from tokenization, RoPE, attention, MoE, and Transformer alternatives to pretraining, KV caches, quantization, SFT, RLHF/DPO/GRPO, reasoning, RAG, agents, and evaluation. Beyond open lectures, the paid Stepik course has 500+ learning activities in total: auto-graded tests, exercises with solutions, and self-check questions with answers; tested notebooks; and a custom MiniLLM—dense S/M/L and their MoE twins—from data to ablations. Part of an evolving series on ML and LLMs.