Introduction & Core Concepts

51 lessons in AI Engineering / Working with LLMs

• Next-Token Prediction: The Core MechanismSlides / Video
• LLMs vs Traditional SoftwareSlides / Video
• Popular LLM Models and ProvidersSlides / Video
• What a Large Language Model IsSlides / Video
• Next-Token PredictionQuiz
• Parameters and Model SizeQuiz
• The Transformer ArchitectureQuiz
• Tokens and TokenizationQuiz
• LLMs vs Rule-Based ProgramsQuiz
• Hallucinations ExplainedQuiz
• What Is a Large Language ModelQuiz
• API vs Chat InterfaceQuiz
• Pretraining BasicsQuiz
• System Prompt vs User PromptQuiz
• Common LLM Use CasesQuiz
• Popular LLM ProvidersQuiz
• Open-Source vs Proprietary ModelsQuiz
• The Context WindowQuiz
• Knowledge CutoffQuiz
• Temperature and RandomnessQuiz
• Non-Deterministic OutputsQuiz
• Prompts and CompletionsQuiz
• Non-determinism in LLM OutputsSlides / Video
• Limitations of LLMsSlides / Video
• Model Parameters and Model SizeSlides / Video
• Common LLM Use Cases and ApplicationsSlides / Video
• Context Window and Its LimitsSlides / Video
• Prompts and CompletionsSlides / Video
• How LLMs Learn Language PatternsSlides / Video
• Tokens and Tokenization BasicsSlides / Video
• Key LLM TerminologySlides / Video
• HallucinationsFlashcard
• Context WindowFlashcard
• Common LLM Use CasesFlashcard
• Common Examples of LLMsFlashcard
• Temperature and Output ControlsFlashcard
• Base vs Instruction-Tuned ModelsFlashcard
• The Transformer ArchitectureFlashcard
• LLMs vs Rule-Based SoftwareFlashcard
• Next-Token PredictionFlashcard
• APIs vs Chat InterfacesFlashcard
• Training Data and PretrainingFlashcard
• What is a CompletionFlashcard
• What is a Large Language ModelFlashcard
• Parameters and Model SizeFlashcard
• What is a PromptFlashcard
• Non-Determinism of OutputsFlashcard
• System, User, Assistant RolesFlashcard
• Tokens and TokenizationFlashcard
• Knowledge CutoffFlashcard
• What is AI EngineeringFlashcard