Reasoning, Chain-of-Thought & Advanced Prompting Techniques

71 lessons in AI Engineering / Working with LLMs

• Majority Voting Over AnswersCode Quiz
• Verifying Reasoning OutputSlides / Video
• Controlling Reasoning Effort and BudgetSlides / Video
• Failure Modes of Chain-of-ThoughtSlides / Video
• Reasoning in Extraction TasksSlides / Video
• Separating Reasoning from Final AnswerSlides / Video
• Cost and Latency of ReasoningSlides / Video
• When to Use Reasoning vs When Not ToSlides / Video
• Generated Knowledge PromptingSlides / Video
• Self-Reflection and Self-Critique PromptingSlides / Video
• Step-Back Prompting: Abstraction FirstSlides / Video
• Least-to-Most PromptingSlides / Video
• Tree-of-Thoughts ReasoningSlides / Video
• Self-Consistency: Multiple Reasoning PathsSlides / Video
• Few-Shot CoT with Worked ExamplesSlides / Video
• Zero-Shot CoT: Let's Think Step by StepSlides / Video
• Why Reasoning Improves LLM AccuracySlides / Video
• What Chain-of-Thought Prompting IsSlides / Video
• CoT On A Reasoning ModelCode Quiz
• Few-shot Reasoning OrderingCode Quiz
• Rephrase-and-Respond PromptingCode Quiz
• Hiding Chain-of-ThoughtCode Quiz
• Step-back Prompting PrincipleCode Quiz
• Self-check Verification StepCode Quiz
• Delimited Scratchpad ExtractionCode Quiz
• Zero-shot CoT Trigger PhraseCode Quiz
• Self-consistency SamplingCode Quiz
• Tree-of-Thoughts BranchingCode Quiz
• Least-to-most DecompositionCode Quiz
• Parsing the Final AnswerCode Quiz
• Separating Reasoning and AnswerCode Quiz
• Few-shot CoT Worked ExamplesCode Quiz
• Least-to-Most PromptingQuiz
• Self-Reflection PromptingQuiz
• Hiding vs Exposing ReasoningQuiz
• Tasks That Benefit from CoTQuiz
• Prompted CoT vs Reasoning ModelsQuiz
• Step-Back PromptingQuiz
• Generated Knowledge PromptingQuiz
• Chain-of-VerificationQuiz
• Faithfulness of CoTQuiz
• Latency and Cost of ReasoningQuiz
• Controlling Reasoning BudgetQuiz
• What Chain-of-Thought Prompting IsQuiz
• Parsing the Final AnswerQuiz
• Why Reasoning Steps Improve AccuracyQuiz
• Few-Shot CoT with Worked ExamplesQuiz
• Self-Consistency SamplingQuiz
• Tree-of-Thoughts PromptingQuiz
• Prompting Reasoning vs Standard ModelsFlashcard
• Step-Back PromptingFlashcard
• Structured Reasoning OutputFlashcard
• Faithfulness of CoT ExplanationsFlashcard
• Generated Knowledge PromptingFlashcard
• Latency and Cost of Advanced PromptingFlashcard
• Choosing the Right Reasoning TechniqueFlashcard
• Hiding vs Exposing Reasoning TracesFlashcard
• Evaluating Reasoning vs Final AnswerFlashcard
• Prompt Chaining for Multi-Step ReasoningFlashcard
• Self-Reflection and Self-CritiqueFlashcard
• When CoT Helps vs HurtsFlashcard
• Tree-of-Thoughts (ToT)Flashcard
• Least-to-Most PromptingFlashcard
• Chain-of-Verification (CoVe)Flashcard
• Reflexion PatternFlashcard
• Self-ConsistencyFlashcard
• Graph-of-ThoughtsFlashcard
• Controlling Reasoning Effort / BudgetFlashcard
• What Chain-of-Thought Prompting IsFlashcard
• Few-Shot CoT with Worked ExamplesFlashcard
• Why CoT Improves Reasoning PerformanceFlashcard