Context Management & Long-Context Strategies

60 lessons in AI Engineering / Working with LLMs

• Refine Summarization ChainCode Quiz
• Retrieval To Fit WindowCode Quiz
• Ordering Against Lost-in-MiddleCode Quiz
• Truncate The Right EndCode Quiz
• Rolling Summary BufferCode Quiz
• Reserve Output TokensCode Quiz
• Deduplicate Retrieved ChunksCode Quiz
• Handle Context-Length ErrorsCode Quiz
• What Context Management IsQuiz
• Refine/Iterative SummarizationQuiz
• Rolling Summary BuffersQuiz
• Summarizing Prior ConversationQuiz
• Map-Reduce SummarizationQuiz
• Prioritizing What to KeepQuiz
• Counting Tokens for ContextQuiz
• Token Budgeting Across SectionsQuiz
• Positioning Important InfoQuiz
• Handling Context Overflow ErrorsQuiz
• Stateless APIs and Manual StateQuiz
• Deduplicating Retrieved ContextQuiz
• Entity/Fact Memory ExtractionQuiz
• Sliding Window TruncationQuiz
• Lost in the Middle ProblemQuiz
• Deciding What to Keep vs DropSlides / Video
• Cost and Latency of Large ContextsSlides / Video
• External Memory Stores for Long-Term ContextSlides / Video
• Prioritizing and Ordering ContextSlides / Video
• Preserving the System PromptCode Quiz
• Summarizing Older TurnsCode Quiz
• Sliding Window Over MessagesCode Quiz
• Context Window CheckCode Quiz
• Overlapping Chunk BoundariesCode Quiz
• Map-Reduce SummarizationCode Quiz
• Estimating Token CountCode Quiz
• Token Budget AllocationCode Quiz
• Summarizing Prior Conversation TurnsSlides / Video
• Sliding Window ContextSlides / Video
• Truncation Strategies for Oversized ContextSlides / Video
• Hierarchical SummarizationFlashcard
• System vs Dynamic ContextFlashcard
• Stateful vs Stateless ConversationsFlashcard
• Deduplication in ContextFlashcard
• Counting Tokens Before SendingFlashcard
• Structuring Prompts EfficientlyFlashcard
• Reserving Output TokensFlashcard
• Lost in the Middle ProblemFlashcard
• Sliding Window RetentionFlashcard
• Truncation StrategiesFlashcard
• Context Pruning and FilteringFlashcard
• Context Ordering and PositioningFlashcard
• Context RotFlashcard
• Prompt Compression TechniquesFlashcard
• Conversation SummarizationFlashcard
• What Context Management IsFlashcard
• Long Context vs RAG TradeoffsFlashcard
• Retrieval-Based MemoryFlashcard
• Conversation History Growth ProblemFlashcard
• Context Rot and Length DegradationSlides / Video
• The Lost-in-the-Middle ProblemSlides / Video
• What Context Management IsSlides / Video