AI Engineering / Working with LLMs
Multimodal & Advanced Model Capabilities
82 lessons in AI Engineering / Working with LLMs
- Choosing the Right Multimodal ModelSlides / Video
- Long-Context ModelsQuiz
- Reasoning Models and Extended ThinkingQuiz
- Selecting a Multimodal ModelQuiz
- Multimodal Failure ModesQuiz
- Vision with Function CallingQuiz
- Multimodal Safety RisksQuiz
- Image Generation Models OverviewQuiz
- Image Token Cost and SizingQuiz
- Image Detail/Resolution SettingsQuiz
- Common Input ModalitiesQuiz
- Structuring Multimodal MessagesQuiz
- Text-to-Speech / Audio OutputQuiz
- Audio Input and TranscriptionQuiz
- Multimodal RAGQuiz
- Multimodal Embeddings (CLIP-style)Quiz
- Prompting for Image GenerationQuiz
- What Multimodal Models AreQuiz
- Vision-Language Models OverviewQuiz
- Video Input HandlingQuiz
- Passing Images to a ModelQuiz
- Image Understanding and CaptioningQuiz
- OCR via Multimodal ModelsQuiz
- Document and Chart UnderstandingQuiz
- Multiple Images in One RequestQuiz
- Embedding Models for Multimodal SearchSlides / Video
- Long-Context Models and Their Trade-offsSlides / Video
- Reasoning Models and Extended ThinkingSlides / Video
- Multimodal Model Failure ModesSlides / Video
- Context Window and Multimodal InputsSlides / Video
- Token Cost of Image and Audio InputsSlides / Video
- Generating Text EmbeddingsCode Quiz
- Decoding Generated Image OutputCode Quiz
- JSON Mode Structured OutputCode Quiz
- Parsing to a Pydantic SchemaCode Quiz
- Extracting Reasoning ContentCode Quiz
- Setting Reasoning EffortCode Quiz
- Requesting Image GenerationCode Quiz
- Reading Reasoning Token UsageCode Quiz
- Multimodal Prompting TechniquesSlides / Video
- Document and PDF UnderstandingSlides / Video
- Text-to-Speech CapabilitiesSlides / Video
- Speech-to-Text Transcription CapabilitiesSlides / Video
- Image Generation and Text-to-Image APIsSlides / Video
- Image Understanding Use CasesSlides / Video
- Passing Images to a Multimodal APISlides / Video
- How Vision-Language Models See ImagesSlides / Video
- Common LLM ModalitiesSlides / Video
- Vision Input with Tool CallingCode Quiz
- Image Detail and Token CostCode Quiz
- Cosine Similarity of EmbeddingsCode Quiz
- Audio as a Base64 Content BlockCode Quiz
- What Multimodal Models AreSlides / Video
- Selecting a Vision ModelCode Quiz
- Encode Local Image to Base64Code Quiz
- Sending Multiple ImagesCode Quiz
- Audio Transcription InputCode Quiz
- Setting Image Detail LevelCode Quiz
- Text-to-Speech OutputCode Quiz
- Passing an Image URLCode Quiz
- Mixing Text and Image BlocksCode Quiz
- Combining Text and Images in a PromptFlashcard
- Long Context Models and Their CapabilitiesFlashcard
- Reasoning Models and Extended ThinkingFlashcard
- Multimodal Use Cases in ApplicationsFlashcard
- Video Understanding and Frame SamplingFlashcard
- Image Generation ModelsFlashcard
- Latency and Cost of Multimodal InputsFlashcard
- Limitations of Multimodal ModelsFlashcard
- Text-to-Image Prompting BasicsFlashcard
- Visual Question AnsweringFlashcard
- Image Detail/Resolution SettingsFlashcard
- Passing Images to an APIFlashcard
- Audio Input and TranscriptionFlashcard
- Common ModalitiesFlashcard
- OCR with Multimodal ModelsFlashcard
- Image Input FormatsFlashcard
- Vision-Language Models (VLMs)Flashcard
- What Multimodal Models AreFlashcard
- Text-to-Speech (Audio Generation)Flashcard
- Document and Chart UnderstandingFlashcard
- How Images Are Tokenized and CostFlashcard