AI FundamentalsGenerative AI and Large Language Models

89 items

1

Foundation Models vs Task-Specific Models

Slides / Video
2

Limitations, Bias, and Ethics of LLMs

Slides / Video
3

Context Window and Its Limitations

Slides / Video
4

Zero-Shot, One-Shot, Few-Shot Learning

Slides / Video
5

Prompting and Prompt Engineering Basics

Slides / Video
6

Reinforcement Learning from Human Feedback

Slides / Video
7

Fine-Tuning and Instruction Tuning

Slides / Video
8

Pretraining on Large Text Corpora

Slides / Video
9

Next-Token Prediction and Autoregressive Generation

Slides / Video
10

Embeddings in LLMs

Slides / Video
11

Tokens and Tokenization in LLMs

Slides / Video
12

Self-Attention Mechanism Intuition

Slides / Video
13

The Transformer Architecture Overview

Slides / Video
14

What a Large Language Model Is

Slides / Video
15

Generative vs Discriminative AI

Slides / Video
16

Real-World Applications of LLMs

Slides / Video
17

Generative Models Beyond Text

Slides / Video
18

Model Parameters and Scaling Laws

Slides / Video
19

Retrieval-Augmented Generation (RAG)

Slides / Video
20

Hallucinations and Factual Reliability

Slides / Video
21

Decoding: Temperature, Top-k, Top-p

Slides / Video
22

Retrieval-Augmented Generation (RAG)

Quiz
23

What a Large Language Model Is

Quiz
24

Fine-Tuning Pretrained Models

Quiz
25

Prompt Engineering Basics

Quiz
26

Reinforcement Learning from Human Feedback

Quiz
27

Context Window and Token Limits

Quiz
28

Chain-of-Thought Prompting

Quiz
29

Diffusion Models for Image Generation

Quiz
30

Positional Encoding

Quiz
31

Next-Token Prediction Objective

Quiz
32

In-Context Learning

Quiz
33

Discriminative vs Generative Models

Quiz
34

Zero-Shot vs Few-Shot Prompting

Quiz
35

Self-Attention Mechanism

Quiz
36

Variational Autoencoders (VAEs)

Quiz
37

Instruction Tuning

Quiz
38

Foundation Models Concept

Quiz
39

Generative Adversarial Networks (GANs)

Quiz
40

Text Generation Decoding Strategies

Quiz
41

Encoder vs Decoder vs Encoder-Decoder

Quiz
42

Evaluating Generative Model Outputs

Quiz
43

What Generative AI Is

Quiz
44

Hallucinations in LLMs

Quiz
45

The Transformer Architecture

Quiz
46

Model Parameters and Scale

Quiz
47

Temperature and Sampling Parameters

Quiz
48

Prompt Injection and Adversarial Prompts

Quiz
49

Practical Applications of Generative AI

Quiz
50

Parameter-Efficient Fine-Tuning (LoRA)

Quiz
51

Multimodal Generative Models

Quiz
52

Emergent Abilities in Large Models

Quiz
53

Scaling Laws for LLMs

Quiz
54

Pretraining LLMs on Large Corpora

Quiz
55

Instruction Tuning

Flashcard
56

Greedy vs Beam Search Decoding

Flashcard
57

System Prompts and Role Instructions

Flashcard
58

Zero, One, and Few-Shot Prompting

Flashcard
59

Top-k and Top-p Sampling

Flashcard
60

In-Context Learning

Flashcard
61

Retrieval-Augmented Generation (RAG)

Flashcard
62

RLHF

Flashcard
63

Chain-of-Thought Prompting

Flashcard
64

Temperature and Sampling Parameters

Flashcard
65

Hallucinations in LLMs

Flashcard
66

Embeddings and Vector Databases

Flashcard
67

Prompt Injection and Safety

Flashcard
68

Parameter-Efficient Fine-Tuning

Flashcard
69

Text-to-Image and Multimodal Models

Flashcard
70

Fine-tuning vs Prompting vs RAG

Flashcard
71

Generative Adversarial Networks

Flashcard
72

Encoder, Decoder, and Encoder-Decoder

Flashcard
73

Foundation Models Concept

Flashcard
74

Knowledge Cutoff and Model Staleness

Flashcard
75

Limitations and Risks of LLMs

Flashcard
76

Diffusion Models

Flashcard
77

Evaluating Generative Models

Flashcard
78

Next-Token Prediction Objective

Flashcard
79

Emergent Abilities and Scaling Laws

Flashcard
80

What is a Large Language Model

Flashcard
81

Tokenization (Subword/BPE)

Flashcard
82

What is Generative AI

Flashcard
83

Prompt Engineering Basics

Flashcard
84

Pre-training vs Fine-tuning

Flashcard
85

Model Parameters and Scale

Flashcard
86

Autoregressive Text Generation

Flashcard
87

Discriminative vs Generative Models

Flashcard
88

Context Window

Flashcard
89

Self-Supervised Learning for LLMs

Flashcard
QuizAdvanced

Model Parameters and Scale

Parameters are learned weights; more of them generally means more capacity.

What are parameters in an LLM?