Fine-tuning & Model Customization

12 lessons in AI Engineering / Working with LLMs

• Dataset Size and QualityFlashcard
• Train/Validation/Test SplitsFlashcard
• Instruction Fine-Tuning (SFT)Flashcard
• Adapters and Prefix/Prompt TuningFlashcard
• LoRA (Low-Rank Adaptation)Flashcard
• Full vs Parameter-Efficient Fine-TuningFlashcard
• What is Fine-TuningFlashcard
• Preparing Training DatasetsFlashcard
• RLHFFlashcard
• DPO and Preference AlignmentFlashcard
• Fine-Tune vs Prompting vs RAGFlashcard
• QLoRA and Quantized Fine-TuningFlashcard