Neural Networks and Deep Learning

77 lessons in AI Fundamentals

• Selecting the LSTM Last TimestepCode Quiz
• MaxPool Stride and DownsamplingCode Quiz
• Data Leakage in ScalingCode Quiz
• Counting Conv Layer ParametersCode Quiz
• PyTorch Training LoopCode Quiz
• Dropout Behavior During EvaluationCode Quiz
• Learning Rate Scheduler PlacementCode Quiz
• Conv Layer Input ChannelsCode Quiz
• SGD Parameter UpdateCode Quiz
• Weight Initialization StrategyCode Quiz
• Sigmoid Activation ImplementationCode Quiz
• Forward Pass Through a LayerCode Quiz
• Normalizing Test Data CorrectlyCode Quiz
• Feedforward Network Output LayerCode Quiz
• Counting Iterations per EpochCode Quiz
• Weight Scale and Exploding ValuesCode Quiz
• Batch Normalization FormulaCode Quiz
• Configuring the Adam OptimizerCode Quiz
• Gradient of a Squared ErrorCode Quiz
• Cross-Entropy Loss ComputationCode Quiz
• Weights, Biases, and Weighted SumsSlides / Video
• The Artificial Neuron / PerceptronSlides / Video
• What a Neural Network IsSlides / Video
• Real-World Applications of Deep LearningSlides / Video
• CNN vs RNN Architectures OverviewSlides / Video
• Regularization: Dropout and Weight DecaySlides / Video
• Feature Learning vs Manual Feature EngineeringSlides / Video
• What Makes a Network 'Deep'Slides / Video
• Epochs, Batches, and IterationsSlides / Video
• CNNs OverviewQuiz
• Biological Neuron InspirationQuiz
• Weights and BiasesQuiz
• Why Non-Linearity MattersQuiz
• Common Activation FunctionsQuiz
• Fully Connected LayersQuiz
• Forward PropagationQuiz
• Backpropagation ConceptQuiz
• Learning Rate EffectQuiz
• Epochs, Batches, IterationsQuiz
• RNNs OverviewQuiz
• Dropout RegularizationQuiz
• Weight Initialization ImportanceQuiz
• Perceptron StructureQuiz
• Weighted Sum ComputationQuiz
• Purpose of Activation FunctionsQuiz
• Network LayersQuiz
• What Makes a Network DeepQuiz
• Gradient Descent TrainingQuiz
• Vanishing GradientsQuiz
• Hierarchical Feature LearningQuiz
• Learning Rate and Its Effect on TrainingSlides / Video
• Backpropagation BasicsSlides / Video
• Gradient Descent for OptimizationSlides / Video
• Loss Functions for Neural NetworksSlides / Video
• Forward Propagation BasicsSlides / Video
• Neural Network Layers ExplainedSlides / Video
• Hyperparameters vs Learned ParametersFlashcard
• Neural Networks and Biological InspirationFlashcard
• Epochs, Batches, and IterationsFlashcard
• Artificial Neuron / Perceptron StructureFlashcard
• What Makes a Network 'Deep'Flashcard
• Common Activation FunctionsFlashcard
• Feedforward and Forward PropagationFlashcard
• Learning RateFlashcard
• Convolutional Neural Networks (CNNs)Flashcard
• Recurrent Neural Networks (RNNs)Flashcard
• Regularization (Dropout, etc.)Flashcard
• Input, Hidden, and Output LayersFlashcard
• BackpropagationFlashcard
• Weights, Biases, and Weighted SumFlashcard
• Loss / Cost FunctionsFlashcard
• Why Deep Learning Needs Data and ComputeFlashcard
• Gradient Descent IntuitionFlashcard
• Feature / Representation LearningFlashcard
• Vanishing and Exploding GradientsFlashcard
• Activation Functions: PurposeFlashcard
• Activation Functions: Sigmoid, ReLU, TanhSlides / Video