Course

Mathematical Methods for Engineers II

Massachusetts Institute of Technology

This graduate-level course is a continuation of Computational Science and Engineering I. The curriculum covers a variety of essential topics:

Numerical methods
Initial-value problems
Network flows
Optimization

Students will delve into practical applications and theoretical foundations, equipping them with the necessary skills for tackling complex engineering challenges.

Course Lectures

Difference Methods for Ordinary Differential Equations
Gilbert Strang

Play
This module introduces difference methods for solving ordinary differential equations. Students will learn how to apply these techniques to various engineering problems, focusing on accuracy and stability.

Key concepts include:

Understanding eigenvalues and eigenvectors

Application of difference methods in practical scenarios
Finite Differences, Accuracy, Stability, Convergence
Gilbert Strang

Play
This module examines finite differences, emphasizing their accuracy, stability, and convergence properties. Students will engage with various numerical techniques and explore how they apply to solving differential equations.

Topics include:

Finite difference approximations

Convergence criteria

Stability analysis
The One-way Wave Equation and CFL / von Neumann Stability
Gilbert Strang

Play
This module introduces the one-way wave equation, emphasizing the Courant-Friedrichs-Lewy (CFL) condition and von Neumann stability analysis. Students will explore wave propagation phenomena through numerical simulations.

Key learning outcomes include:

Understanding wave equations

Applying stability conditions to numerical methods

Analyzing wave propagation using computational tools
Comparison of Methods for the Wave Equation
Gilbert Strang

Play
This module compares various methods for solving the wave equation, focusing on advantages and limitations. Students will evaluate different numerical techniques and their applications in engineering contexts.

Topics covered include:

Finite difference methods

Analytical solutions

Performance metrics for comparison
Second-order Wave Equation (including leapfrog)
Gilbert Strang

Play
This module focuses on the second-order wave equation, including leapfrog methods. Students will learn the significance of these methods in numerical simulations and their applications in physical systems.

Key aspects include:

Understanding second-order equations

Implementing leapfrog methods for numerical solutions

Investigating practical applications
Wave Profiles, Heat Equation / Point Source
Gilbert Strang

Play
This module investigates wave profiles, focusing on the heat equation and point source phenomena. Students will analyze how these equations model physical systems and phenomena in engineering.

Learning objectives include:

Modeling heat diffusion

Analyzing point source effects

Applying numerical methods to real-world problems
Finite Differences for the Heat Equation
Gilbert Strang

Play
This module covers finite differences specifically for the heat equation, emphasizing techniques and their implementation in solving thermal problems. Students learn about stability, accuracy, and convergence in the context of heat conduction.

Topics include:

Heat equation formulation

Finite difference discretization

Analysis of numerical stability
Convection-Diffusion / Conservation Laws
Gilbert Strang

Play
This module discusses convection-diffusion equations and conservation laws. Students will examine the balance of convection and diffusion processes, critical in various engineering applications such as fluid dynamics and heat transfer.

Key points include:

Understanding convection-diffusion phenomena

Applying conservation laws in modeling

Identifying practical applications in engineering
Conservation Laws / Analysis / Shocks
Gilbert Strang

Play
This module focuses on conservation laws, analysis, and shocks. Students will explore the mathematical modeling of shock waves and how they affect fluid flow, using numerical techniques to analyze these phenomena.

Topics include:

Mathematical formulation of shock waves

Numerical methods for shock analysis

Applications in engineering and physics
Shocks and Fans from Point Source
Gilbert Strang

Play
This module explores the behavior of shocks and fans originating from point sources, examining their mathematical and physical implications. Students will analyze how these concepts are integrated into engineering applications.

Key aspects include:

Mathematical modeling of shock and fan propagation

Applications in aerodynamics and fluid mechanics

Numerical techniques for simulation
Level Set Method
Gilbert Strang

Play
This module introduces the Level Set Method, a numerical technique for tracking interfaces and shapes in complex systems. Students will learn about its application in various engineering fields, including fluid mechanics and material science.

Learning objectives include:

Understanding Level Set Method fundamentals

Implementing the method for interface tracking

Analyzing applications in engineering
Matrices in Difference Equations (1D, 2D, 3D)
Gilbert Strang

Play
This module focuses on matrices in difference equations across one, two, and three dimensions. Students will explore how matrices are utilized in various numerical techniques and their significance in solving engineering problems.

Key points include:

Matrix representation of difference equations

Applications in multidimensional problems

Strategies for efficient computations
Elimination with Reordering: Sparse Matrices
Gilbert Strang

Play
This module introduces elimination with reordering techniques for sparse matrices. Students will learn about the importance of sparsity in computations and how to efficiently solve large-scale systems.

Topics include:

Understanding sparse matrix properties

Elimination techniques for efficient computation

Applications in engineering and scientific computing
Financial Mathematics / Black-Scholes Equation
Gilbert Strang

Play
This module explores financial mathematics, focusing on the Black-Scholes equation, which is fundamental for pricing options and financial derivatives. Students will understand the derivation, application, and numerical solution techniques of this important equation.

Key topics include:

Deriving the Black-Scholes equation

Applications in finance

Numerical methods for solution
Iterative Methods and Preconditioners
Gilbert Strang

Play
This module covers iterative methods and preconditioners, focusing on their importance in solving large linear systems. Students will learn about various iterative techniques and how preconditioning can improve convergence rates.

Key aspects include:

Understanding iterative methods

Introduction to preconditioning techniques

Applications in engineering problems
General Methods for Sparse Systems
Gilbert Strang

Play
This module presents general methods for solving sparse systems. Students will explore various algorithms and their applications, emphasizing the significance of sparsity in making computations more efficient.

Topics include:

Understanding sparse system properties

Numerical methods for sparse matrices

Applications in engineering and computing
Multigrid Methods
Gilbert Strang

Play
This module focuses on multigrid methods, which are powerful techniques for solving differential equations efficiently. Students will learn how multigrid methods reduce computational costs while maintaining accuracy in solutions.

Key points include:

Understanding the multigrid approach

Applications in engineering

Performance analysis
Krylov Methods / Multigrid Continued
Gilbert Strang

Play
This module covers Krylov methods and their continuation with multigrid techniques. Students will learn how these methods are applied to efficiently solve large-scale linear systems and differential equations.

Key learning outcomes include:

Understanding Krylov subspace methods

Combining Krylov methods with multigrid techniques

Applications in engineering and scientific computing
Conjugate Gradient Method
Gilbert Strang

Play
This module discusses the Conjugate Gradient Method, a widely used algorithm for solving large systems of linear equations, particularly those that arise in scientific computing and engineering.

Topics covered include:

Understanding the Conjugate Gradient algorithm

Applications in engineering problems

Performance analysis and convergence
Fast Poisson Solver
Gilbert Strang

Play
This module focuses on the Fast Poisson Solver, which is essential for efficiently solving Poisson's equation in various applications, including electrostatics and fluid dynamics. Students will learn about the numerical techniques and algorithms involved.

Key aspects include:

Understanding Poisson's equation

Fast algorithms for solving the equation

Applications in engineering contexts
Optimization with constraints
Gilbert Strang

Play
This module explores optimization with constraints, focusing on techniques for solving constrained optimization problems in engineering. Students will learn about various methods and their applications in real-world scenarios.

Key points include:

Understanding constrained optimization

Methods for solving optimization problems

Applications in engineering design
Weighted Least Squares
Gilbert Strang

Play
This module focuses on weighted least squares, an important method for regression analysis. Students will explore how to apply this technique to solve problems in engineering and data analysis.

Topics include:

Understanding weighted least squares principles

Applications in engineering and statistics

Numerical solution techniques
Calculus of Variations / Weak Form
Gilbert Strang

Play
This module discusses the calculus of variations and the weak form approach to solving problems in engineering. Students will learn how these mathematical techniques apply to optimization and functional analysis.

Key learning objectives include:

Understanding calculus of variations

Weak form formulations

Applications in engineering problems
Error Estimates / Projections
Gilbert Strang

Play
This module explores error estimates and projections, crucial for understanding the accuracy of numerical methods. Students will learn how to assess and minimize errors in engineering applications.

Topics include:

Understanding error analysis

Projection techniques

Applications in numerical simulations
Saddle Points / Inf-sup condition
Gilbert Strang

Play
This module focuses on saddle points and the inf-sup condition, which are critical in optimizing solutions in constrained systems. Students will explore their significance in engineering and numerical analysis.

Key points include:

Understanding saddle points

Inf-sup conditions in optimization

Applications in engineering problems
Two Squares / Equality Constraint Bu = d
Gilbert Strang

Play
This module discusses two squares and the equality constraint Bu = d, focusing on their applications in optimization problems. Students will learn how to implement these techniques in engineering contexts.

Key topics include:

Understanding equality constraints

Application in optimization problems

Engineering applications
Regularization by Penalty Term
Gilbert Strang

Play
This module introduces regularization by penalty term, a technique used to improve the stability and accuracy of solutions in optimization problems. Students will explore its application in various engineering scenarios.

Key points include:

Understanding penalty terms

Applications in optimization stability

Engineering case studies
Linear Programming and Duality
Gilbert Strang

Play
This module covers linear programming and duality, focusing on solving optimization problems using linear programming techniques and understanding dual relationships. Students will apply these concepts to engineering challenges.

Key aspects include:

Understanding linear programming fundamentals

Application in engineering problems

Exploring duality concepts
Duality Puzzle / Inverse Problem / Integral Equations
Gilbert Strang

Play
This module explores the duality puzzle, inverse problems, and integral equations. Students will learn how these concepts relate to optimization and their applications in engineering and applied mathematics.

Key learning points include:

Understanding duality in optimization

Solving inverse problems

Applications of integral equations