This textbook offers a comprehensive introduction to deep learning and neural networks, integrating core foundations with the latest advances. It begins with essential machine learning concepts and classic neural network architectures before progressing through convolutional models, backpropagation, regularization, generalization theory, PAC learning, and Boltzmann machines. Advanced chapters cover sequence models — including recurrent networks, LSTMs, attention, Transformers, state-space models, and large language models — alongside deep generative approaches such as VAEs, GANs, and diffusion models. Emerging topics include graph neural networks, self-supervised learning, metric learning, reinforcement learning, meta-learning, model compression, and knowledge distillation.
Balancing mathematical rigor with hands-on practice, Elements of Deep Learning emphasizes both theoretical depth and real-world application. Different theories are introduced with PyTorch-based code examples, helping readers to translate theory into implementation. Organized into five sections—fundamentals, sequence models, generative models, emerging topics, and practice—the text provides a unified roadmap for mastering modern deep learning.
Designed for advanced undergraduates, graduate students, instructors, and professionals in engineering, computer science, mathematics, and related fields, this book serves both as a primary course text and a reliable reference. With minimal prerequisites in linear algebra and calculus, it offers accessible explanations while equipping readers with practical tools for applications in vision, language, signal processing, healthcare, and beyond.
Benyamin Ghojogh received the B.Sc. degree in electrical engineering from the Amirkabir University of Technology, Tehran, Iran, in 2015, the M.Sc. degree in electrical engineering from the Sharif University of Technology, Tehran, Iran, in 2017, and Ph.D. in electrical and computer engineering (in the area of pattern analysis and machine intelligence) from the University of Waterloo, Waterloo, ON, Canada, in 2021. He was a postdoctoral fellow, focusing on machine learning, at the University of Waterloo, in 2021. He is the co-author of Elements of Dimensionality Reduction and Manifold Learning, published by Springer. His research interests include machine learning, deep learning, dimensionality reduction, data science, and computer vision.
Ali Ghodsi is a Professor of Statistics and Computer Science at the University of Waterloo, Director of the Data Science Lab, and a Faculty Affiliate at the Vector Institute for Artificial Intelligence. His research focuses on the theoretical foundations and algorithmic development of machine learning and artificial intelligence, with applications in natural language processing, bioinformatics, and computer vision.
He is the co-author of Elements of Dimensionality Reduction and Manifold Learning (Springer). His widely viewed online lectures — including a popular deep learning course — make advanced AI topics accessible to a global audience.
