Deep Learning with PyTorch Step-by-Step: A Beginner's Guide - Volume III: Sequences & NLP

Revised for PyTorch 2.x!

Why this book?

Are you looking for a book where you can learn about deep learning and PyTorch without having to spend hours deciphering cryptic text and code? A technical book that's also easy and enjoyable to read?

This is it!

How is this book different?

• First, this book presents an easy-to-follow, structured, incremental, and from-first-principles approach to learning PyTorch.
• Second, this is a rather informal book: It is written as if you, the reader, were having a conversation with Daniel, the author.
• His job is to make you understand the topic well, so he avoids fancy mathematical notation as much as possible and spells everything out in plain English.

What will I learn?

In this third volume of the series, you'll be introduced to all things sequence-related: recurrent neural networks and their variations, sequence-to-sequence models, attention, self-attention, and Transformers.

This volume also includes a crash course on natural language processing (NLP), from the basics of word tokenization all the way up to fine-tuning large models (BERT and GPT-2) using the Hugging Face library.

By the time you finish this book, you'll have a thorough understanding of the concepts and tools necessary to start developing, training, and fine-tuning language models using PyTorch.

This volume is more demanding than the other two, and you're going to enjoy it more if you already have a solid understanding of deep learning models.

What's Inside

• Recurrent neural networks (RNN, GRU, and LSTM) and 1D convolutions
• Seq2Seq models, attention, masks, and positional encoding
• Transformers, layer normalization, and the Vision Transformer (ViT)
• BERT, GPT-2, word embeddings, and the HuggingFace library