You're reading from Pretrain Vision and Large Language Models in Python End-to-end techniques for building and deploying foundation models on AWS

Product type Paperback

Published in May 2023

Publisher Packt

ISBN-13 9781804618257

Length 258 pages

Edition 1st Edition

Languages

Python

Tools

AWS

Concepts

GPT/LLMs

Author (1):

Emily Webber

View More author details

Table of Contents (23) Chapters

Preface

1. Part 1: Before Pretraining

2. Chapter 1: An Introduction to Pretraining Foundation Models FREE CHAPTER

3. Chapter 2: Dataset Preparation: Part One

4. Chapter 3: Model Preparation

5. Part 2: Configure Your Environment

6. Chapter 4: Containers and Accelerators on the Cloud

7. Chapter 5: Distribution Fundamentals

8. Chapter 6: Dataset Preparation: Part Two, the Data Loader

9. Part 3: Train Your Model

10. Chapter 7: Finding the Right Hyperparameters

11. Chapter 8: Large-Scale Training on SageMaker

12. Chapter 9: Advanced Training Concepts

13. Part 4: Evaluate Your Model

14. Chapter 10: Fine-Tuning and Evaluating

15. Chapter 11: Detecting, Mitigating, and Monitoring Bias

16. Chapter 12: How to Deploy Your Model

17. Part 5: Deploy Your Model

18. Chapter 13: Prompt Engineering

19. Chapter 14: MLOps for Vision and Language

20. Chapter 15: Future Trends in Pretraining Foundation Models

21. Index

Why subscribe?

22. Other Books You May Enjoy

Index

As this ebook edition doesn't have fixed pagination, the page numbers below are hyperlinked for reference only, based on the printed edition of this book.

accelerated linear algebra (XLA) 123

accelerator performance

hyperparameters 58

infrastructure optimizations for accelerators on AWS 58, 59

optimizing 58

troubleshooting 60

accelerators 47, 51-53

using 53-55

using, on AWS 56

activation checkpointing 73

Alexa Teacher Model (AlexaTM) 41, 42

Amazon Bedrock 214

Amazon CloudWatch 60

Amazon SageMaker 56

data pipeline, optimizing 88-90

distributed training 68

hyperparameter tuning with 103, 104

Amazon’s Trainium 127

compiled models, running on 126

Amazon Titan 214

artificial intelligence (AI) 75, 150

asynchronous endpoints 166, 195

Asynchronous Successive Halving Algorithm (ASHA) 98

augmentations 29, 30

Augmented Artificial Intelligence (A2I) 198

AWS

deep learning...

The rest of the chapter is locked

You're reading from Pretrain Vision and Large Language Models in Python End-to-end techniques for building and deploying foundation models on AWS

Table of Contents (23) Chapters

Index

Authors (1)

Personalised recommendations for you

You're reading from Pretrain Vision and Large Language Models in Python End-to-end techniques for building and deploying foundation models on AWS

Table of Contents (23) Chapters

Index

Unlock this book and the full library FREE for 7 days

Authors (1)

Personalised recommendations for you