
A Hands-On Guide to Fine-Tuning Large Language Models with PyTorch and Hugging Face
Description
Alles über E-Books | Antworten auf Fragen rund um E-Books, Kopierschutz und Dateiformate finden Sie in unserem Info- & Hilfebereich.
Are you ready to fine-tune your own LLMs?
This book is a practical guide to fine-tuning Large Language Models (LLMs), combining high-level concepts with step-by-step instructions to train these powerful models for your specific use cases.
Who Is This Book For?
This is an intermediate-level resource?positioned between building a large language model from scratch and deploying an LLM in production?designed for practitioners with some prior experience in deep learning.
If terms like Transformers, attention mechanisms, Adam optimizer, tokens, embeddings, or GPUs sound familiar, you're in the right place. Familiarity with Hugging Face and PyTorch is assumed. If you're new to these concepts, consider starting with a beginner-friendly introduction to deep learning with PyTorch before diving in.
What You'll Learn:
- Load quantized models using BitsAndBytes.
- Configure Low-Rank Adapters (LoRA) using Hugging Face's PEFT.
- Format datasets effectively using chat templates and formatting functions.
- Fine-tune LLMs on consumer-grade GPUs using techniques such as gradient checkpointing and accumulation.
- Deploy LLMs locally in the GGUF format using Llama.cpp and Ollama.
- Troubleshoot common error messages and exceptions to keep your fine-tuning process on track.
This book doesn't just skim the surface; it zooms in on the critical adjustments and configuration?those all-important "knobs"?that make or break the fine-tuning process.
By the end, you'll have the skills and confidence to fine-tune LLMs for your own real-world applications. Whether you're looking to enhance existing models or tailor them to niche tasks, this book is your essential companion.
More details
Person
Daniel Voigt Godoy is a husband, a brother, and a son. In the last 25 years, he had many jobs ? developer, data scientist, teacher, writer ? but he's none of them. He is an avid learner and he has a curious and restless mind.
At age 46, he was finally able to switch gears. It took him several years and lots and lots of questions to figure out what was the right path for him. Now, he's finally at peace and happy with who he is while living his life the best he can.
System requirements
File format: ePUB
Copy protection: Adobe-DRM (Digital Rights Management)
System requirements:
- Computer (Windows; MacOS X; Linux): Install the free reader Adobe Digital Editions prior to download (see eBook Help).
- Tablet/smartphone (Android; iOS): Install the free app Adobe Digital Editions or the app PocketBook before downloading (see eBook Help).
- E-reader: Bookeen, Kobo, Pocketbook, Sony, Tolino and many more (not Kindle).
The file format ePub works well for novels and non-fiction books – i.e., „flowing” text without complex layout. On an e-reader or smartphone, line and page breaks automatically adjust to fit the small displays.
This eBook uses Adobe-DRM, a „hard” copy protection. If the necessary requirements are not met, unfortunately you will not be able to open the eBook. You will therefore need to prepare your reading hardware before downloading.
Please note: We strongly recommend that you authorise using your personal Adobe ID after installation of any reading software.
For more information, see our ebook Help page.