
Effective Machine Learning Teams
Description
Alles über E-Books | Antworten auf Fragen rund um E-Books, Kopierschutz und Dateiformate finden Sie in unserem Info- & Hilfebereich.
Gain the valuable skills and techniques you need to accelerate the delivery of machine learning solutions. With this practical guide, data scientists, ML engineers, and their leaders will learn how to bridge the gap between data science and Lean product delivery in a practical and simple way. David Tan, Ada Leung, and Dave Colls show you how to apply time-tested software engineering skills and Lean product delivery practices to reduce toil and waste, shorten feedback loops, and improve your team''s flow when building ML systems and products.
Based on the authors'' experience across multiple real-world data and ML projects, the proven techniques in this book will help your team avoid common traps in the ML world, so you can iterate and scale more quickly and reliably. You''ll learn how to overcome friction and experience flow when delivering ML solutions.
You''ll also learn how to:
- Write automated tests for ML systems, containerize development environments, and refactor problematic codebases
- Apply MLOps and CI/CD practices to accelerate experimentation cycles and improve reliability of ML solutions
- Apply Lean delivery and product practices to improve your odds of building the right product for your users
- Identify suitable team structures and intra- and inter-team collaboration techniques to enable fast flow, reduce cognitive load, and scale ML within your organization
More details
Other editions
Additional editions

Content
- Intro
- Copyright
- Table of Contents
- Preface
- Who This Book Is For
- How This Book Is Organized
- Part I: Product and Delivery
- Part II: Engineering
- Part III: Teams
- Additional Thoughts
- Conventions Used in This Book
- Using Code Examples
- O'Reilly Online Learning
- How to Contact Us
- Acknowledgments
- From David Tan
- From Ada Leung
- From David Colls
- Chapter 1. Challenges and Better Paths in Delivering ML Solutions
- ML: Promises and Disappointments
- Continued Optimism in ML
- Why ML Projects Fail
- Is There a Better Way? How Systems Thinking and Lean Can Help
- You Can't "MLOps" Your Problems Away
- See the Whole: A Systems Thinking Lens for Effective ML Delivery
- The Five Disciplines Required for Effective ML Delivery
- Conclusion
- Part I. Product and Delivery
- Chapter 2. Product and Delivery Practices for ML Teams
- ML Product Discovery
- Discovering Product Opportunities
- Canvases to Define Product Opportunities
- Techniques for Rapidly Designing, Delivering, and Testing Solutions
- Inception: Setting Teams Up for Success
- Inception: What Is It and How Do We Do It?
- How to Plan and Run an Inception
- User Stories: Building Blocks of an MVP
- Product Delivery
- Cadence of Delivery Activities
- Measuring Product and Delivery
- Conclusion
- Part II. Engineering
- Chapter 3. Effective Dependency Management: Principles and Tools
- What If Our Code Worked Everywhere, Every Time?
- A Better Way: Check Out and Go
- Principles for Effective Dependency Management
- Tools for Dependency Management
- A Crash Course on Docker and batect
- What Are Containers?
- Reduce the Number of Moving Parts in Docker with batect
- Conclusion
- Chapter 4. Effective Dependency Management in Practice
- In Context: ML Development Workflow
- Identifying What to Containerize
- Hands-On Exercise: Reproducible Development Environments, Aided by Containers
- Secure Dependency Management
- Remove Unnecessary Dependencies
- Automate Checks for Security Vulnerabilities
- Conclusion
- Chapter 5. Automated Testing: Move Fast Without Breaking Things
- Automated Tests: The Foundation for Iterating Quickly and Reliably
- Starting with Why: Benefits of Test Automation
- If Automated Testing Is So Important, Why Aren't We Doing It?
- Building Blocks for a Comprehensive Test Strategy for ML Systems
- The What: Identifying Components For Testing
- Characteristics of a Good Test and Pitfalls to Avoid
- The How: Structure of a Test
- Software Tests
- Unit Tests
- Training Smoke Tests
- API Tests
- Post-deployment Tests
- Conclusion
- Chapter 6. Automated Testing: ML Model Tests
- Model Tests
- The Necessity of Model Tests
- Challenges of Testing ML Models
- Fitness Functions for ML Models
- Model Metrics Tests (Global and Stratified)
- Behavioral Tests
- Testing Large Language Models: Why and How
- Essential Complementary Practices for Model Tests
- Error Analysis and Visualization
- Learn from Production by Closing the Data Collection Loop
- Open-Closed Test Design
- Exploratory Testing
- Means to Improve the Model
- Designing to Minimize the Cost of Failures
- Monitoring in Production
- Bringing It All Together
- Next Steps: Applying What You've Learned
- Make Incremental Improvements
- Demonstrate Value
- Conclusion
- Chapter 7. Supercharging Your Code Editor with Simple Techniques
- The Benefits (and Surprising Simplicity) of Knowing Our IDE
- Why Should We Care About IDEs?
- If IDEs Are So Important, Why Haven't I Learned About Them Yet?
- The Plan: Getting Productive in Two Stages
- Stage 1: Configuring Your IDE
- Stage 2: The Star of the Show-Keyboard Shortcuts
- You Did It!
- Conclusion
- Chapter 8. Refactoring and Technical Debt Management
- Technical Debt: The Sand in Our Gears
- Getting to a Healthy Level of Debt Through Tests, Design, and Refactoring
- Refactoring 101
- How to Refactor a Notebook (or a Problematic Codebase)
- The Map: Planning Your Journey
- The Journey: Hitting the Road
- Looking Back at What We've Achieved
- Technical Debt Management in the Real World
- Technical Debt Management Techniques
- A Positive Lens on Debt: Systems Health Ratings
- Conclusion: Make Good Easy
- Chapter 9. MLOps and Continuous Delivery for ML (CD4ML)
- MLOps: Strengths and Missing Puzzle Pieces
- MLOps 101
- Smells: Hints That We Missed Something
- Continuous Delivery for Machine Learning
- Benefits of CD4ML
- A Crash Course on Continuous Delivery Principles
- Building Blocks of CD4ML: Creating a Production-Ready ML System
- How CD4ML Supports ML Governance and Responsible AI
- Conclusion
- Part III. Teams
- Chapter 10. Building Blocks of Effective ML Teams
- Common Challenges Faced by ML Teams
- Effective Team Internals
- Trust as the Foundational Building Block
- Communication
- Diverse Membership
- Purposeful, Shared Progress
- Internal Tactics to Build Effective Teams
- Improving Flow with Engineering Effectiveness
- Feedback Loops
- Cognitive Load
- Flow State
- Conclusion
- Chapter 11. Effective ML Organizations
- Common Challenges Faced by ML Organizations
- Effective Organizations as Teams of Teams
- The Role of Value-Driven Portfolio Management
- Team Topologies Model
- Team Topologies for ML Teams
- Organizational Tactics to Build Effective Teams
- Intentional Leadership
- Create Structures and Systems for Effective Teams
- Engage Stakeholders and Coordinate Organizational Resources
- Cultivate Psychological Safety
- Champion Continuous Improvement
- Embrace Failure as a Learning Opportunity
- Build the Culture We Wish We Had
- Encourage Teams to Play at Work
- Conclusion
- Epilogue: Dana's Journey
- Index
- About the Authors
- Colophon
System requirements
File format: PDF
Copy-Protection: Adobe-DRM (Digital Rights Management)
System requirements:
- Computer (Windows; MacOS X; Linux): Install the free reader Adobe Digital Editions prior to download (see eBook Help).
- Tablet/smartphone (Android; iOS): Install the free app Adobe Digital Editions or the app PocketBook before downloading (see eBook Help).
- E-reader: Bookeen, Kobo, Pocketbook, Sony, Tolino and many more (only limited: Kindle).
The file format PDF always displays a book page identically on any hardware. This makes PDF suitable for complex layouts such as those used in textbooks and reference books (images, tables, columns, footnotes). Unfortunately, on the small screens of e-readers or smartphones, PDFs are rather annoying, requiring too much scrolling.
This eBook uses Adobe-DRM, a „hard” copy protection. If the necessary requirements are not met, unfortunately you will not be able to open the eBook. You will therefore need to prepare your reading hardware before downloading.
Please note: We strongly recommend that you authorise using your personal Adobe ID after installation of any reading software.
For more information, see our eBook Help page.