Designing Machine Learning Systems
[HPP] Chip HuyenJuly 16, 20253 min
2 connectionsΒ·3 entities in this videoβHolistic Approach to ML System Design
- π― This book advocates a holistic approach to designing ML systems, considering various components and the objectives of different stakeholders.
- β The goal is to create systems that are reliable, scalable, maintainable, and adaptive to changing environments and business needs.
- π Content is illustrated with actual case studies, backed by ample references, and reviewed by ML practitioners and experts in specific topics like batch processing or responsible AI.
Target Audience and Scope
- π‘ This book is for anyone looking to leverage ML to solve real-world problems, encompassing both deep learning and classical algorithms.
- π It primarily focuses on ML systems at scale, relevant for medium to large enterprises and fast-growing startups, as smaller systems may benefit less from its comprehensive approach.
- π§βπ» The language is specifically geared toward engineers, including ML engineers, data scientists, data engineers, ML platform engineers, and engineering managers.
Addressing Common ML Challenges
- π Learn to engineer data and choose the right metrics to effectively solve business problems.
- βοΈ Discover how to deploy models after offline experiments and establish methods to quickly detect, debug, and address issues in production.
- π οΈ Automate and improve the often manual, slow, and error-prone process of developing, evaluating, deploying, and updating models.
- ποΈ Lay down the foundation for shared ML platform components, such as model stores, feature stores, and monitoring tools, to be reused across various use cases.
Knowledge graph3 entities Β· 2 connections
How they connect
An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.
Hover Β· drag to explore
3 entities
Chapters2 moments
Key Moments
Transcript13 segments
Full Transcript
Topics15 themes
Whatβs Discussed
ML systems designMachine learningDeep learningClassical algorithmsData scientistsML engineersData engineersML platform engineersResponsible AIBatch processingStream processingModel deploymentProduction monitoringFeature storeMLOps
Smart Objects3 Β· 2 links
ConceptsΒ· 3