Skip to main content

Designing Machine Learning Systems

[HPP] Chip HuyenJuly 16, 20253 min
2 connections·3 entities in this video→

Holistic Approach to ML System Design

  • 🎯 This book advocates a holistic approach to designing ML systems, considering various components and the objectives of different stakeholders.
  • βœ… The goal is to create systems that are reliable, scalable, maintainable, and adaptive to changing environments and business needs.
  • πŸ“š Content is illustrated with actual case studies, backed by ample references, and reviewed by ML practitioners and experts in specific topics like batch processing or responsible AI.

Target Audience and Scope

  • πŸ’‘ This book is for anyone looking to leverage ML to solve real-world problems, encompassing both deep learning and classical algorithms.
  • πŸš€ It primarily focuses on ML systems at scale, relevant for medium to large enterprises and fast-growing startups, as smaller systems may benefit less from its comprehensive approach.
  • πŸ§‘β€πŸ’» The language is specifically geared toward engineers, including ML engineers, data scientists, data engineers, ML platform engineers, and engineering managers.

Addressing Common ML Challenges

  • πŸ“Š Learn to engineer data and choose the right metrics to effectively solve business problems.
  • βš™οΈ Discover how to deploy models after offline experiments and establish methods to quickly detect, debug, and address issues in production.
  • πŸ› οΈ Automate and improve the often manual, slow, and error-prone process of developing, evaluating, deploying, and updating models.
  • πŸ—οΈ Lay down the foundation for shared ML platform components, such as model stores, feature stores, and monitoring tools, to be reused across various use cases.
Knowledge graph3 entities Β· 2 connections

How they connect

An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.

Hover Β· drag to explore
3 entities
Chapters2 moments

Key Moments

Transcript13 segments

Full Transcript

Topics15 themes

What’s Discussed

ML systems designMachine learningDeep learningClassical algorithmsData scientistsML engineersData engineersML platform engineersResponsible AIBatch processingStream processingModel deploymentProduction monitoringFeature storeMLOps
Smart Objects3 Β· 2 links
ConceptsΒ· 3