Skip to main content

Soumith Chintala's Perseverance: The Story Behind PyTorch

[HPP] Soumith ChintalaNovember 14, 20257 min
14 connections·13 entities in this video→

Early Struggles and Rejections

  • πŸ’‘ Soumith Chintala, co-creator of PyTorch, faced immense adversity early in his career, including struggling with mathematics as a teenager and attending a tier 2 engineering school.
  • 🎯 He was rejected by 27 universities for graduate studies, initially receiving 12 rejections and then 15 more after reapplying.
  • πŸ“Œ Despite these setbacks, he made a bold leap of faith, flying to the US on a research internship visa without graduate school admissions or job offers.

A Pivotal Turn

  • πŸŽ“ Chintala was finally accepted into New York University (NYU), where he thrived under the mentorship of AI pioneer Yann LeCun.
  • 🧠 At NYU, he honed his deep learning skills and began contributing to open-source projects, finding a mentor who recognized his potential.
  • ⚠️ Even with a master's degree and top research experience, he faced continued rejections for AI research roles, including three times from Google's DeepMind, leading him to take a job as a test engineer at Amazon.

Breakthrough at FAIR

  • πŸš€ Chintala's relentless perseverance led to a breakthrough opportunity when Yann LeCun, his former mentor, recruited him to Facebook AI Research (FAIR) in 2014.
  • βœ… Soon after joining, he proved his worth by identifying and fixing a subtle numerical bug that had stumped senior engineers for weeks, solving a critical project issue.
  • ✨ This achievement boosted his confidence and set the stage for him to build something impactful in the AI field.

The Birth of PyTorch

  • πŸ› οΈ By 2016, Chintala led a small team with a vision to create a more intuitive and flexible AI research tool, which became PyTorch.
  • πŸ“‰ PyTorch's development almost ended prematurely as internal management nearly canceled the project, not seeing its value, a moment Chintala described as devastating.
  • πŸ‘ Fortunately, his mentors championed the project, allowing PyTorch to launch in early 2017 and achieve a meteoric rise in the AI research landscape.

A Legacy of Resilience

  • πŸ“ˆ Today, PyTorch boasts over 90% adoption in the AI research community and powers major AI companies, demonstrating its profound impact.
  • πŸ”‘ Chintala's journey from a struggling test engineer to a VP at Meta and the creator of an industry-standard framework is a powerful lesson in resilience and refusing to give up.
  • 🌱 His goal with PyTorch was to lower the barrier to entry for AI research, proving that beginnings don't define destiny and rejection is merely a hurdle to overcome.
Knowledge graph13 entities Β· 14 connections

How they connect

An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.

Hover Β· drag to explore
13 entities
Chapters4 moments

Key Moments

Transcript26 segments

Full Transcript

Topics15 themes

What’s Discussed

Artificial IntelligencePyTorchSoumith ChintalaDeep LearningOpen-Source ProjectsCareer RejectionPerseveranceFacebook AI Research (FAIR)Software FrameworksAI ResearchVisa IssuesYann LeCunResilienceGraduate StudiesBarrier to Entry
Smart Objects13 Β· 14 links
PeopleΒ· 2
ProductΒ· 1
CompaniesΒ· 6
ConceptsΒ· 2
LocationΒ· 1
EventΒ· 1