Skip to main content

Good and Evil Are Obsolete: Morality in an Age of God-like Power

[HPP] Nick BostromFebruary 9, 20269 min
23 connections·37 entities in this video→

The Evolutionary Roots of Morality

  • πŸ’‘ Human morality evolved as a set of social instincts around 2 million years ago to enable cooperation in early human groups.
  • 🧠 Emotions like empathy, guilt, shame, and moral outrage were favored by natural selection because they helped tribes survive and outcompete others.
  • 🎯 These moral responses were calibrated for the Stone Age, solving problems like resource scarcity and conflicts within small groups.

The Moral Placeholder Theory

  • πŸ”‘ This theory posits that morality was never meant to be permanent, serving as a temporary placeholder for a barely intelligent species.
  • πŸš€ As humanity gains god-like capabilities through technology (nuclear weapons, AI, gene editing), these Stone Age moral frameworks are becoming obsolete.
  • ⚠️ Traditional moral philosophy struggles with modern problems like editing human embryos or creating conscious AI, as evolution never encountered such scenarios.

Technology Outpaces Moral Frameworks

  • πŸ’₯ The development of nuclear weapons in 1945 forced the creation of new frameworks like deterrence theory, stretching "thou shalt not kill" beyond recognition.
  • πŸ€– Artificial intelligence could soon make life-and-death decisions faster than humans, raising questions about which human morality to program and its inherent inconsistencies.
  • 🧬 Gene editing challenges traditional values, as our evolved morality has no answer for choices like eliminating genetic diseases or enhancing human traits.

Uncomfortable Implications

  • πŸ’‘ If morality is an evolutionary adaptation, there's no objective basis for right and wrong; murder "feels wrong" due to ancestral survival.
  • 🚧 Stone Age moral intuitions may actively impede progress in areas like developing super-intelligence or genetically engineering humans for extended lifespans.
  • πŸ”„ The theory suggests we may be forced to abandon moral frameworks entirely, replacing them with rational calculation or optimization algorithms.

The Future of Morality

  • βš–οΈ A counterargument suggests morality is a capacity we refine, like mathematics, and can be expanded to include all sentient beings.
  • ⏳ Humanity faces a critical test: either constrain our power to fit our current morality or abandon our morality to match our power.
  • ⚑ The "moral operating system" that got us this far is approaching its expiration date, leading to something fundamentally different for humanity.
Knowledge graph37 entities Β· 23 connections

How they connect

An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.

Hover Β· drag to explore
37 entities
Chapters5 moments

Key Moments

Transcript35 segments

Full Transcript

Topics15 themes

What’s Discussed

Moral Placeholder TheoryEvolutionary MoralitySocial InstinctsNatural SelectionStone Age MoralityTechnological CapabilitiesNuclear WeaponsArtificial Intelligence EthicsGene EditingExistential RiskDeterrence TheoryGenetic EngineeringSuper-intelligenceMoral ProgressHuman Morality
Smart Objects37 Β· 23 links
PeopleΒ· 6
ProductΒ· 1
ConceptsΒ· 28
LocationΒ· 1
EventΒ· 1