Should We Prioritize Long-Term Existential Risk?
Cross-posted to the Effective Altruism Forum.
Summary: We should reduce existential risk in the long term, not merely over the next century. We might best do this by developing longtermist institutions1 that will operate to keep existential risk persistently low.
Confidence: Unlikely.
This essay was inspired by a blog post and paper2 by Tom Sittler on long-term existential risk.
Civilization could continue to exist for billions (or even trillions) of years. To achieve our full potential, we must avoid existential catastrophe not just this century, but in all centuries to come. Most work on x-risk focuses on near-term risks, and might not do much to help over long time horizons. Longtermist institutional reform could ensure civilization continues to prioritize x-risk reduction well into the future.
This argument depends on three key assumptions, which I will justify in this essay:
- The long-term probability of existential catastrophe matters more than the short-term probability.
- Most efforts to reduce x-risk will probably only have an effect on the short term.
- Longtermist institutional reform has a better chance of permanently reducing x-risk.