Philanthropists Probably Shouldn't Mission-Hedge AI Progress
Summary
Confidence: Likely. [More]
Some people have asked, “should we invest in companies that are likely to do particularly well if transformative AI is developed sooner than expected?”1
In a previous essay, I developed a framework to evaluate mission-correlated investing. Today, I’m going to apply that framework to the cause of AI alignment.
(I’m specifically looking at whether to mission hedge AI, not whether to invest in AI in general. [More])
Whether to mission hedge crucially depends on three questions:
- What is the shape of the utility function with respect to AI progress?
- How volatile is AI progress?
- What investment has the strongest correlation to AI progress, and how strong is that correlation?
I came up with these answers:
- Utility function: No clear answer, but I primarily used a utility function with a linear relationship between AI progress and the marginal utility of money. I also looked at a different function where AI timelines determine how long our wealth gets to compound. [More]
- Volatility: I looked at three proxies for AI progress—industry revenue, ML benchmark performance, and AI timeline forecasts. These proxies suggest that the standard deviation of AI progress falls somewhere between 4% and 20%. [More]
- Correlation: A naively-constructed hedge portfolio would have a correlation of 0.3 at best. A bespoke hedge (such as an “AI progress swap”) would probably be too expensive. An intelligently-constructed portfolio might work better, but I don’t know how much better. [More]
Across the range of assumptions I tested, mission hedging usually—but not always—looked worse on the margin2 than investing in the mean-variance optimal portfolio with leverage. Mission hedging looks better if the hedge asset is particularly volatile and has a particularly strong correlation to AI progress, and if we make conservative assumptions for the performance of the the mean-variance optimal portfolio. [More]
The most obvious changes to my model argue against mission hedging. [More] But there’s room to argue in favor. [More]
Continue reading