Preventing Human Extinction, Now With Numbers!

Part of a series on quantitative models for cause selection.

Introduction

Last time, I wrote about the most likely far future scenarios and how good they would probably be. But my last post wasn’t precise enough, so I’m updating it to present more quantitative evidence.

Particularly for determining the value of existential risk reduction, we need to approximate the probability of various far future scenarios to estimate how good the far future will be.

I’m going to ignore unknowns here–they obviously exist but I don’t know what they’ll look like (you know, because they’re unknowns), so I’ll assume they don’t change significantly the outcome in expectation.

Here are the scenarios I listed before and estimates of their likelihood, conditional on non-extinction:

*not mutually exclusive events

(Kind of hard to read; sorry, but I spent two hours trying to get flowcharts to work so this is gonna have to do. You can see the full-size image here or by clicking on the image.)

I explain my reasoning on how I arrived at these probabilities in my previous post. I didn’t explicitly give my probability estimates, but I explained most of the reasoning that led to the estimates I share here.

Some of the calculations I use make certain controversial assumptions about the moral value of non-human animals or computer simulations. I feel comfortable making these assumptions because I believe they are well-founded. At the same time, I recognize that a lot of people disagree, and if you use your own numbers in these calculations, you might get substantially different results.

Continue reading
Posted on

Expected Value Estimates You Can (Maybe) Take Literally

Part of a series on quantitative models for cause selection.

Alternate title: Excessive Pessimism About Far Future Causes

In my post on cause selection, I wrote that I was roughly indifferent between $1 to MIRI, $5 to The Humane League (THL), and $10 to AMF. I based my estimate for THL on the evidence and cost-effectiveness estimates for veg ads and leafleting. Our best estimates suggested that these are conservatively 10 times as cost-effective as malaria nets, but the evidence was fairly weak. Based on intuition, I decided to adjust this 10x difference down to 2x, but I didn’t have a strong justification for the choice.

Corporate outreach has a lower burden of proof (the causal chain is much clearer) and estimates suggest that it may be ten times more effective than ACE top charities’ aggregate activities1. So does that mean I should be indifferent between $5 to ACE top charities and $0.50 to corporate campaigns? Or perhaps even less, because the evidence for corporate campaigns is stronger? But I wouldn’t expect this 10x difference to make corporate campaigns look better than AI safety, so I can’t say both that corporate campaigns are ten times better than ACE top charities and also that AI safety is only five times better. My previous model, in which I took expected value estimates and adjusted them based on my intuition, was clearly inadequate. How do I resolve this? In general, how can we quantify the value of robust, moderately cost effective interventions against non-robust but (ostensibly) highly cost effective interventions?

To answer that question, we have to get more abstract.

Continue reading
Posted on

How Valuable Are GiveWell Research Analysts?

Update 2016-05-18: I no longer entirely agree with this post. In particular, I believe GiveWell employees are more replaceable than this post suggests. I may write about my updated beliefs in the future.

Edited 2016-03-11 because I’ve adjusted my estimate of the value of global poverty charities downward, which makes working at GiveWell look worse.

Edited 2016-03-11 to add a new section.

Edited 2016-02-16 to update the model based on feedback I’ve received. Temporal replaceability doesn’t apply so I was underestimating the value of research analysts.

Summary: The value of working as a research analyst1 at GiveWell is determined by:

  • Temporal replaceability of employees
  • How good you are relative to the counterfactual employee
  • How much good GiveWell money moved does relative to where you could donate earnings
    • A lot if you care most about global poverty, not as much if you care about other cause areas
  • How directly more employees translate into better recommendations and more money moved
    • This relationship looks strong for Open Phil and weak for GiveWell Classic

If you believe GiveWell top charities are the best place to donate, working at GiveWell is probably a really strong career option; if you believe other charities are substantially better (as I do) and you have good earning potential, earning to give is probably better.

Continue reading
Posted on

Are GiveWell Top Charities Too Speculative?

The common claim: Unlike more speculative interventions, GiveWell top charities have really strong evidence that they do good.

The problem: Thanks to flow-through effects, GiveWell top charities could be much better than they look or they could be actively harmful, and we have no idea how big their actual impact is or if it’s even net positive.

Continue reading
Posted on

More on REG's Room for More Funding

I have received some interest from a few people in donating to REG, and the main concern I’ve heard has been about whether REG could effectively use additional funding. I spent some more time learning about this. My broad conclusion is roughly the same as I wrote previously: REG can probably make good use of an additional $100,000 or so, and perhaps more but with less confidence.

Poker Market Saturation

Tobias from REG claims that about 70% of high-earning poker players have heard of REG, although many of those have had only limited engagement. He claims that they have had the most success convincing players to join through personal contact, and REG has not had contact with many of the players who have heard of it. This gives some reason to be optimistic that REG can expand substantially among high-earning poker players, although I would not be surprised if it started hitting rapidly diminishing returns once it grows to about 2x its current size.

To date, REG has not spent much effort on marketing to non-high-earning poker players. This field is much larger, but targeting lower-earning players should be less efficient because each individual player donates less money. To get a better sense of how important this is, I would have to know what the income distribution looks like for poker players, and getting this information is nontrivial.

REG would like to hire a new marketing person with experience in the poker world. They would probably be considerably better at marketing than any of the current REG employees. For this reason, additional funds to REG may actually be more effective than past funds, although this is difficult to predict in advance.

Continue reading
Posted on

Excessive Optimism About Far Future Causes

In my recent post on cause selection, I constructed a model where I broke down by category all the charities REG has raised money for and gave each category a weight based on how much good I thought it did. I put a weight of 1 on my favorite object-level charity (MIRI) and gave other categories weights proportional to that. I put GiveWell-recommended charities at a weight of 0.1–that means I’m about indifferent between a donation of $1 to MIRI and $10 to the Against Malaria Foundation (AMF).

Buck criticized my model, claiming that my top charity, MIRI, is more than ten times better than AMF and I’m being too conservative. But I believe that this degree of conservatism is appropriate, and a substantially larger ratio would be epistemically immodest.

Continue reading
Posted on

A Consciousness Decider Must Itself Be Conscious

Content note: Proofs involving computation and Turing machines. Whether you understand the halting problem is probably a good predictor of whether this post will make sense to you.

I use the terms “program” and “Turing machine” interchangeably.

Continue reading
Posted on

Should Altruists Leverage Donations?

Disclaimer: I am not a financial advisor. This is not financial advice.

Effective altruists often debate the question of whether to give now or later. One common approach is to give a regular donation each year. This approach makes a lot of sense: here Holden Karnofsky suggests a few reasons why we should give regularly.

But one problem arises with the “give regularly” strategy. If you’re young, and especially if you’re still in school, you probably aren’t earning much money right now, so you can’t donate much. You will earn a lot more money five or ten years from now, which means you’ll also be donating a lot more. If you’re currently a student and you follow the “donate however much I can afford every year” strategy, you end up leaning heavily toward giving more later.

This mirrors the problem described by Ayres and Nalebuff in Lifecycle Investing: if you’re saving for retirement, you end up saving a lot more money later in life. They recommend that most people leverage investments when they’re young and hold more bonds when they’re older in order to spread risk more evenly across their investing lifetimes (or, as they put it, to improve temporal diversification).

We can apply a similar principle to donations. If you don’t earn much now but expect to earn substantially more in the future, you can “leverage” your donations by donating more than you normally would given your income.

It’s not obvious how to do this. There are three basic methods I can see: taking out loans, foregoing savings, and donating trust fund savings. None of these is perfect, but they’re worth considering.

Continue reading
Posted on

My Cause Selection: Michael Dickens

Cross-posted to the EA Forum. If you want to leave a comment, you can post it there.

Last edited 2015-09-24.

In this essay, I provide my reasoning about the arguments for and against different causes and try to identify which one does the most good. I give some general considerations on cause selection and then lay out a list of causes followed by a list of organizations. I break up considerations on these causes and organizations into five categories: Size of Impact; Strength of Evidence; Tractability; Neglectedness/Room for More Funding; Learning Value. This roughly mirrors the traditional Importance; Tractability; Neglectedness criteria. I identify which cause areas look most promising. Then I examine a list of organizations working in these cause areas and narrow down to a few finalists. In the last section, I directly compare these finalists against each other and identify which organization looks strongest.

You can skip to Conclusions to see summaries of why I prioritize the finalists I chose, why I did not consider any of the other charities as finalists, and my decision about who to fund.

TL;DR

I chose these three finalists:

Based on everything I considered, REG looks like the strongest charity because it produces a large donation multiplier and it directs donations to both MIRI and ACE (as well as other effective charities).

Continue reading
Posted on

On Values Spreading

Cross-posted to the EA Forum.

Introduction

Note: When I speak of extinction risk in this essay, it refers not just to complete extinction but to any event that collapses civilization to the point where we cannot achieve highly good outcomes for the far future.

There are two major interventions for shaping the far future: reducing human extinction risk and spreading good values. Although we don’t really know how to reduce human extinction, the problem itself is fairly clear and has seen a lot of discussion among effective altruists. Values spreading is less clear.

A lot of EA activities could be classified as values spreading, but of very different sorts. Meta-organizations like Giving What We Can and Charity Science try to encourage people to value charity more highly; animal charities like The Humane League and Animal Ethics try to get people to assign greater weight to non-human animals. Many supporters of animal welfare interventions believe that these interventions have a large positive effect on the far future via spreading values that cause people to behave in ways that make the world better.

I believe that reducing extinction risk has a higher expected value than spreading good values, and there are a number of concerns with values spreading that make me reluctant to support it. This essay lays out my reasoning.

Personal note: In 2014 I directed my entire donations budget to The Humane League, and in 2015 I directed it to Animal Charity Evaluators. At the time, I generally agreed with the arguments that values spreading is the most important intervention. But recently I have considered this claim more carefully and now I am more skeptical, for the reasons outlined below.

Continue reading
Posted on

Page 7 of 9