Posted by: yanzhang | February 16, 2013

Defense Against the Dark Arts: the Reverse Regression Effect

Much like our harmonious world, imagine a world populated with blue and green men living as brothers, ignoring the difference of the color of their skin. Much like our exciting world, both blue and green men get educated, go into the real world, and get jobs. One day, a green activist tells you that according to a recent study, for every given education level, blue men receive much higher salary on average than green men, a clear sign of discrimination against the greens — why should equally educated green men not be paid as much as blue men? After leaving you indignant and disappointed, a blue activist tells you that according to another study, for every salary level, green men are less educated than blue men, a clear sign of discrimination against the blues — why should blue men study harder in school than green men to get the same rewards for their work?

The punchline, of course, is that the two studies come from the same data. Judea Pearl mentions it as a throwaway comment in a general talk “The Art and Science of Cause and Effect,” which I read in his great work Causality. In particular, the paper referenced was Goldberger’s 1984 paper Reverse Regression and Salary Discrimination, with actual data demonstrating the effect (though with a different color palette). I find it surprising that Pearl would dedicate an entire chapter in Causality to Simpson’s Paradox but only one comment in the talk to this effect. While it is somewhat similar to Simpson’s Paradox (which I may talk about some other time), they are decidedly different in origin and I find this phenomenon much more relevant, prominent, and chilling. Let me explain.

“You must have set it up wrong.”

I’ve heard this comment several times already. The argument goes something like this: unless the data is really pathological, we can assume the data is something like a curve for each blue and green on the education vs. salary plot. Let’s say that education is the x-axis and salary the y-axis. The first report shows that in general we need to have the blue curve above the green curve at all vertical slices of the graph. But this means the blue curve must be left of the green curve at all horizontal slices of the graph, which contradicts the second report.

It seems we need the blue line to lie above the green line and to the right of the green line, which is impossible.

Like all other examples of good math done in the wrong situations, the problem lies not with the logic above (which is correct) but with the assumptions. Instead, let’s make another very commonplace generative model:

  • assume the employers were just and higher education corresponds to higher salary, and there is no discrimination at all; (equivalently, have the education vs. salary plot be centered on the x=y line)
  • for whatever reason, have the blue men be more educated than the green men and thus get more salary (this could be, of course, due to prior discrimination in the history of the world, socioeconomic circumstances, etc. But the point is we don’t have that kind of information in our data. That’s why I stressed that the employers were just and not the world).
  • important: add some noise. So we don’t have well-defined lines, but some variation in ability and occasional misplacement of salary to ability.

This gives you a graph that looks more like the following:

A more "realistic" and equally natural model, where the main addition to the previous graph is noise.

And now you see it — on vertical slices, blue tend to be higher; on horizontal slices, blue tends to be on the right, something that we thought was very counter-intuitive due to the “lines” model. As Boris Alexeev pointed out to me, the noise is actually doing all of the work in this model!

The watchful reader will notice that this model makes very few assumptions and is very natural, and surely he/she can make some ideas of real-world data that follows this pattern. This is one main difference between the reverse regression effect and Simpson’s Paradox — by some fairly natural definition of “random,” a random set of data will get into the Simpson’s Paradox situation about 1/60 of the time (see Pearl). The RRE  does not depend on such coincidences.

Interpretations and Discrimination

So what is really going on? Some people get very impatient at this point: “is there discrimination or is there not?” Well, whether you believe my simple generative model or not, what is objectively going on is just that the data is telling a very simple story, which is that A) blue men are more educated and B) more educated people get paid more. Sadly, by trying to torture the data to make it talk, we are overstepping our bounds on what we can extract from the data. What the two activists are doing is trying to pull some complicated mechanism, like discrimination, out in a contorted way from very simple data.

An obvious question to ask at this point is: “how do we tell when discrimination exists?” Well, discrimination is a complicated object and it could come in different forms, including, say:

  • discrimination-1: employers get equally qualified people, but then pay them less if they were green men
  • discrimination-2: employers are just, but the blue people discriminated against green people earlier and green men were put in tough socio-economical situations
  • discrimination-3: …

The point is finding different kinds of discrimination is different, but we have an overloaded (and very emotionally charged!) word “discrimination.” To really find discrimination, you have to define each carefully and look for them separately. Using Pearl’s language, I would outline all different types of discrimination as different causal mechanisms. (formally, this means different graphical models using Pearl’s approach) I would then look at the world and see if those models make sense for the data. Qualitatively, it means something we knew intuitively all along: we need more history about this blue-green world and see how it compares with other worlds: maybe in most other worlds the green men are equally educated as blue men; maybe in this world the education of green men were repressed a century ago and education level has a hereditary effect. In our situation, a careful statement would be something like:

  • discrimination-1: we don’t see discrimination-1, rather evidence against it;
  • discrimination-2: we don’t see it, but we don’t see evidence against either. We don’t have the right kind of data to find discrimination-2.
  • discrimination-3: … 

Yes, reductionism makes it more complicated. But it is necessary if we need to make precise judgments.

Epilogue: the Dark Arts

Why did I mention the Dark Arts? Can this information be maliciously used? Hell yes. I’ve literally just given you a recipe to finagle the politically charged idea of discrimination, GOING BOTH WAYS, from a single set of data. So if you feel like it, you can take basically any reasonable population story and create a perfectly-reasonable-sounding discrimination case against either side! I can even go a step further and see a use case when someone can point to this very effect to claim that no discrimination has taken place in a world where it really did (for example, maybe discrimination has actually caused the blue-green difference in education in the first place)! It is very important to stress that the RRE does not show that discrimination does not exist, rather that similar data like this example alone does not show discrimination. If this commonplace but nuanced situation is not Dark Arts (the knowledge of which is prerequisite to defend against it) of mathematics, I don’t know what is. The only thing I can do is to use this knowledge responsibly;  I hope it has similarly helped you.

Thanks to Boris Alexeev for first pointing me towards this effect and Pearl’s work on Causality. It was one of the best time investments I’ve ever made for mathematics.

-Yan

About these ads

Responses

  1. Thought-provoking. It might be informative to dig up cases where public thought-leaders are doing such dark arts.

    Also, RRE might also be pronounced “multicollinearity”, a situation in regression where two predictors are correlated (in your noisy example, it seems like color is “correlated” with education).

  2. @Long: yes, digging up such cases would be good. A lot of times they aren’t even trying to be dark, of course, but the effects may be bad. As for multicollinearity, I agree it is the situation here. I emphasize the E in RRE because the RRE is the actual act of interpretation (reversing the regression to get opposite-sounding effects) by the data scientist than the situation. So I would word it something like “be careful of the reverse regression effect which happens when you have multicollinearity”.

  3. Interesting… though I think there is an important point to make. It is not that there isn’t discrimination against blues or greens. There is in fact discrimination against both. Simply, the discrimination takes place with regard to two different criteria, education and salary. Boris is correct in pointing out that the phenomenon wouldn’t exist with no scattering, otherwise all the data would lie on x=y. But what can we conclude from the scattering? That, given an “outlier” amongst the blue population, say a member less educated, an employer is likelier to assign such an outlier a higher salary. And similarly, an “outlier” amongst the green population, say a member more educated, is paid less.

    What might we conclude from this empirical fact about the outliers? A simple explanation would be that employer believes in “regression toward the mean.” In particular, given the fact that a less educated member of the blue population is an “outlier,” the employer still expects better performance because of his or her race (hence the higher pay). That is to say, the race (more than the level of education) indicates the level of performance. That sounds like discrimination to me.

    What unifies the two types of discrimination which you describe, that seemingly pull in opposite directions, is that employers STEREOTYPE. Whether such stereotyping is statistically justified in terms of work performance is irrelevant to my point. One might note that I have assumed a certain causal relationship between education and salary–that the latter is, or should be, a function of the former. But I think that is a reasonable assumption.

  4. Hi Philip (I just got back from Paris after a 2-week trip, so I didn’t reply earlier!): I agree with basically everything you say, precisely because you’ve defined “discrimination” in a clear way which happens to be not one of the definitions I’ve used =D. This was kind of my point: the word “discrimination” is overloaded with lots of possible statistical interpretations. I think they are all generally related to “putting more emphasis on a ‘less causal’ variable,” but they are all subtly different. As long as the two people talking about something settle on something, the conversation can be a good one. This is a particularly hard tightrope these days =D

    Two random ideas:
    1) Now, I think the way you chose your wording in the second paragraph is nice so I may steal it for the future. =)
    2) Future mental experiment: I can think of plenty of job situations where race is much more relevant to the job performance than education level; I wonder what “Discrimination” should be then?

  5. Re: Yan
    If you were to trim the outliers so that they conform closer to the pay = edu relation, the effect would be reduced. What the noise does, especially if it’s as strong as the signal–in this case even expanding in an almost perpendicular direction, is to allow comparisons between outliers that are ‘opposite’ (low-pay hi-edu green versus hi-pay low-ed blue, and hi-pay low-ed green versus lo-pay hi-ed blue). It means that within each group, salary and education are not correlated; whether that’s prejudice or not depends on your ideal. Between groups, however, salary and education becomes more of a factor.

    Re: Philip
    It doesn’t seem to be a case of ‘regression’ (Is that technically an actual regression?) toward the mean since the centers of the two clusters still lie on the same line. And if you were to prejudice against both equally, then by definition you are not favoring one over the other; then there is no bias between the two.

  6. Also known as the Base Rate Fallacy, in epidemiology where the death-rates concentrate the mind a bit. Here this tells you that the market is discounting formal education against the larger Green talent-pool, but then selects harder for promotions. So you see the long and short strategies on education, and that contrast won’t go away.


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Categories

Follow

Get every new post delivered to your Inbox.

Join 78 other followers

%d bloggers like this: