Data Science & Psychology Data Science applied to Values, Morals, Politics, & things that matter.

5Apr/12

Big Data Should Measure Value Fit

I gave a presentation at South by Southwest earlier this month.  I appreciate the many people who voted for my idea, who attended my talk, and who gave me feedback via twitter or face to face afterwards. It was a great experience.

It was a great experience, not for the people I met or for the thrill of speaking , both of which were nice, but more so because it forced me to think deeply about what I wanted to say.  A famous writer once said that “How do I know what I think until I see what I say?”.  My thoughts are still evolving (one person, who was positive about the talk, commented to me after that she could see my thoughts evolve on stage), and if I did the presentation over, I would frame it differently, but what I believe I arrived at, is this: Big data should measure value fit.  Or perhaps more generally, the proliferation of data should be used to measure the intangible things that we say are important to us.

Here is more or less what I ended up saying in narrated powerpoint:

I was happy with my talk, but I will try to simplify things a bit the next time I do it.  Rather than present more cool findings from psychology, which are endless but ultimately forgotten, I would have focused more clearly on the point I started with: that we need to bridge the gap between the things we say we care about and the things that we measure.

Just as countries are starting to question whether measuring gross domestic product is a good measurement of that which is worthwhile, companies should start to question whether measuring profits/monthly unique visitors/return on investment/facebook likes/valuation, is measuring that which is worthwhile.  A recurring theme at South by Southwest was a focus on the importance of values and happiness as evidenced by talks with names like "Go Forth and make Awesomeness:  Core Values & Action" or "Why Happiness is the new Currency?".  But while companies talk about values and happiness as outcomes, they don’t measure them, perhaps because they feel like they can’t measure the intangible.  Moral psychology and positive psychology, which deal with the quantification of values and happiness related constructs, can provide this methodology so that big data can eventually be used to measure the right things.

Once you start to think in this way, you can see this need everywhere. On cue, a friend recently sent me this article from the New York Times, that illustrates the points I make.  It’s by a courageous Goldman Sachs employee who quit because of he felt, in the terms of this post, that Goldman was measuring success the wrong way.

How did we get here? The firm changed the way it thought about leadership. Leadership used to be about ideas, setting an example and doing the right thing. Today, if you make enough money for the firm (and are not currently an ax murderer) you will be promoted into a position of influence.

What are three quick ways to become a leader? a) Execute on the firm’s “axes,” which is Goldman-speak for persuading your clients to invest in the stocks or other products that we are trying to get rid of because they are not seen as having a lot of potential profit. b) “Hunt Elephants.” In English: get your clients — some of whom are sophisticated, and some of whom aren’t — to trade whatever will bring the biggest profit to Goldman. Call me old-fashioned, but I don’t like selling my clients a product that is wrong for them. c) Find yourself sitting in a seat where your job is to trade any illiquid, opaque product with a three-letter acronym.

Today, many of these leaders display a Goldman Sachs culture quotient of exactly zero percent. I attend derivatives sales meetings where not one single minute is spent asking questions about how we can help clients. It’s purely about how we can make the most possible money off of them. If you were an alien from Mars and sat in on one of these meetings, you would believe that a client’s success or progress was not part of the thought process at all.

I am sure that Goldman Sachs has sophisticated algorithms to use their giant data sets to predict financial markets and make as much money as possible.  I doubt they’ve ever considered measuring the values of their employees. Sometimes what you measure is a reflection of your values.

- Ravi Iyer

ps. I am not short on projects, but if you would like help taking the data you have and using it to measure intangible/psychological things, feel free to email me.

Comments

comments

Old Comments (4) Trackbacks (3)
  1. Played hooky from my work to listen/watch this…I thought it was a good amt of examples, and that you made your point well. I liked your rather bold stmt that the study of the brain was more the purview of technologists than neurologists- points for impertinence. You also had some references of online projects at the end I didn’t know about that are fun to look at…I used to design sql db’s and test them, for somewhat complex business processes. That is the most fun work I’ve ever done.

    The whole presentation reminded me, as happens occasionally to me nowadays, of the social scientist/data modeler hero at the beginning of the Foundation series. I remember reading it as a kid and thinking ‘what a dorky, unrealistic idea.’ But in my lifetime, data has become incredibly useful, and will continue to become more so as people continually progress to asking better and better questions. Yours here- why not measure value?- is already being asked, of course, but not so much your “How do we stop being balkanized?”, which, as we discussed a few weeks back, is a more and more urgent question. Seems a shame to leave it to the capitalists selling popsicles and the facebook team.

    Does hypothes.is seem like they’ll realistically assist with your desires for convergence to broader, standardized data sets? They do seem to be trying to subvert the peer-review paradigm, but I’m a bit lost on 1) whether they view their role in academia as supplementary or revolutionary, and 2) their data strategies. Data supersets, metadata and standardized interdisciplinary db structures seem such a natural extension.

  2. Scott, thanks for pointing out hypothes.is. I’m excited to see what comes of it.

  3. Just discovered this blog from the NYT article in the “Campaign Stops” series published on April 29th. I’m curious, assuming a high school principal or superintendent just read this, and is contemplating the slide presentation, is there a viable application of these ideas to measuring public school success? In terms of what we measure vs. what we care about, and the gap between them, it seems to me like there is a real and important opportunity to talk about the content and approach to data/values you discuss here using public education as the unit of analysis. I couldn’t help but think of test scores, grades, attendance records, and misbehavior counts vs. competence, creativity, economic viability, and self-fulfillment when viewing the “what we measure vs. what we care about” slide. Are you aware of any applications of this thinking to public education already in existence? I suspect there are, and having just discovered the blog, I admit I haven’t invested the time in going back to read the years of posts that probably include the answer to my question. But, doing that reading is now a new item in my GTD. Thanks for sharing this work.

  4. I hadn’t thought of that, but part of my motivation in doing the presentation is to hopefully inspire others to try to think of what “intangible” things that they actually care about that they could use recent data techniques to help illuminate. I agree that there is a definite opportunity in education to use data to improve the things we care about more, though, not being an educational psychologist, I don’t think I’d know better than anyone else what those things that we need to measure are, in the educational realm. It would be a great and worthy problem to try to solve and maybe I’ll check with some people in the education school here to see if they have ideas. Thanks for a great idea and maybe a passing reader will do something interesting with it…:)


Leave a comment