The Thing and the Symbolic Representation of The Thing

Let’s assume there is a thing that all would agree is, in context, a Good Thing(tm) that someone in your situation would want.

Do you want the thing, or do you want the symbolic representation of the thing?*

This sounds like an easy question; obviously you want the thing! Alas, it is often not that simple. Even when the thing itself would be most valuable, often the symbolic representation of the thing is what is in demand and gets produced.

One of MetaMed’s biggest mistakes was not realizing that this applied to health care. As Robin Hanson put it, health care is not about health: The system is more concerned with making sure everyone is able to signal, to others and to themselves, that they care deeply and that they are doing everything they can. This drives people’s decisions strongly enough to usually dominate decision making when the stakes are high. The actual health effects of the decisions involved are often a secondary concern, and the costs a distant third. The risk of not doing the standard thing, or what your doctor told you to do, looms larger than the fact that you believe that the decision is wrong; if you go against that advice, then you are not doing the responsible thing, you don’t care for yourself or your loved ones, and everything that happens to you after that is your fault.

Unsurprisingly, this leads to some very poor decisions when looked at in terms of what has a positive impact on the people’s health. And of course, everyone involved being afraid of being sued (far beyond the statistical danger of actually being sued) every time they deviate from the standard of care makes this that much worse.

MetaMed’s central thesis was that people cared enough about their health that if the information on how to save their life was available to them, they would have to buy it, and they would be willing to pay at least a small fraction of what that information was worth.

This theory was tested, and was conclusively falsified. Or rather, the following was conclusively falsified:

If a person is convinced that information could become available that might save their life, that person will often be willing to buy that information for a small fraction of what that belief implies the information is worth to them.

The experiment was not a randomized controlled trial, nor was the sample size all that big, but the data was clear and conclusive: A non-zero number of people will do this, but the vast majority of people will not.

Two points of failure are being explicitly excluded here.

The first is: Did we actually have that information? I would argue that we did, and believe we very much did right by those who hired us in terms of getting them the information they needed and/or requested, but of course I am biased, and we will never know for sure.

The second is: Did we manage to convince people that we had or could acquire this information? Our success rate on this was not all that high; certainly the majority of people who considered this hypothesis rejected it, most of them doing so quickly. Like any good start-up, and many bad ones, we did not let this stop us, and we kept pitching. Eventually we found a decent number of people who we did convince. We should have been able to do this more often, and were improving at it, but that is another story.

The important thing is that while it was only a fraction of the people we attempted to convince, many people explicitly said that they believed we had or could acquire this information in exchange for money, and I have no reason to doubt them. We have a sample size well into the triple figures of such people.

The majority of them did not buy. Of those who did buy, the majority of them chose a project far smaller than their problems justified, and intensely haggled to make that size as small as possible.

Then, in the end, many were dissatisfied because we had given them the thing rather than the symbolic representation of the thing. In one case, the person went so far as to show us the symbolic representation of the thing that the person was hoping to buy – a very colorful and nicely formatted informational packet that did not contain the information this person needed to deal with their very serious health problem, in part because the packet was completely out of date.

It took us over a year, and over forty cases, to realize that when we delivered a report, it was not being evaluated on the basis of whether the information would improve health outcomes. It was being evaluated on the basis of whether it looked like an expensive report should look, and whether it looked like they had ‘gotten their money’s worth’ in terms of the work that was visible. The work that was visible, of course, was mostly distinct from the work that could make them healthier.

Over time, we moved from spending almost all our time and effort into helping find ways to improve people’s health, and inventing a system to make that happen efficiently without wasting money on other things, to figuring out how to make people feel listened to and show them (ideally grey-haired and well-credentialed) doctors that spoke with proper authority and confidence, and then give them reports that were laid out as beautifully as possible and looked expensive and professional, and do that as efficiently as possible so we could deliver our actual research payload that might actually help them. Everything depended on convincing the right people that we were capable of presenting the proper symbolic representations, so we could get continued funding for our operations and improve our symbolic representations in the hopes of finally being able to get more sales at the now much higher price point that was necessary in order to deliver the symbolic representation of our product, without which our product would never get to help anyone, as well as also deliver the actual product.

We had a bunch of people who care very deeply about helping and making sure the product actually works, and were deeply concerned about every minute spent on anything else, so the temptation was never there to only deliver the symbolic representation and stop actually helping people. I think that people who would have been capable of that would have never founded MetaMed in the first place! But that is the natural outcome of such a process after enough rounds of selection pressure: Only the symbolic representation remains.

A number of the products and services we attempted to buy, or which others attempted to sell to us, had either gone through this process or had skipped it entirely by never being real in the first place. Instead, they existed so that people could tell themselves they were doing a Responsible Business Thing that businesses needed to do, rather than working to get the benefits that thing would provide if it was actually done. Most times we hired people from outside the core team to complete key tasks, and those tasks could not be fully and explicitly specified, those tasks did not actually get done. Instead, the people involved did things symbolically representative of the task, and billed us or collected their salaries continuously until we realized the things involved never got done. When we then investigated, it became clear the decisions being made did not make any sense if one was looking to help a company succeed; they only made sense in terms of what would superficially look like doing the job if not examined too closely, or would be vaguely associated with the job getting done if one never thought about how things would physically progress from point A to point B.

Michael Vassar speculates that this has overtaken giant sections of the economy, and that many or even most products and services are symbolic representations of themselves first and the product or service itself second or not at all. I certainly find examples of this all around me. This last week, my wife and I went on vacation to a place that charges quite a bit of money for things that I see no value in, but which she enjoys greatly, and I believe that what she enjoys is that it symbolically says “Vacation” to her. I see the actual thing, and so I do not get it. That is fine. I am not the target (a powerful mantra!). Sometimes, what one needs are not expensive wines but expensive wine bottles. Other times one wants the wisdom, or lack of wisdom, to know the difference.

*The problem with talking about this topic is that I realized that every time I wanted to talk about the details, it would involve accusing someone of fraud or at a minimum completely missing the point, and be at least deeply insulting if not fighting words or grounds for a lawsuit. Thus, the motivating example of this post is completely missing, and a lot of details are being left out that would make this a lot easier to grok. But I’d rather post it this way than not post at all.

This entry was posted in Death by Metrics, Impractical Optimization, Personal Experience, Rationality and tagged , , , . Bookmark the permalink.

38 Responses to The Thing and the Symbolic Representation of The Thing

  1. GDT says:

    Agreed. Seeing the distinction between what people say and what they mean is a difficult skill to learn — at least it was for me.
    I wonder if there is a way to learn awareness of that symbol/substance dichotomy *without* getting burned by it?

  2. Ken Arromdee says:

    I suspect something else is going on. *My* hypothesis is that if someone says they believe you have the information and yet won’t pay what it’s obviously worth to them… they were probably lying when they said they believe you have the information, or at least, expressing higher verbal confidence in that belief than they really had.

    Also, it’s generally a bad idea to spend money or resources on something just because you were convinced of it by an argument, since your argument skills aren’t perfect. Your potential customers may have been just deciding–correctly, on a Bayseian basis–that there is a good chance that something which they are personally convinced of, but which is rejected by society at large and which nobody has ever managed to pull off, is wrong.

  3. Quixote says:

    I gather from this post that metamed was wound down. May I ask what happed to the Key Operating Procedures, Process Manuals, and potentially Outsourcing Specifications, and Business Process Documents, etc. that specified how someone would go about researching a condition and determining a better than standard treatment?
    It seems like the set of instructions someone could follow to do that would be really useful and potentially lifesaving to many.

    • TheZvi says:

      I still have all the documents I wrote detailing how to do things. Sarah Constantin is the one to contact if someone is interested, since she is still doing this type of research on occasion; I’m not.

      Instructions would need to be changed a lot out of the context of the company. And there is at least some risk when showing such things that we could expose ourselves to liability, although that gets more remote every day of course.

  4. glenra says:

    People do judge books by their cover. A $1000+ piece of software has to work but also has to be attractively packaged to a degree that a $50 piece of software probably doesn’t. The $1000 software might come with an attractive hefty well-formatted manual and optional training classes and live phone bank tech support. You can’t make a living selling software that doesn’t work at all, but in addition to making it work there’s a bare minimum necessary infrastructural investment required to make people happy to buy it in the first place so they can *find out* if it works; precisely how much is required will vary depending on the industry segment you’re going after. If you want to charge the big bucks, you probably do need to hire a marketing/docs person to put together something approximating that “colorful and nicely formatted informational packet”.

    • William Newman says:

      “People do judge books by their cover.” Yes, and even when you think you know this, you may not appreciate it properly: the effect can turn out to be an order of magnitude stronger than you expect. I spent a lot of time some years ago working on a computer program to choose the best move in the game of Go — a “go playing program” in the sense of the more common “chess playing program”. One of the unexpected things I learned from that experience was how qualitatively more impressed people were with the appearance of the graphical wrapper that I used to demo it (which was fine but nothing special: free software that I didn’t write myself, a standard program for displaying the board position when two people e.g. play against each other over the internet) than with any of the thinking/choosing/analysis issues that my program was about.

  5. Doug S. says:

    You’re running into another problem. People have no way of telling whether the information you give will improve health outcomes or not. Any quack can say that their cure works, and, sometimes, it even does! The symbolic representations are the only thing they can actually judge the quality of; if you’re wrong, nobody will be able to tell, but they sure can tell if your report has typos in it.

    Furthermore, the advice is only useful if it actually gives a different answer than the conventional wisdom, personified by whatever doctor you’d be seeing. In many cases, the proper treatment, given a correct diagnosis, is obvious because it’s extremely effective. If you have appendicitis, you get your appendix removed, and every doctor knows this. In others, you only get a choice between mostly useless treatments; if you’re getting Alzheimer’s disease, all you can do is maybe buy yourself a few more months.

    The only times Metamed can theoretically benefit a patient are if 1) doctors, in general, disagree with each other and Metamed can find the correct resolution to the controversy, 2) the “correct” treatment for a person’s problem is known by someone somewhere, but isn’t widely put into practice generally (for example, mirror therapy for phantom limb pain) or 3) Metamed employees can actually invent a new treatment that didn’t exist before by applying known information (telling Eliezer to take melatonin in the middle of the day to fix his sleep problem).

    Apparently #2 is a bigger problem than most people would think…

    • Doug S. says:

      This is an old post, but I have since become aware of yet another problem with MetaMed’s product.

      4) Doctors gatekeep a lot of medical treatment, so if you buy a MetaMed report that says Drug X will save your life, you still have to persuade your doctor to prescribe Drug X for you, which is often a lot harder than simply handing them a stack of paper and saying “This says I should take Drug X, so give it to me.” Unless MetaMed has MDs that are willing to write prescriptions based on its recommendations, a report that’s accurate but unpersuasive to a third party isn’t going to help.

  6. Vince says:

    Basically… sales

  7. Orborde says:

    “Most times we hired people from outside the core team to complete key tasks, and those tasks could not be fully and explicitly specified, those tasks did not actually get done. Instead, the people involved did things symbolically representative of the task, and billed us or collected their salaries continuously until we realized the things involved never got done.”

    I’m very interested in hearing more specifics here. What services did you attempt to contract out like this? What did you get instead of what you wanted, and how did it fail to achieve the purpose while still managing to look like applied effort?

  8. David Michael Felt says:

    As someone who was part of the people outside the core firm who did many of those tasks, I take a bit of offense to this but have come to understand that there was a fundamental misunderstanding between the core team and the outer team’s idea of what needed to be done. Communication was a big problem, and I think the disconnect between core and non-core people built up some hostility that did not help. I’m guilty of thinking that the core team just collected salaries and phoned it in at the time, but after reading your post I’m confident you put in the same blood, sweat, tears, and hope that we did.

    As for if people would buy, I think it is reasonable that customers want bedside manner with expensive (but cost effective) healthcare- the answers to your medical problems are worthless if you can’t understand them. However when the emphasis shifts from “is this an effective report” to “does this look expensive” we get into dangerous territory.

    • TheZvi says:

      Thank you for this. To say there were communication problems is some mix of massive understatement and description of the human condition. I didn’t do as good a job of that as I should have, and it caused both a lot of problems and a lot of stress.

      I can laugh about it all now, but that took about two years.

      • David Michael Felt says:

        We never directly interacted but you’re very welcome, my feelings and reflections on the experience have changed a lot over two years and I’m glad we can both laugh about it. I actually recently started doing what is basically an autopsy on the entire company, reading over old emails or news articles along with some financial number crunching and statistical analysis.

        It is actually very interesting what the qualitative and quantitative data reveals about the internal working of the company, our group of contractors, how we interacted, and how the company interfaced with the public. I’m a bit of a geek for seeing how systems and structures work (or fail) so while not perfect I think I figured out a bunch of likely factors that resulted in the problems and ultimately the demise of the company.

        If you’re curious about the autopsy let me know. You made some mistakes because humans make mistakes but those problems and stress had a lot of other causes, I wouldn’t place that much blame for a lot of things on you in the slightest.

        It was a strange time in my life but honestly even with the problems and the stress it was a blast at times, I worked the hardiest in my life up to that point, taught me a great deal, and resulted in meeting some incredible people.

        I’m very thankful for the experience, so thank you for that Zvi.

  9. senjiukanuba says:

    So MetaMed doesn’t exist any more. That’s a little sad, I thought the idea was brilliant and I was hoping to use it if I got a terminal illness at some point. I think I read about it in Scott Alexander’s blog.
    I’m not even thirty yet so I hope that terminal illnesses are a long way off and by the time I do need medical help with a serious problem I hope that AI can solve that problem. (But I guess most illnesses don’t really care about how young you are..)

  10. Pingback: Short Termism | Don't Worry About the Vase

  11. Pingback: Exploring Premium Mediocrity | Don't Worry About the Vase

  12. Pingback: Expanding Premium Mediocrity | Don't Worry About the Vase

  13. Pingback: Best of Don’t Worry About the Vase | Don't Worry About the Vase

  14. Pingback: More Dakka | Don't Worry About the Vase

  15. Pingback: I Vouch For MIRI | Don't Worry About the Vase

  16. Donk Contest says:

    Great site you have got here.. It’s hard to find good quality writing like yours nowadays. I seriously appreciate people like you! Take care!!

  17. Pingback: Book Review: The Elephant in the Brain | Don't Worry About the Vase

  18. Pingback: Unconscious Competence and Counter-Incentives – mindlevelup

  19. Pingback: Nice Things | Don't Worry About the Vase

  20. Pingback: Chris Pikula Belongs in the Magic Hall of Fame | Don't Worry About the Vase

  21. Pingback: Book Trilogy Review: Remembrance of Earth’s Past (The Three Body Problem) | Don't Worry About the Vase

  22. Pingback: Privacy | Don't Worry About the Vase

  23. Pingback: Why You’re Not Taking Enough Risks On “pulling the goalie” and daring to look stupid – Productivity Hub

  24. Pingback: Why You’re Not Taking Enough Risks - Maarten van Doorn

  25. Pingback: Intersex Brains And Conceptual Warfare – Sinceriously

  26. Pingback: Case study: CFAR – Everything to Save It

  27. Pingback: Slackmobiles – Everything to Save It

  28. Pingback: Motive Ambiguity | Don't Worry About the Vase

  29. Pingback: Zvi’s Thoughts on the Survival and Flourishing Fund (SFF) | Don't Worry About the Vase

  30. Pingback: Criticism of EA Criticism Contest | Don't Worry About the Vase

  31. Pingback: On the Crisis at Silicon Valley Bank | Don't Worry About the Vase

  32. Pingback: The Best of Don’t Worry About the Vase | Don't Worry About the Vase

Leave a comment