Saturday Edition

The model for future success from Tom Peters Company


Get the Blog Feed
What is RSS?

dispatches from the new world of work

Dice 1, Experts 0

You must read ...

New Yorker. December 5 issue. Page 98. Louis Menand, "Everybody's an Expert: Putting Practitioners to the Test." The article is a lengthy review of the book Expert Political Judgement: How Good Is It? by psychologist and Berkeley Professor Philip Tetlock. The apolitical treatise is based on 20 years' research on the predictive skill of experts.

In short, and doing neither the book nor the review justice, the "experts" are less likely to be correct than predictions based on coin tossing! Menand: "Tetlock has found that specialists are no more reliable than non-specialists in predicting what is going to happen in the region they study. Knowing a little may make someone a more reliable forecaster, but Tetlock found that knowing a lot can actually make a person less reliable." Tetlock: "We reach the point of diminishing marginal predictive returns for knowledge disconcertingly quickly." The devil is in the details—and the subsequent details make this piece a must read.

(FYI, I have long felt that the #1 thing Bob Waterman and I had going for us when we studied "excellent companies" was a certain naïveté or freshness. And I admit to wondering over the years whether my "enhanced knowledge" has actually hurt. I suspect that I'm at my best when I'm "half naïve"—e.g., on the topic of women and markets a couple of years ago; design, a couple of years before that.)

Tom Peters posted this on 12/07/05.

Comments

There is "know how," "know what," and "know who." Only expertise in the latter will help you predict the future. If no one is studying it, then you can count on it not chaning. When I go back and review a few of the fields I'm interested in, I'm shocked that nothing has happened over the last twenty years. But, it turns out that nobody is interested, so nothing of interest happened.

Posted by David Locke at December 7, 2005 4:07 PM


I read a very good book on Decision making a few years ago. This described an interesting experiment based around the results of a medical test (Bender Gestalt test)

THey did 3 groups Psychologists with many years experience reading the results of this test. Student traininees, and the secretaries of the psychologists.

results

psychologists 65%

Students 67%

secretaries 70%

The problem was that people were not learning from their experience. Gut feel is only good if it is part of people learning from experience and (something people are not good at) evaluating and marking themselves over time on how good their decisions are - we tend to post justify bad decisions rather than say "no we got wrong there"!

Posted by PaulH at December 8, 2005 11:30 AM


Paul, your "learning from experience" point (how lousy we are) is the primary reason that the good though rudimentary artificial intelligence-expert systems programs readily outperform human experts, even at very complex tasks.

Posted by tom peters at December 8, 2005 12:15 PM


I think it is equally a matter of too much information. Blasphemous as that may sound, the information overload leads to over-analyzation that can cause an 'expert' to read so deeply into every indicator that he 'misses the forest for the trees' (I think that's how the saying goes). Meanwhile the novice is able to see the fairly obvious (or likely) solution, simply because he doesn't know he's supposed to be tearing each piece of information apart to look for its 'deeper, hidden meaning'. I remember reading somewhere, perhaps one of Malcolm Gladwell's books or articles, about a study where random people were given extremely basic indicators of how to predict the weather. They turned out right at least as often as the professional meteorologists. I think of economists and analysts who dig through piles of formulas and indicators, and I have to believe the marginal return on each piece of additional info scrutinized must be extremely low. Somewhere along the line you need to apply the 80/20 or even 90/10 principle. I'm convinced that if I analyze something long and hard enough it will tell me whatever I want it to tell me (making my 'objective' analysis worthless).

Posted by Paul at December 8, 2005 5:11 PM


There's a tangent to this point that's interesting also: people tend to overestimate their average at making correct predictions. I read a study (perhaps in Money Magazine years ago) that amateurs who play the market BELIEVE they're much more successful than they are statistically, a false confidence that can have disastrous consequences.

Posted by John O'Leary at December 8, 2005 10:10 PM


John, it goes both ways, like so many things in life. Inappropriate optimism causes stock losses, but it is the primary determinant of what makes a good-great salesperson (see Marty Seligman's work).

Posted by tom peters at December 11, 2005 8:17 AM



ARCHIVES

- May 2013

- April 2013

- March 2013

- February 2013

- January 2013

- December 2012

- November 2012

- October 2012

- September 2012

- August 2012

- July 2012

viagra and paypal uk no prescription - June 2012

- May 2012

- April 2012

- March 2012

- February 2012

- January 2012

- December 2011

- November 2011

- October 2011

- September 2011

buy viagra on line

- August 2011

- July 2011

- June 2011

- May 2011

- April 2011

- March 2011

- February 2011

- January 2011

- December 2010

- November 2010

- October 2010 brand viagra 50 mg

- September 2010

- August 2010

- July 2010

- June 2010

- May 2010

- April 2010

viagra 50mg dosage online - March 2010

- February 2010

- January 2010

- December 2009

- November 2009

- October 2009

- September 2009

- August 2009

- July 2009

- June 2009

- May 2009

- April 2009

generic viagra 25 mg

- March 2009

- February 2009

- January 2009

- December 2008

- November 2008

- October 2008

- September 2008

- August 2008

- July 2008

- June 2008

- May 2008

- April 2008

- March 2008

- February 2008

- January 2008

- December 2007

- November 2007

- October 2007

- September 2007

- August 2007

- July 2007

- June 2007

- May 2007

- April 2007

- March 2007

- February 2007

- January 2007

- December 2006

- November 2006

- October 2006

- September 2006

- August 2006

- July 2006

- June 2006

- May 2006

- April 2006

- March 2006

- February 2006

- January 2006

- December 2005

- November 2005

- October 2005

- September 2005

- August 2005

- July 2005

- June 2005

- May 2005

- April 2005

- March 2005

- February 2005

- January 2005

- December 2004

- November 2004

- October 2004

- September 2004

- August 2004

- July 2004

- June 2004

- May 2004

- April 2004

Before blogging became all the rage, Tom was posting book reviews and Observations (essentially early blog posts) to this site. You can find the archives below.

What Tom's Reading Archives

- February 2004

- August 2003

- March 2003

- September 2002

- March 2002

- September 2001

- April 2001

- March 2001

- June 2000

- September 1999

OBSERVATIONS ARCHIVES

- July 2004

- April 2004

- February 2004

- May 2003

- March 2003

- June 2002

- April 2002

- March 2002

- February 2002

- January 2002

- December 2001

- November 2001

cheap viagra on line mastercard

- October 2001

- September 2001

- August 2001

- February 2001

purchase viagra online

- January 2001 viagra uk next day delivery

- December 2000

- November 2000

- October 2000

- September 2000

- August 2000

- July 2000

- June 2000

- May 2000

- April 2000

- March 2000

- February 2000

- January 2000

- December 1999

- November 1999

- October 1999

- September 1999

right now

What we're talking about
on the front page.

viagra express delivery