Yes, he's unfortunately worth reading, for the drama and stimulation and calling attention to things that are known but not always fully appreciated. But I wish he wasn't worth reading.
His hero Mandelbrot on the other hand? A real scholar with radical ideas, not a provocateur.
The important ideas in his book are well known by thinkers, if not all practitioners, in the fields he criticizes. But, oh, the insults! And so much of what he says is "Such and such models have flaws! Throw them away and do nothing at all until you have perfect models!" That's not terribly useful if you are, say, running an insurance firm. Or doing science.
Anyway, here's the issue of American Statistician duly taking him to task on the technicalities, though unfortunately without the bombast and mud-slinging.
Also could somebody explain to me why hacker types like to name-check Popper but never Kuhn? Is it because the Star Trek TNG episode with the Binars actually got it right?
Kuhn and Popper both make interesting observations about the development of science. However, Popper's observations are more directly applicable to the task of actually doing science. He gives a useful framework for developing and testing theories, where Kuhn's work has more to say about how theories become widely accepted. So Popper appeals to the pragmatism of most hackers.
Kuhn is also, sadly, very popular with crackpots. Almost any fringe scientist will eagerly explain to you that his ideas represent "a new paradigm", and that those who doubt him are simply trapped in old ways of thinking. So a desire to avoid guilt by association probably also plays into it.
That's my take on it anyway. (I know it's kind of a tangent, but it seemed like an interesting thing to think through).
Highly, highly recommend this book to anyone who hasn't taken the time yet. Not all that revolutionary for anyone firmly grounded in the real ins and outs of probability, but surprisingly revolutionary for those who know just enough probability to be dangerous, so to speak.
Given the audience on HN I recommend the very readable "Misbehavior of Markets" by Mandelbrot. Everything worth reading in Taleb's book is a dumbed down rehash of Mandelbrot's ideas.
"Not all that revolutionary for anyone firmly grounded in the real ins and outs of probability"
The fact that those familiar with the subject matter do not think this is revolutionary is exactly the problem Taleb is pointing to. He is calling it "the great intellectual fraud" for a reason. Domain experts obviously do not believe "intellectual fraud" and "bell curve" should be in the same sentence
"Half of my 1964 Ph.D. thesis is tests of market efficiency, and the other half is a detailed examination of the distribution of stock returns. Mandelbrot is right. The distribution is fat-tailed relative to the normal distribution. In other words, extreme returns occur much more often than would be expected if returns were normal. There was lots of interest in this issue for about ten years. Then academics lost interest. The reason is that most of what we do in terms of portfolio theory and models of risk and expected return works for Mandelbrot's stable distribution class, as well as for the normal distribution (which is in fact a member of the stable class)."
The finance guys may have been aware of it, but their actions were clearly not in line with this knowledge as evidence by the year 2008.
From the article you linked: "None of this implies, however, that the existence of outliers undermines modern portfolio theory or asset pricing theory."
In fact, that's exactly what it does. This is what happens when you build houses on top of sand.
Big crashes will always occur, but I would not blame the recent crash on the gaussian models. I'd rather say that (almost) everyone underappreciated the risks connected to the real estate prices.
Taleb pushes for a strategy that consists of buying a lot of very safe assets and blending them with bets on "extreme events" (like buying far out-of-the-money put options). Is that a viable long-term strategy? I have my doubts, since there are no evidence suggesting that 'uncertain' strategies have greater returns that more quantified ones.
Since Taleb started thinking through this stuff he's been able to cash out on two big crashes- just in the last 10 years. The second (current) one came after the black swan was published. It's almost erie reading it now. In any case, he's not advocating that everyone use that as a trading strategy. What he's advocating is that people be aware of the nature of the underlying system and stop fooling ourselves into thinking that it's "gaussian + weird things that are obvious in retrospect."
Big crashes will always occur, but I would not blame the recent crash on the gaussian models. I'd rather say that (almost) everyone underappreciated the risks connected to the real estate prices.
Part of the reason they underestimated those risks is that they paid attention only to the middle of the distribution, where things are approximately normal. I wouldn't say the explicit Gaussian-ness of the models was the reason for the trouble, but it's hard to imagine a Gaussian model providing any sort of reasonable risk estimate for the type of thing that we saw happen. It was so far outside the "business as usual" range that no risk estimate based on what was happening on most days would have been legitimate.
Taleb pushes for a strategy that consists of buying a lot of very safe assets and blending them with bets on "extreme events" (like buying far out-of-the-money put options). Is that a viable long-term strategy? I have my doubts, since there are no evidence suggesting that 'uncertain' strategies have greater returns that more quantified ones.
I don't know about this; it's all a question of price. If far out of the money puts are really underpriced compared to how often they "hit", then he could be right. My immediate impression is that the crappy prices you tend to get due to low liquidity in the extreme tails might make a profitable strategy tough to come by.
One could certainly look at the historical data over the past several decades and see whether such a strategy might have been profitable (which wouldn't necessarily tell you whether it will be profitable in the future, but might shed at least some light on the matter), but I don't have options data going back very far, so I'm not the man for the job...
Why is Taleb getting all this mainstream attention?
He's telling people that "common knowledge" in a particularly despised sector of our economy is not only wrong, but downright idiotic.
And he's presenting it in a way such that Joe the Plumber can feel like he groks it, even if he doesn't stand a snowball's chance in hell of really understanding what's been happening here.
Not that Taleb's altogether wrong - Eugene Fama may be very aware of the limitations and caveats implicit in risk measurements, but it wasn't Fama that got caught pants down screwing around for billions with an asset class that he didn't understand, was it?
What academics understand about the market often has very little to do with what real traders and banks will do in it. Taleb has valid criticisms against the real players, who were freaking idiots in a lot of ways, but he's presenting them as if they're criticisms against the establishment as a whole, which is a bit unfair, but makes for a good publicity play.
Smart move, if you ask me. Nobody would know or care who the hell he is if he hadn't made such a fuss over this stuff.
My recollection of a mathematical finance course I took was that early on we spent about 30 minutes going through the caveats you mention and that were covered in the article, and then they were promptly forgotten or ignored for the entire rest of the semester. I always found that very odd, particularly considering that the course was the start of what was considered (I think) a pretty good MA in Mathematical Finance, with a lot of alumni ending up at well known places on Wall Street: http://www.math.columbia.edu/department/mafn/page5.html
Why is Taleb getting all this mainstream attention? - my (partial) answer is that he is ambiguous enough so that everyone can write his own interpretation and the conversation is going on. This is very much alike the web 2.0 thing. And it is what Henry Jenkins calls 'spreadable media'.
"Take a random sample of any two people from the U.S. population who jointly earn $1 million per annum."
This is where the author loses me. Where is the randomness of the sample, when there are two items which are interdependent?
Later, he criticizes standard deviation as applied to stocks and bonds (decidedly non-random data), finding fault with the bell curve, rather than the misapplication.
Does this chapter make any more sense in the context of the entire book?
"Where is the randomness of the sample, when there are two items which are interdependent?"
Given all pairs of people whose join income is $1M, select a pair at random. "All pairs" is an unusual population to select from, but mathematically it's a perfectly valid way to define a random variable.
I recommend to read the book. Taleb's point is that applying gaussian instruments to mandelbrotian data is not only wrong, it has a peculiar characteristic of being mostly right all the way until it goes horribly, horribly wrong. The time lag is crucial at it allows people to accumulate risks without realizing what they do.
Google Books cut off before he got to explaining what the fraud was. Does anyone know?
He seemed to be complaining about assuming distributions were normal without checking, a simple mistakes that is warned against in any introductory statistics class.
Yes, he's unfortunately worth reading, for the drama and stimulation and calling attention to things that are known but not always fully appreciated. But I wish he wasn't worth reading.
His hero Mandelbrot on the other hand? A real scholar with radical ideas, not a provocateur.
The important ideas in his book are well known by thinkers, if not all practitioners, in the fields he criticizes. But, oh, the insults! And so much of what he says is "Such and such models have flaws! Throw them away and do nothing at all until you have perfect models!" That's not terribly useful if you are, say, running an insurance firm. Or doing science.
Anyway, here's the issue of American Statistician duly taking him to task on the technicalities, though unfortunately without the bombast and mud-slinging.
http://pubs.amstat.org/toc/tas/61/3
Also could somebody explain to me why hacker types like to name-check Popper but never Kuhn? Is it because the Star Trek TNG episode with the Binars actually got it right?