Abu Muqawama retains its autonomy and the views and beliefs expressed within the blog do not reflect those of CNAS. Abu Muqawama retains the right to delete comments that include words that incite violence; are predatory, hateful, or intended to intimidate or harass; or degrade people on the basis of gender, race, class, ethnicity, national origin, religion, sexual orientation, or disability. In summary, don't be a jerk.
I have written a little about the utility of quantitative analysis in the field of security studies here and here. Last week, though, I finished Wall Street Journal reporter Scott Patterson's book on how quantitative hedge funds -- as opposed to "fundamental" investors like Warren Buffett -- contributed to the Wall Street collapse of 2008. Patterson ends his book with the efforts of some quants to get their analysis to abide by a code of conduct. The resulting manifesto -- written by Paul Wilmott and Emanuel Derman -- can be read here. There are some useful passages, highlighted below, which address the uncomfortable reality that elegant mathmatical formulae don't always describe messy human endeavors like the behavior of the markets -- or war, for that matter.
Physics, because of its astonishing success at predicting the future behavior of material objects from their present state, has inspired most financial modeling. Physicists study the world by repeating the same experiments over and over again to discover forces and their almost magical mathematical laws. Galileo dropped balls off the leaning tower, giant teams in Geneva collide protons on protons, over and over again. If a law is proposed and its predictions contradict experiments, it's back to the drawing board. The method works. The laws of atomic physics are accurate to more than ten decimal places.
It's a different story with finance and economics, which are concerned with the mental world of monetary value. Financial theory has tried hard to emulate the style and elegance of physics in order to discover its own laws. But markets are made of people, who are influenced by events, by their ephemeral feelings about events and by their expectations of other people's feelings. The truth is that there are no fundamental laws in finance. And even if there were, there is no way to run repeatable experiments to verify them. ...
The Modelers' Hippocratic Oath
~ I will remember that I didn't make the world, and it doesn't satisfy my equations.
~ Though I will use models boldly to estimate value, I will not be overly impressed by mathematics.
~ I will never sacrifice reality for elegance without explaining why I have done so.
~ Nor will I give the people who use my model false comfort about its accuracy. Instead, I will make explicit its assumptions and oversights.
~ I understand that my work may have enormous effects on society and the economy, many of them beyond my comprehension.
I found the humility in this manifesto to be really refreshing. What might a similar manifesto look like for those using quantitative analysis to study war? And should the U.S. graduate programs in political science (and subsets of the field, like international relations and security studies) pushing their students toward quantitative analysis be more up-front about the explanatory limits of such analysis? Anyway, borrowing liberally (read: plagiarizing) from Wilmott and Derman, here is what I think a Hippocratic Oath for Quantitative Analysis in Security Studies should look like: