Abu Muqawama: Post

Abu Muqawama retains its autonomy and the views and beliefs expressed within the blog do not reflect those of CNAS. Abu Muqawama retains the right to delete comments that include words that incite violence; are predatory, hateful, or intended to intimidate or harass; or degrade people on the basis of gender, race, class, ethnicity, national origin, religion, sexual orientation, or disability. In summary, don't be a jerk.

A Quantitative Analysis Manifesto?

I have written a little about the utility of quantitative analysis in the field of security studies here and here. Last week, though, I finished Wall Street Journal reporter Scott Patterson's book on how quantitative hedge funds -- as opposed to "fundamental" investors like Warren Buffett -- contributed to the Wall Street collapse of 2008. Patterson ends his book with the efforts of some quants to get their analysis to abide by a code of conduct. The resulting manifesto -- written by Paul Wilmott and Emanuel Derman -- can be read here. There are some useful passages, highlighted below, which address the uncomfortable reality that elegant mathmatical formulae don't always describe messy human endeavors like the behavior of the markets -- or war, for that matter.

Physics, because of its astonishing success at predicting the future behavior of material objects from their present state, has inspired most financial modeling. Physicists study the world by repeating the same experiments over and over again to discover forces and their almost magical mathematical laws. Galileo dropped balls off the leaning tower, giant teams in Geneva collide protons on protons, over and over again. If a law is proposed and its predictions contradict experiments, it's back to the drawing board. The method works. The laws of atomic physics are accurate to more than ten decimal places.

 

It's a different story with finance and economics, which are concerned with the mental world of monetary value. Financial theory has tried hard to emulate the style and elegance of physics in order to discover its own laws. But markets are made of people, who are influenced by events, by their ephemeral feelings about events and by their expectations of other people's feelings. The truth is that there are no fundamental laws in finance. And even if there were, there is no way to run repeatable experiments to verify them. ...

 

The Modelers' Hippocratic Oath

 

~ I will remember that I didn't make the world, and it doesn't satisfy my equations.

 

~ Though I will use models boldly to estimate value, I will not be overly impressed by mathematics.

 

~ I will never sacrifice reality for elegance without explaining why I have done so.

 

~ Nor will I give the people who use my model false comfort about its accuracy. Instead, I will make explicit its assumptions and oversights.

 

~ I understand that my work may have enormous effects on society and the economy, many of them beyond my comprehension.

I found the humility in this manifesto to be really refreshing. What might a similar manifesto look like for those using quantitative analysis to study war? And should the U.S. graduate programs in political science (and subsets of the field, like international relations and security studies) pushing their students toward quantitative analysis be more up-front about the explanatory limits of such analysis? Anyway, borrowing liberally (read: plagiarizing) from Wilmott and Derman, here is what I think a Hippocratic Oath for Quantitative Analysis in Security Studies should look like:

  • War is a human endeavor. I recognize that it is a phenomenon that does not conform to neat mathematical equations.
  • I will use quantitative analysis in conjunction with theory and qualitative analysis to describe what I see as phenomena in war and peace. I will be honest about the limits of both my theory and my analysis.
  • In war and peace, the variables are infinite, and not everything can be measured or assigned a numerical value.
  • I will not use numbers to signify what are fundamentally qualitative assessments without acknowledging to my reader that I have done so in order to satisfy a departmental requirement, gain tenure, or get published in the APSR. Or because I have been in graduate school for so long that I have forgotten how to effectively write in prose.
  • I recognize there are no mathematical equations in Vom Kriege and that it is nonetheless unlikely that my legacy will transcend that of Clausewitz.
  • I recognize that very few squad leaders in the 10th Mountain Division have ever taken a course in statistics yet probably know more about the conduct and realities of war than I do. 
Books, social science

149 comments

Wait a minute. Are you

Wait a minute. Are you suggesting that maybe we need to rethink the magic ratio of counterinsurgents to population? Crazy talk.

That's good stuff. If

That's good stuff.

If Robert McNamara couldn't make quantitative analysis work in war, no one can. He was a certified genius.

I believe you have probably read "The Black Swan" but if you haven't do if you want some really devastating critique. He's also quite amusing in his prose.

Thanks for the plug for Squad Leaders...

Economics underwent a

Economics underwent a similar debate early in the 20th century when Austrian economists argued that human behavior makes modelling financial markets undesirable. They no doubt have a very strong point, but great strides and insights have since been made in Economics (I'm not talking about finance) that would not have been possible without mathematical tools. I get being very wary of quants, but please make sure you don't throw the baby out with the bath water.

Roger Cohen thinks we need

Roger Cohen thinks we need an EJK doctrine--originally found under the hilarious title "America needs a Drone Doctrine" over at Real Clear Politics. I was so hoping for ROE for Robots or something really geeky...

http://www.nytimes.com/2010/02/26/opinion/26iht-edcohen.html?ref=opinion

He thinks we need doctrines, laws, and accountablity for the drone hits. As you can see I love the last part most of all...I guess he thinks we've won so time to ratf*ck out the dirty workers.

For reasons much belabored already, I think we need to take care of business on the down low and do none of the above for said dirty business. The Height of Folly.

AM: I recognize most if not

AM:

I recognize most if not all of your manifesto is tongue in cheek. Three thoughts, though:

1) The trend in the field, so far as I can ascertain, is to utilize mixed methods: ie, perform quantitative analysis of one form or another (a "game," or data analysis"), *combined with* qualitative case studies (the Lyall-Wilson article does this, for example). The people who do this are the people who are getting, or hold, the top jobs (or, at least, some of the jobs).

2) While I recognize that this is, indeed, tongue-in-cheek, try getting someone to admit they're publishing what they're publishing for the sake of tenure or other requirements! This article might also be interesting to you, in the wake of bats*t crazy Amy Bishop: http://chronicle.com/article/Reactions-Is-Tenure-a-Matter/64321/.

3) Your comment about the squad leader made me laugh, for three reasons. First, I have never served, but I met and worked with an E-7 and former E-4 last year, the former a high dropout, I believe, the other who had yet to complete his college degree. Both were far more savvy and astute and intelligent than I could ever hope to be (hopefully that does not sound patronizing - I sincerely hold both in the highest regard). Second, I'm reminded of Samuel Johnson's comment, which I cannot recall in anything resembling its true glory, that he would take the wisdom of any common plowman over that of a _ anyday. Third, and similarly, is the quote by William F. Buckley that he would rather be governed by the first 300 names in the Boston phone book than by the Harvard faculty.

ADTS

that's a bit of an

that's a bit of an unfortunate, and in many ways uncomprehending, take on quantitative and formal methods.

Rock on ADTS!! أبو

Rock on ADTS!!

أبو مقاومة - but what's the record of game theory in war, in particular the Cold War and up to now?

If people know what game you are expecting, they will change theirs.

As far as the market: the regulatory authority that will work = market discipline. In other words you are bankrupt, @ssholes. Hit the breadline as we auction off your furniture. You wanted the free market, here it is...oh and here's the Feds just in case you did engage in corruption and fraud.

You are right about their bad behavior being incentivized. A lot of that going around.

AM....why all the fuss over

AM....why all the fuss over quants?

Should add one more line....you should never say never.

What about parallel realities? Just never know.

Actually, most of my ROTC

Actually, most of my ROTC class took statistics (it was that or Calculus). Whether we paid any attention is another issue entirely...

But these are just

But these are just platitudes. Why do you feel the need to produce a manifesto? Are you actually doing a lot of quant studies?

Quantitative and qualitative methods should be used wherever necessary.

Plenty of quant funds did fine in the crash. For instance: Renaissance. In fact, the mere existance of Jim Simons/Renaissance seems to render your analogy somewhat incoherent.

And presumably you have already thown your copy of Military Power in the bin?

BTW elf, Taleb is a self-obssessed moron.

That manifesto is just as

That manifesto is just as much a critique of qualitative work as it is of quantitative work. Over-claiming results, not understanding the limitations of the method, etc.

This is an exceptional post,

This is an exceptional post, Abu M.

As a INR student about to enter grad school for US-Middle East security studies, this sort of thing should be posted on everyone's wall in any relevant department.

In putting the final touches on my personal statement (about what I hope to accomplish and how) this post will be a guiding light for me. In trying to make a name for oneself, I'm almost positive that this level of humility about limitations and honesty is lacking when we open our word processors to type out what we're sure will be a critical masterpieces of our time.

I certainly needed this and I thank you for writing it.

Thanks for this manifesto,

Thanks for this manifesto, I've shared it with my colleagues & students in IR here in the Political Science Department at the University of Rochester. Lord knows we need some of this sensible thinking around here.

I strongly favor

I strongly favor quantitative analysis, intelligently applied. Years ago I read Trevor Dupuy's books outlining his Quantified Judgment Method, and they informed my wide reading of narrative military history. Very useful in highlighting and speculating on what variables might impact the outcome of engagements. For what it's worth, Dupuy applied QJM in a short book published before the first Gulf War, and his results -- while wildly high in estimating Coalition casualties -- subsequently proved to be closer to reality than any other published forecast by the multitude of pundits who wrote in the weeks leading up to Operation Desert Storm.

Like Jim, I'm at the

Like Jim, I'm at the University of Rochester, but I found your post jejune and sadly depressing . Yeah, let's once again fight unproductive wars over methods and let's not ask new questions or seek to provide new answers, no let's just have more of the same. Since what we had in the past could not possibly be improved upon.

I would venture to guess that our IR students here actually do more original historical research than do IR students at more traditional qualitatively oriented programs. But our students do this research to get a better understanding of the puzzles and potential answers rather than as "case studies" which supposedly "test" theories.

Speaking for myself, I do seek to obtain a basic understanding and competence in a variety of methods because I have always found that the more ways you can think about a question, the more likely you are to achieve a deeper understanding and richer answer. One "method" will push the answers of another "method" and force you to use yet another "method" to really understand what's going on.

As one commented " War is a

As one commented " War is a human endeavor. I recognize that it is a phenomenon that does not conform to neat mathematical equations. … there are no mathematical equations in Vom Kriege and that it is nonetheless unlikely that my legacy will transcend that of Clausewitz.." That was true. Find more world political news

An interesting post to go

An interesting post to go through. Nicely articulated . Find more world sport news today

p>An interesting post to go

p>An interesting post to go through. Nicely articulated . Find more world sport news today

As commented above "It's a

As commented above "It's a different story with finance and economics, which are concerned with the mental world of monetary value. Financial theory has tried hard to emulate the style and elegance of physics in order to discover its own laws. But markets are made of people, who are influenced by events, by their ephemeral feelings about events and by their expectations of other people's feelings. The truth is that there are no fundamental laws in finance. And even if there were, there is no way to run repeatable experiments to verify them. " True. Find more current events news

I am glad to see that you

I am glad to see that you have finished the Wall Street Journal reporter Scott Patterson's book on how quantitative hedge funds. I admit that I don't know much about the issues discussed in this well written article, so I thank you for writing the post and helping us learn. It makes me love the internet even more, after I searched for news, electric griddle reviews, movies and other things that I probably forgot. I might as well check other sections on this site, since I like it so far.

"Thanks for taking the time

"Thanks for taking the time to discuss this, I feel strongly about it and love learning more on this topic. If possible, as you gain expertise, would you mind updating your blog with extra information? It is extremely helpful for me."
Golf in Mallorca

Congrats for releasing such

Congrats for releasing such a nice post.This is nice post. I was awaiting for such an artice and I have gained some very useful information from this site.I admire the valuable information you offer in your articles. I will bookmark your blog and have my friends check up here often. I am quite sure they will learn lots of new stuff here than anybody else .Thanks for sharing this information.
Kidney stones treatment

Interesting post! The only

Interesting post!
The only thing I’ll add is that Clausewitz was, actually, directly attacking an empirical tradition among military writers of his era. These writers, like Jomini, used which used mathematical equations (in the form of strategic lines) to demonstrate flanking manouevers that would allow generals htp company to outwit their enemies before they really had a chance to fight. I don’t speak math, so I won’t comment. But I do feel that there is an important lists place for quants. Exum sounds like a bit of a dork here.

I am not sure what you are

I am not sure what you are trying to say here. There is no way the Warren buffet had some responsibility of the collapse in 2008. You really need to look at this again. accutane lawyer

This it Good Stuff. I feel

This it Good Stuff. I feel strongly about it and love learning more on this topic. If possible, as you gain expertise, would you mind updating your blog with extra information?
Mutterwitze

That manifesto is just as

That manifesto is just as much a critique of qualitative work as it is of quantitative work. Over-claiming results, not understanding the limitations of the method, etc. Mutterwitze

I love that hypocratic

I love that hypocratic oath... both realistic, useful... and makes a great point!

Sal
Exterior Window Shutters

But markets are made of

But markets are made of people, who are influenced by events, by their ephemeral feelings about events and by their expectations of other people's feelings. vera wang perfume

An interesting post to go

An interesting post to go through. You really need to look at this again
Ferienhaus in Tschechien

Nice Artikle this it realy

Nice Artikle this it realy good Blog
X-Box 360 Forum

Thank you for the Nice

Thank you for the Nice Artikle, The Site it realy good.
X-Box 360 Forum

we auction off your

we auction off your furniture. You wanted the free market, here it is...oh and here's the Feds just in case you did engage in corruption and fraud. Insurance

Thank you for the really

Thank you for the really good Info, this it verry help ful for me
Kartenlegen

However, if you'll will most

However, if you'll will most certainly be hunting for the purpose of some sort of people must think about purchasing some sort of via a good internet retail store. The public will learn about even while everyone might be and additionally have fun with participating in the idea. Those top strategy for you to professional photographer could be to help discover belly a wonderful. Those right approach to assist you could be so that you can acquire mid-section some effective. If it turns out anyone happen to be shopping pertaining to another one should really give some thought to acquiring a good from a strong the net retail store. Everyone are able to uncover even when we are usually and even indulge in accomplishing the item.

Looking really awesome way

Looking really awesome way of arguing and presenting your point of view.All the men/women have't such a great way of writing.Its incredible.
sales letter software

Thank you for another great

Thank you for another great article. Where else could anyone get
that kind of information in such a perfect way of writing?
I have a presentation next week, and I am on the look for such information.
Professional web hosting

Thank you for another great

Thank you for another great article. Where else could anyone get
that kind of information in such a perfect way of writing?
I have a presentation next week, and I am on the look for such information.
Professional web hosting

Thank you for the Nice

Thank you for the Nice Artikle, The Site it realy good my best regards Mike and his Tafelfolie

Thank you for the Nice

Thank you for the Nice Artikle, The Site it realy good my best regards Mike and his Tafelfolie

An invaluable resource and

An invaluable resource and great addition to my favorites. The new features are well received on this end and will surely help the community share and progress more rapidly.
Filigree

I believe you have to have a

I believe you have to have a positive attitude to quantitative analysis in the field of security
People here talking about Negative attitude is not good actually. You have learn a lot quantitative analysis in conjunction with theory and qualitative analysis to explain what You experience while learning as scenario in war and peace. I trust on your statement that you will have been honest about the limits of both your theory and analysis.
John from replica bags

Looking really awesome way

Looking really awesome way of arguing and presenting your point of view.All the men/women have't such a great way of writing.Its incredible.
Kartenlegen Gratis

I think we need to take care

I think we need to take care of business on the down low and do none of the above for said dirty business. would you mind updating your blog with extra information? It is extremely helpful for me..
casino online

An invaluable resource and

An invaluable resource and great addition to my favorites. The new features are well received on this end and will surely help the community share and progress more rapidly.

digital slr

Economics underwent a

Economics underwent a similar debate early in the 20th century when Austrian economists argued that human behavior makes modelling financial markets undesirable. They no doubt have a very strong point, but great strides and insights have since been made in Economics (I'm not talking about finance) that would not have been possible without mathematical tools. I get being very wary of quants, but please make sure you don't throw the baby out with the bath water.
decorating ideas

Thanks a lot for the

Thanks a lot for the informative and interesting publication first of all. Actually I was looking for this information for a long time and finally have noticed this your entry. Reading this great post I have found so many new and useful information about your manifesto, which I have not known before. I am so glad that I have bookmarked this website because I see that it is full of various and attractive information about everything. Thanks one more time for this publication, it was really interesting to read it. Regards, David Gregor ( aka pariuri sportive ) from Missouri

This quantitative analysis

This quantitative analysis is really great to see !
Because most of the people trust on the result shown against him with statistic.
safety supplies has some great features statistics support as well !!!

Add your comment

CNAS retains the right to delete comments that include words that incite violence; are predatory, hateful, or intended to intimidate or harass; or degrade people on the basis of gender, race, class, ethnicity, national origin, religion, sexual orientation, or disability. In summary, don't be a jerk.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <p> <br> <hr><blockquote>
  • Lines and paragraphs break automatically.
  • Web page addresses and e-mail addresses turn into links automatically.

More information about formatting options

CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.

Search