Subscribe via RSS

Archives by Date
October 2008
September 2008
August 2008

See all Archives
Archives by Category
'Canes
Afghan Update
Ammo and Munitions
Armor
Around the Globe
Av Week Extra
Axe in Iraq (and Elsewhere)
Bizarro
Blimps
Blog Bidness
Body Armor Blues
Bomb Squad
Brownshoes in Action
Bubbleheads, etc.
Cammo Green
Catch the "Buzz"
Chem-Bio
Civilian Apps
Cloak and Dagger
Commandos
Comms
Contingency Ops
Cops and Robbers
Cyber-warfare
Data Diving
Defense Tech Poll
Dissent Tech
Door Kickers
Drones
DT Administrivia
Eat DT's Dust
Extra! Extra!
Eye on China
Fast Movers
FCS Watch
Fire for Effect
FOS Files
Friday Funnies
Gadgets and Gear
Going Green
Grand Ole Osprey
Ground Vehicles
Guns
Homeland Security
In the Weeds with Eric
Info War
Iraq Diary
Jarhead Jazz
JSF Watch
Just War Theories
Lasers and Ray Guns
Less-lethal
Logistics
Los Alamos and Labs
M4 Monopoly
Medic!
Mercs
Missiles
Money Money Money
Most Wanted
MRAP Edge
Net-Centric
Nukes
Old Skool
Our Shrinking Planet
Planes, Copters, Blimps
Politricks
Polmar's Perspective
Popular Mechanics
Rapid Fire
Raptor Watch
Red Team
Retro-Futuro
Robots
Roll Your Own
Sabra Tech
Ships and Subs
Snipertech
Space
Special Ops
Star Wars
Strategery
Stray Trons
Tactical Development
Terror Tech
The Deadlies
The Defense Biz
The Peoples' Site
The Sunday Paper
The Tanker Tango
The View from Av Week
Those Nutty Norks
Training and Sims
Trimble on the Case
Video Lounge
War Update
Ward'z Wonderz
You can run...

See all Archives
Newsletters

Edited by Christian Lowe | Contact

Data Diver Disses Terror-Mining

Jeff Jonas is one of the country's leading practitioners of the dark art of data analysis. Casino chiefs and government spooks alike have used his CIA-funded "Non-Obvious Relationship Awareness" software to scour databases for hidden connections.

nyt_mag_terror_diagram.jpgSo you'd think that Jonas would be all into the idea of using these data-mining systems to predict who the next terrorist attacker might be.

Think again. "Though data mining has many valuable uses, it is not well suited to the terrorist discovery problem," he writes in a new study, co-authored with the Cato Institute's Jim Harper. "This use of data mining would waste taxpayer dollars, needlessly infringe on privacy and civil liberties, and misdirect the valuable time and energy of the men and women in the national security community." Are you listening, NSA?

Jonas doesn't have a problem cobbling together information on suspects from various databases. It's using these databases to forecast a terrorist's behavior -- think market research, but for Al-Qaeda -- that Jonas hates. "The possible benefits of predictive data mining for finding planning or preparation for terrorism are minimal. The financial costs, wasted effort, and threats to privacy and civil liberties are potentially vast," he writes.

One of the fundamental underpinnings of predictive data mining in the commercial sector is the use of training patterns. Corporations that study consumer behavior have millions of patterns that they can draw upon to profile their typical or ideal consumer. Even when data mining is used to seek out instances of identity and credit card fraud, this relies on models constructed using many thousands of known examples of fraud per year.

Terrorism has no similar indicia. With a relatively small number of attempts every year and only one or two major terrorist incidents every few years—each one distinct in terms of planning and execution—there are no meaningful patterns that show what behavior indicates planning or preparation for terrorism. Unlike consumers’ shopping habits and financial fraud, terrorism does not occur with enough frequency to enable the creation of valid predictive models. Predictive data mining for the purpose of turning up terrorist planning using all available demographic and transactional data points will produce no better results than the highly sophisticated commercial data mining done today [with results in the low single-digits – ed.]. The one thing predictable about predictive data mining for terrorism is that it would be consistently wrong.

Without patterns to use, one fallback for terrorism data mining is the idea that any anomaly may provide the basis for investigation of terrorism planning. Given a “typical” American pattern of Internet use, phone calling, doctor visits, purchases, travel, reading, and so on, perhaps all outliers merit some level of investigation. This theory is offensive to traditional American freedom, because in the United States everyone can and should be an “outlier” in some sense. More concretely, though, using data mining in this way could be worse than searching at random; terrorists could defeat it by acting as normally as possible.

Treating “anomalous” behavior as suspicious may appear scientific, but, without patterns to look for, the design of a search algorithm based on anomaly is no more likely to turn up terrorists than twisting the end of a kaleidoscope is likely to draw an image of the Mona Lisa.

Civil libertarians and bloggers have talked 'til they're blue in the face about how lame this kind of terror-predicting is. But I don't think I've ever heard a giant of the field, like Jonas, come out against the practice -- at least not on-the-record. Let's hope this is one conversation that the feds are monitoring.

(Big ups: Daou)

UPDATE 11:49 AM: Shane Harris here. Die-hard proponents of pattern-based 'data mining' to catch terrorists will remain unconvinced by Jonas' and Harper's argument. While it's true that data mining in the commercial sector is based upon "training patterns," backers of systems such as Total Information Awareness will say, yes, and that's why data mining for terrorists has to start with hundreds -- maybe thousands -- of known or potential terrorist patterns to look for. A major part of TIA research was the creation of terrorist attack templates through red teaming exercises, in which experts were paid to come up with devious and clandestine plots that a terrorist might conceivably attempt. Their various machinations would, presumably, leave a set of digital footprints -- airline tickets purchased, money wired, hotels paid for, and so on -- and THAT data would be mined for clues.

What's also interesting about this paper is the combination of the authors. Jim Harper is a well-known and articulate activist, and has long since staked out central territory in the security vs. privacy debate. But Jonas has stayed out of politics. Indeed, those who've met him will know that he sticks out like a sore West coast thumb among Washington gear heads, being unafraid to use the word "dude" in formal conversation and happily acknowledging his ignorance of most Beltway insider baseball. But those who know Jonas and have heard him speak about electronic terrorist hunting know that, like his co-author Harper, he has a strong libertarian streak. Maybe Jonas wouldn't put it quite that way -- dude -- but it's there.

Comments

replica rolex watches

http://www.watchinstyle.com/chanel-j12-white-chronograph-fully-high-grade-ceramic-p-910.html?zenid=9m7rdns1qli5ntbq2uevks5ve0

http://easyforbuy.com/nike-air-zoom-lebron-c-49.html?zenid=c0enle2a7n4rgumpq0g5t9bqb6

http://lowestmall.com/nike-air-max-c-44.html?zenid=e62d2m88ej0b70vn97n4e9pkd6

http://onestoptown.com/

Posted by: instylewatch at October 9, 2008 12:02 AM



replica rolex watches

http://www.watchinstyle.com/chanel-j12-white-chronograph-fully-high-grade-ceramic-p-910.html?zenid=9m7rdns1qli5ntbq2uevks5ve0

http://easyforbuy.com/nike-air-zoom-lebron-c-49.html?zenid=c0enle2a7n4rgumpq0g5t9bqb6

http://lowestmall.com/nike-air-max-c-44.html?zenid=e62d2m88ej0b70vn97n4e9pkd6

http://onestoptown.com/

Posted by: instylewatch at October 8, 2008 11:54 PM


Haw-haw !It is a very beaufitul writing! The moderator is really a man of intention. I

really appreciate his wisdom and philosophy of life
replica watch

http://www.watchinstyle.com/rolex-datedate-white-diamondsswiss-eta-2836-p-768.html?

zenid=teg6g8jtnlurrhkmbomsugkuj7
http://easyforbuy.com/002-puma-shoes-all-black-p-4029.html
http://lowestmall.com/9826-nike-king-black-sapphire-p-5367.html?

zenid=iu1fq75j2cmr6534iltfb807i5
http://onestoptown.com/


Hack mechanism (second hand stops when crown is pulled out to set the time-standard

Rolex watches).

Posted by: replicawatches at October 8, 2008 10:12 PM


The thing with non-Christians is that they are out
smarted by Cultists daily with data...Only people
who actually know God,catch such people...

Posted by: reshtet at September 10, 2008 07:40 PM


At last, The Second Life linden world is a place dedicated to your creativity. After all, an avatar is your persona in the virtual world.

Posted by: Second Life linden at August 26, 2008 09:18 PM


In my opinion, Knight Online Gold is a fun game that mighthave been worth playing a few years ago despite the slowness.

Posted by: Knight Online Gold at August 26, 2008 09:18 PM


If you think that play game was important that have you thought about your parents? I want to say that when you played game that you do not forget your parents and friends. When you used your parents give your money to buy the Archlord gold, did you thought that money was your parents’ effort to earn. Did you think your parents’ heart?

Posted by: Archlord gold at August 13, 2008 02:26 AM


Other players can, I think I can too, many players said that BB can let us get more flyff gold, if you do not have enough flyff gold in the game, and then you can not do many things, in the reality world also like this. But I more like through my effort to get the success, that success can let me memorable forever.

Posted by: flyff gold at August 13, 2008 02:23 AM


in order to play this game I spend money to buy the flyff penya, the BB again left me at the same time, same situation when I hard to get it, my angry can not use the words describe, if I was not operated for a full and the lack of time, then I do not have any words to say, but last time also like this.

Posted by: flyff penya at August 13, 2008 02:21 AM


Now I often do not buy the new clothes and do not buy the food, I retrench money to buy the fiesta online money, although the days had a little sad, but I felt happy. I hope that who can tell me that which companies can sell the cheap fiesta online money. I already did not have enough money.

Posted by: fiesta online money at August 13, 2008 02:18 AM


So play EVE you must remember that playing one to concentrate and to buy some eve online isk, EVE was different from other online games.

Posted by: eve online isk at August 13, 2008 02:13 AM


they often like to ask something about the players looks like, family, and in the game can earn how much 2moons gold, I do not know these people are playing the game or game play them

Posted by: 2moons gold at August 13, 2008 02:06 AM


All things are the memories, before all things have been imprinted in my mind, the friends all have left the 2moons, sometimes before when the sleeping I often think of the previous screen, together with friends upgrade, earn the 2moons dil and together play with friends, playing now I also feeling some tired, I do not know what things I persist in

Posted by: 2moons dil at August 13, 2008 02:01 AM


Higher Vocational does not necessarily need to“transfer”of a single approach ,Players can also change under different conditions to the fighting style, and generally quite different RPG.of course, Props to the charges, so you must be prepared NosTale money.

Posted by: NosTale money at August 5, 2008 09:47 PM


When their Daguai no ability to make money when you can buy Maple mesos. Later games to a new BOSS, Puchu a lot of things, because why did not go to school, the students later I have been playing this game until the most senior.

Posted by: Maple mesos at August 5, 2008 09:46 PM


rolex replica watches - $98 swiss , we don't sale replica watches.The Art of E-commerce

Posted by: replica watches at August 3, 2008 09:43 PM


Now I have been working. Rappelz unwittingly with the growth of the past few years, Rappelz has been updating, I also busy, but I have not forgotten the game. Work and is inseparable from the game, I like Rappelz, even if the equipment is not good, even if I have no much rappelz gold. I also very happy, because I have many friends in the game, so what can be said, does not, as long as you said to.

Posted by: rappelz gold at August 2, 2008 03:28 AM


nice to meet you

Posted by: wowpowerleveling at April 14, 2008 11:29 PM


i want to be a joint military for automotive services

Posted by: Aine enos at October 17, 2007 01:16 PM


yes, i want to be a joint military for machanical automotive service.

Posted by: Aine enos at October 17, 2007 01:10 PM


Obviously Jef Jonas has not heard of the new kid in town. His name is ARGUS; it's not an acronym, but the mythological, all-seeing Greek god. ARGUS is an open-source data mining tool which focuses on social disruption as an indicator or nefarious activity; but its content engine and Bayesian algorithms can be evolved to focus on any subject, human or otherwise. This tool is in its initial stages, but is being grown into a global capability which currently operates in 23 languages.
Yes, most data mining tools are very limited, especially for an predictive analysis. But ARGUS is winning over everyone who's seen its capability because it drills down below the official [read censored] websites and blogs and captures individual postings which are aching to be read by the rest of the world. ARGUS will be peering into an open source near you...
peace out. Bob

Posted by: Bob Stevens at December 18, 2006 09:58 PM


I am surprised that a man of his credibility made the assumption that terrorist activity is limited to a handful of incidents each year. While I understand that his focus may be limited to domestic attacks here in the United States, there is and always has been terrorist actiity throughout the world, and there is a vast collection of data to draw on. While I agree with his conclusion that forecasting terrorist activity is problematic, the assertion that there is not enough data to draw on to begin such a project is unfounded. I would argue that completing the project is the real challenge, because of its reliance on subjective conclusions to compensate for unknowns, its continual need for new input and maintenance. In theory, it works best on a targeted audience of limited scope. A system that monitors everything and everybody is too broad.

Posted by: Serena Dal at December 17, 2006 01:02 AM


yes, and what about just simply "mailing" cash

Posted by: mike at December 16, 2006 04:42 PM


As a long time employee of the National Security Agency, I do not agree entirely with conclusions expressed in this article. Data mining is and has been extremely useful in building detailed and complex databases on a number of potential threats to the U.S. For example, detailed information on the enemy's Order of Battle are constructed from intercepted data including sigint/comint and elint. Electronic profiles of weapons systems are developed. The list is endless. And much of the data mining is highly target specific....so it more akin to a laser than a shotgun.

Posted by: James B at December 16, 2006 02:56 PM


I think this comments thread gives us some perpective. Clearly there are a lot of Americans who will support data mining whether or not experts say it's effective or legal.

They want the capability used. It's no more complex than that. Unintended consequences, like the data being shipped to other Federal agencies to assist in criminal prosecutions, or being used for political opposition research, do not matter.

And will not until a Democrat does it. You heard it here first.

Posted by: zak822 at December 14, 2006 01:08 PM


I disagree with the first posters comment, bravo sierra. To add, logging into foriegn AQ or Jihadist web pages, frequent phone calls to known terrorists, foriegn citizenship with a country that is producing jihadist movements, buying chemicals with no known purpose, calls to said chemical producers, interest in explosives knowledge, repeditive travel and connecting flights to Terrorist harboring or training camp containing countries, recently purchased military type weapons, interest in flight schools, rented space for no known purpose. Recent increase in cash flow from no specified source. Membership in organizations and Mosques that are known to preach hate. All this can be determined from phone calls, bank accounts, and credit card receipts. The list goes on. I wish people would reserve their obviously biased comments until they did some research or used common sense. This goes for the articles so called expert. Please qualify your experts before giving them that moniker. What counter-terrorism experience does he have? You don't really say he has any.

Posted by: John at December 14, 2006 10:19 AM


http://www.schneier.com/blog/archives/2006/03/data_mining_for.html

Posted by: Jeremiah at December 14, 2006 12:16 AM


Bullshit.
"Their various machinations would, presumably, leave a set of digital footprints -- airline tickets purchased, money wired, hotels paid for, and so on"
Bullshit.
If we look at the information footprint that the 9/11 hijackers left, what have we got?
their entry records
some flights that they took.
phone records on their non-terror phones.

basically these guys lived below the radar.
little of what they did would attract attention..
as for money transfers- well there are informal money transfer methods that immigrants use.

Posted by: Aaron at December 13, 2006 01:56 AM


I have a libertarian streak, but even I will acknowledge there are valid arguments on both sides of the data mining issue. I'm less concerned with the efficacy debate than with how data mining is implemented.

Mining tools are only as effective as the person who uses them. Are our analysts in the IC adriot enough to use them effectively? Maybe at the NSA and CIA, but there hasn't been much evidence to suggest that DHS, the FBI or the DOD have the brainpower to use such sophisticated tools.

More importantly, we should be vigilant about how data mining fits into the larger picture of counter-terrorism and national security tools. The national security bureaucracy is very cost conscious and has gotten all doey-eyed about "silver bullet" tech before - just think about the ridiculous heights of nuclear force planning in the 1950s. Data mining should be treated as only one of many different tools used to pursue terrorism.

Posted by: Robot Economist at December 12, 2006 11:22 PM


C-Low, thanks, your check is in the mail!

Careful, though, that subliterate moron schtick was almost over the top. No one's going to believe you're for real...

Posted by: Vast Left-Wing Conspiracy at December 12, 2006 01:57 PM


The common counter-argument to anybody who raises privacy concerns and such for data mining operations is that it's better to have them than not to have them because it MIGHT prevent a terrorist attack.

One of the biggest data mining operations people have common access to is Amazon.com, where they record every single click you make on their website to make recommendations to you.

How often has Amazon recommended something you hated?

Is that the kind of thing that you want attempting to identify terrorists or predict the next terrorist attack?

Even before you hit the issues of privacy and civil liberties, I need more convincing that data mining even works in the PRIVATE sphere before I'm going to support the government using it as a tool to catch the next Osama bin Laden. Things like this document directly counter the argument that data mining might catch a terror attack by questioning whether that assertion is even true.

Posted by: Edward Liu at December 12, 2006 12:53 PM


Of course there is privacy concerns and of course there is potential for abuse. Name something that can’t be abused? Abuse could be most likely trolling for terrorist but finding a more domestic crime like tax evasion or drug dealing and use the information gleaned to prosecute (Domestic Crime is not time critical or mass casualty potential like terrorism so the justification is not and should not be there for intrusive mining ONLY TERRORISM ONLY) or to get a history profile on a political enemy. Either way all information gleaned Data Mining would only be usable for Terrorism NOT domestic crime (so far the Patriot Act was passed on this basis and I have seen no example of abuse for non-terrorist prosecutions as yet).

I think one of the major FEARS LLL’s have about Data Mining is the 3rd fourth 4th power associates mining targeting. Many ranking LLL’s Belafonte, Sheenan, Jackson tied to front line Democrats, have links to people close to terrorist. Well known Example Belafonte has met with Chavez who we know has met with Iran pres who we know has met with Hamas, Hezbollah, PLFP, IJ, ranking leaders. I would imagine if these are open on camera meetings the back channel phone cross overs must be a lot deeper.

Now I am not saying these LLL’s are terrorist but it is well known they associate with open enemies of the US who often are or are closely linked to terrorist. Personally I think most of them are just washed up peace-love-and-happiness 60’s hold outs looking to relive their glory days and feel young again.

Bottom line thou is that on that 3rd and 4th string sharing that stage with those LLL’s who are not terrorist I would wager are many others WHO ARE terrorist. Like it or not you roll with pigs don’t be mad when you get dirty too. Or in this case don’t be mad when the CIA comes a mining your personal info to catch the guy you just got off the phone with terrorist friend.

Data Mining I think is just one extra that just may catch the next terrorist attack (we need all the help we can get it only takes one terrorist success see 9-11 to do imense damage) but abuse of such tools minning and other for non-terrorist work should be procecuted to the max. You don't disarm the police so they can't abuse thier pistols and shoot some innocent guy you train the cops on when and when not to shoot while procecuting abuse to the max. We need all the tools we can get against terrorist in a open free society if non-intrusive don't work I don't want to see a nation were the Ariport securty goes nation wide Malls, Movies, Supermarket, ect... car searched going in car lot then your person searched going in building on and on and on.

Posted by: C-Low at December 12, 2006 12:29 PM


Post a comment




Remember Me?


Please enter the code as seen in the image below to post your comment.