Epeus' epigone

Edifying exquisite equine entrapments

Wednesday, 29 May 2002

Fighting Terrorism with Google?
A couple of posts on Dave Farber's 'Interesting people' list set this thought off.

First this one
WASHINGTON - An experimental computer program designed to analyze
intelligence gave U.S. Special Forces a mission recommendation in 2000 that
some say could have prevented the Sept. 11 attacks.

In truth, though, the CIA does study foreign press, but before Sept. 11 made
little use of computers to collect and analyze classified and unclassified
information together, which is what Special Forces began doing in 1997,
enabling them to get a read-out on the terror cells.


This smells of fish to me. Computers can't analyze intelligence (unless a lot of AI breakthroughs have happened in secret). People can analyze intelligence. Computers can aggregate and help them link and inform each other.

If the 'intelligence community' worked with the kind of hyperlinking tools that the rest of us use to help make Google the best way to find anything, maybe they'd have got somewhere.

The idea of how this works isn't hard to grasp - my 7-year-old son got it straight away - but it is hard to map to an insufficiently public space, like an intranet or (in particular) a hierarchically organised intelligence network that is more concerned with 'need to know' and secrecy classification.

Today, David Reed suggested that we harness the public:
An open/transparent world reduces imagination of potential threats. It also increases the reliability of assessing actual threats.

Which tends to synergize with Moynihan's sound-bite: "Secrecy is for losers".

So here's a radical proposal: openly publish most (if not all) of the information collected by the CIA, NSA, ... to public inspection. Figure out how to avoid compromising sources where needed, but get all of it out, efficiently. Use the Internet, because it scales, rather than TV, print, and Radio, which don't.

This will enable all of civil society to become outsourcers of the costly mundane details of threat management, leaving the difficult and specialized functions to experts with specialized resources.

In this world, terrorist's ability to use the leverage of "unknown" threats and rampant paranoia of their targets to amplify their meager efforts would be dramatically reduced.

This would also mean that the emergent properties of Google indexing millions of individual human's links could come into play, as discussed in Cory's article 'How I learned to stop worrying and love the Panopticon'

AltaVista for them, Google for us

But what do they do with all of that data that they collect? Filter it for keywords? Fat chance. The volume of false positives (e.g., people talking about child pornography who aren't child pornographers) far exceeds the volume of actual criminal activity. Even creaky old Lycos gave up on plain-old keyword matching a long, long time ago.

Maybe they manually check it. After all, that approach worked for Yahoo, right? Oh, right, it didn't work. Scratch that.

Then they must use some hybrid approach: human editors and AI (Artificial Intelligence or Almost Implemented, take your pick) working in concert to tweeze out the most relevant material as quickly and efficiently as possible.

Right. AltaVista.

Poor bastards.
Posted by Kevin Marks at 17:04

No comments:

Post a Comment

Newer Post Older Post Home
Subscribe to: Post Comments (Atom)

This is my personal blog. Any views you read here are mine, and not my employers'.

Atom Feed

Support the Open Rights Group
My photoKevin Marks Me on Twitter
Me on G+

People's thoughts I read:

Daily

Rosie
San Jose Young People's Theatre
Dave Weinberger
Doc Searls
Gonzo Engaged
AKMA
Cory & friends
Denise Howell
Charles Wiltgen
Shelley Powers
James Lileks
Suw Charman
Halley Suitt

Weekly

Andrew Marks
Blogsisters
Arts & Letters Daily
Bricklin, Frankston & Reed
Steve Yost
Jeneane Sessum
Brian Micklethwait et al
Tom Matrullo
Gary Turner

Sporadically

Small Pieces
Stuart Cheshire
RageBoy
Nonzero
Neil Gaiman
Thomas Vincent
Brad deLong
Andrew Odlyzko
ProSUA

No to Mickey Mouse Computers

powered by blogger

Blog Archive

  • ►  2017 (2)
    • ►  May (1)
    • ►  April (1)
  • ►  2015 (7)
    • ►  November (2)
    • ►  May (3)
    • ►  April (1)
    • ►  January (1)
  • ►  2014 (3)
    • ►  October (1)
    • ►  April (2)
  • ►  2013 (5)
    • ►  June (1)
    • ►  May (1)
    • ►  April (2)
    • ►  March (1)
  • ►  2012 (8)
    • ►  December (1)
    • ►  May (1)
    • ►  April (1)
    • ►  March (1)
    • ►  January (4)
  • ►  2011 (11)
    • ►  December (1)
    • ►  November (1)
    • ►  September (2)
    • ►  August (2)
    • ►  July (1)
    • ►  April (2)
    • ►  January (2)
  • ►  2010 (16)
    • ►  November (1)
    • ►  October (1)
    • ►  September (3)
    • ►  June (1)
    • ►  May (2)
    • ►  April (2)
    • ►  March (2)
    • ►  February (2)
    • ►  January (2)
  • ►  2009 (22)
    • ►  November (2)
    • ►  October (2)
    • ►  September (2)
    • ►  August (3)
    • ►  July (2)
    • ►  June (2)
    • ►  May (2)
    • ►  April (1)
    • ►  February (2)
    • ►  January (4)
  • ►  2008 (28)
    • ►  December (2)
    • ►  November (3)
    • ►  August (1)
    • ►  July (2)
    • ►  June (3)
    • ►  May (5)
    • ►  April (2)
    • ►  February (3)
    • ►  January (7)
  • ►  2007 (45)
    • ►  November (3)
    • ►  October (4)
    • ►  September (4)
    • ►  August (10)
    • ►  July (3)
    • ►  June (8)
    • ►  April (2)
    • ►  March (6)
    • ►  February (3)
    • ►  January (2)
  • ►  2006 (119)
    • ►  December (13)
    • ►  November (8)
    • ►  October (16)
    • ►  September (10)
    • ►  August (3)
    • ►  July (6)
    • ►  June (24)
    • ►  May (3)
    • ►  April (10)
    • ►  March (7)
    • ►  February (8)
    • ►  January (11)
  • ►  2005 (101)
    • ►  December (10)
    • ►  November (13)
    • ►  October (9)
    • ►  September (8)
    • ►  August (7)
    • ►  July (7)
    • ►  June (8)
    • ►  May (12)
    • ►  April (7)
    • ►  March (6)
    • ►  February (1)
    • ►  January (13)
  • ►  2004 (53)
    • ►  December (8)
    • ►  November (5)
    • ►  October (6)
    • ►  September (7)
    • ►  July (5)
    • ►  June (3)
    • ►  May (2)
    • ►  March (3)
    • ►  February (7)
    • ►  January (7)
  • ►  2003 (196)
    • ►  December (12)
    • ►  November (14)
    • ►  October (21)
    • ►  September (23)
    • ►  August (19)
    • ►  July (11)
    • ►  June (14)
    • ►  May (9)
    • ►  April (22)
    • ►  March (20)
    • ►  February (16)
    • ►  January (15)
  • ▼  2002 (224)
    • ►  December (15)
    • ►  November (21)
    • ►  October (22)
    • ►  September (12)
    • ►  August (11)
    • ►  July (28)
    • ►  June (19)
    • ▼  May (29)
      • House Hearing on Home Recording of Copyrighted Works
      • MacOPINION : Matthew Ruben | Celine Dion Killed My...
      • Fighting Terrorism with Google? A couple of posts ...
      • BBspot - Copies of Spider-Man 2 Available on the Web
      • The EFF parody 'The Mickey Mouse Club' to fight th...
      • Dave is complaining about how uncomfortable outdoo...
      • The US Senate Committee on the Judiciary is collec...
      • John Dvorak gets it on the DMCA: I have to ask, d...
      • Alex Cox replays Courtney Love's piracy accusations.
      • Alastair Cooke mourns Peter Bauer, notes China's c...
      • Following Dorothea's advice, I'm trying to make a ...
      • A great Defence of Lessig by Ernie the Attorney le...
      • 2 more quick points on connectivity. The FCC just ...
      • Connectivity Convergence I have to admit that read...
      • Einstein quotes for Akma: Things should be made a...
      • Dave is trying to explain end-to-end for a putativ...
      • Must be summer coming - had a 2 hour power cut at ...
      • Dave is live-blogging Connectivity 2002 One thing ...
      • Akma, who was kind enough recently to confirm my a...
      • If you're at all interested in the CBTPA (Hollywoo...
      • "How does the computer know so much?" Andrew asked...
      • Eisnerwatch Fortune has a shallow article on the c...
      • Creative Commons launched today, and Doc is bloggi...
      • Felt the earth move tonight Magnitude 5.2 in Gilro...
      • Dave's latest JOHO is out. In the email section he...
      • John Glimore explains the problem with Intel's ap...
      • Book people
      • Teaching children to program
      • Study says Internet music sharing helps, does not ...
    • ►  April (18)
    • ►  March (19)
    • ►  February (16)
    • ►  January (14)
  • ►  2001 (13)
    • ►  December (2)
    • ►  November (11)

About Me

My photo
Kevin Marks
Kevin Marks works on IndieWeb and open web tech. From 2011 to 2013 he was VP of Open Cloud Standards at Salesforce. From 2009 to 2010 he was VP of Web Services at BT. From 2007 to 2009, he worked at Google on OpenSocial. From 2003 to 2007 he was Principal Engineer at Technorati responsible for the spiders that make sense of the web and track millions of blogs daily. He has been inventing and innovating for over 25 years in emerging technologies where people, media and computers meet. Before joining Technorati, Kevin spent 5 years in the QuickTime Engineering team at Apple, building video capture and live streaming into OS X. He was a founder of The Multimedia Corporation in the UK, where he served as Production Manager and Executive Producer, shipping million-selling products and winning International awards. He has a Masters degree in Physics from Cambridge University and is a BBC-qualified Video Engineer. One of the driving forces behind microformats.org, he regularly speaks at conferences and symposia on emergent net technologies and their cultural impact.
View my complete profile