The SIGINT Philosopher: Too Many Choices
Open PDFDocument date: 2011-01-18
Type: SIDtoday
Pages: 2
Genre: newsletter
Classification: UNCLASSIFIED
Dissemination: FOUO
The inaugural 2011 NSA SIDtoday "SIGINT Philosopher" column by a Russian language analyst, using the everyday paralysis of grocery shopping to introduce the concept of "analysis paralysis" and argue that the SIGINT enterprise's greatest challenge is not a lack of access or information but the cognitive difficulty of prioritizing among an overwhelming abundance of choices.
-
People mentioned:
Simon, Herbert
Countries:
Russia
Tags:
analysis paralysis, cognitive bias, attention scarcity, information overload, prioritization, analytic tradecraft
Identifier:
too-many-choices
PDF SHA-256:
fb97e14eac0f3c27df26fb685c8b81a29f59984acb0ceca3820dca4848f8d71f
My notes
(U) The SIGINT Philosopher: Too Many Choices
FROM: (U//FOUO) [REDACTED]
Run Date: 01/18/2011
(U//FOUO) Editor's note: SIDtoday sought out a "SIGINT philosopher" in our midst, and we found him! We are pleased to announce that [REDACTED] (pictured), a Russian language analyst, will be penning a monthly column on that theme, starting today. The below column is unclassified in its entirety:
I'm not a pleasant person to shop with.
The reason is simple an overabundance of choices. The second I'm placed in front of a plethora of tastes, textures, prices, and sizes, I lose my bearings. I don't know the difference between preserves, jams, jellies, or spreads. I know what I like on toast, but heaven help me if I have to go find it in the aisle. Do I go with the bigger jar? What about sugar-free? Swirled with peanut butter? Am I safe with a store brand, or can I assume that with a name like "Smucker's," it has to be good?
You may be wondering right about now just what any of this has to do with SIGINT...
Plenty. We in the agency are at risk of a similar, collective paralysis in the face of a dizzying array of choices every single day.
"Analysis paralysis" isn't only a cute rhyme. It's the term for what happens when you spend so much time analyzing a situation that you ultimately stymie any outcome. It's what happens inside your grandfather's brain while you wait endlessly for him to make his move on the chess board. It's what happens when I stand in front of the jams and jellies at the supermarket. And it's what happens in SIGINT when we have access to endless possibilities, but we struggle to prioritize, narrow, and exploit the best ones.
But hey, we're only human, right? That's my point exactly. Ever wonder why the Pepsi Challenge only had two colas to pick from, or why taste-tests don't ask you to sample dozens of flavors? It's because we're cognitively wired to consume only so much information when making crucial decisions. It's why the best tasting sample will win by leaps and bounds against two competitors, but only by a small margin over many.
In 1971, Herbert Simon could not have known how prophetic the following statement was, given that he was still two decades away from the dawn of the information age:
"...in an information-rich world, the wealth of information means a dearth of something else: a scarcity of whatever it is that information consumes. What information consumes is rather obvious: it consumes the attention of its recipients. Hence a wealth of information creates a poverty of attention and a need to allocate that attention efficiently among the overabundance of information sources that might consume it."
(Designing Organizations for an Information-Rich World, 1971)
In an evolving climate where there are few constants, heuristics (rules of thumb) are of little help in drilling down to our most useful accesses and fulfilling our mission. We spend every day trying to solve what sociologists call "wicked problems." They're tagged as such due to the changing nature of requirements, capabilities, and priorities. They have no ultimate solution and no way to concretely verify the quality of the outcome. These are problems with many "best" answers, and a far greater number of "good" answers. When tackling such issues, narrowing the playing field can be equally vital to broadening our expertise.
The SIGINT mission is far too pressing for many team-building activities or brain-storming sessions aiming to improve our organizational approach to analysis. At the same time, the SIGINT mission is far too vital to unnecessarily expand the haystacks while we search for the needles. Prioritization is key.
And now, if you'll excuse me, I'm off to the store for some jam...
Published in the Same Report
(10 documents)
-
Dealing With a 'Tsunami' of Intercept SIDtoday [pdf]
As part of NSAs efforts to implement Human Language Technology, prototype processors located at collection sites will soon be able to query content at "line speed" based on the language, it is written in.
People: Kulman, Anita H.The Intercept ↗ (2019-05-29) · “Inside NSA, Officials Privately Criticize "Collect It All" Surveillance” - The Intercept ↗ (2015-05-28) · Maass, Peter -
Is There a Sustainable Ops Tempo in S2? How Can Analysts Deal with the Flood of Collection? SIDtoday [pdf]
The NSA's Deputy Director for Analysis and Production discusses the unsustainable operational tempo caused by overwhelming data collection volumes, advocating for "Analytic Modernization" that would shift from treating SIGINT as "radioactive" NSA-only material to sharing raw intelligence with other agencies for collaborative exploitation.
Programs: A-SPACE -
The SIGINT Philosopher: Cognitive Overflow? SIDtoday [pdf]
A 2011 NSA SIDtoday opinion column reflecting on whether the SIGINT Directorate's collective analytical capacity has a finite "channel capacity" — borrowing from cognitive psychology to ask whether SID's ever-expanding mission, tools, and information load risks exceeding the combined cognitive limits of its workforce.
Marking: UNCLASSIFIED -
'Data Is Not Intelligence' SIDtoday [pdf]
A 2007 NSA SIDtoday summary of a keynote address by Deputy DNI for Analysis Thomas Fingar at the Analytic Transformation Symposium, outlining the Intelligence Community's agenda for improving analytical quality, cross-agency collaboration, and integrated operations through training, shared standards, and new tools like A-Space and the Library of National Intelligence.
Programs: A-SPACE -
"Signal v Noise" Column: Do We Need a Bigger SIGINT Truck? SIDtoday [pdf]
A 2012 NSA SIDtoday opinion column arguing that SID lacks adequate internal metrics to evaluate the value and cost of its SIGINT collection capabilities, using the analogy of melon sellers buying a bigger truck to illustrate how expanding capacity without measuring effectiveness is a flawed response to resource constraints.
-
Op-ed: Leave Bright Pebbles, Not Breadcrumbs, for Those Coming After You SIDtoday [pdf]
A 2010 NSA SIDtoday op-ed by a Chinese language analyst urging analysts to actively document and share their target knowledge through available tools rather than hoarding expertise in personal files or spreadsheets, arguing that the agency's increasing reliance on short tours and rotating assignments makes institutional knowledge-sharing an operational necessity.
-
The SIGINT Philosopher: The Fallacies Behind the Scenes SIDtoday [pdf]
A 2011 NSA SIDtoday opinion column in the "SIGINT Philosopher" series examining four cognitive fallacies — the Texas Sharpshooter, Gambler's, Sunk-Cost, and Appeal to Probability fallacies — and their implications for how analysts unconsciously distort intelligence assessments and decision-making.
-
SIGINT Mission Thread 3 SIDtoday [pdf]
A 2011 NSA SIDtoday article outlining SIGINT Mission Thread 3's strategic initiative to shift the SIGINT Directorate's analytical culture away from data production toward discovery and understanding, introducing tools like the Analytic Body of Knowledge, Analytics Taxonomy, and GAMBIT portal to systematize tradecraft sharing across the Five Eyes enterprise.
Programs: GAMBITPeople: Gladwell, Malcolm -
ELINT Analysts - Overcome by Overload? Help is Here with IM&S SIDtoday [pdf]
A 2011 NSA SIDtoday article announcing the Initial Operational Capability of the ELINT Modernization Information Management and Storage system, designed to give analysts worldwide unified access to five years of ELINT reports and raw data from an expanding range of traditional and non-traditional collection platforms.
-
"Signal v. Noise" Column: Summit Fever SIDtoday [pdf]
A 2012 NSA opinion column in the "Signal v. Noise" series using the mountaineering concept of "summit fever" — the dangerous fixation on reaching a goal despite worsening conditions — as a metaphor for the institutional tendency within SIGINT to continue pursuing failing projects, collection sites, or targets long past the point where objective data would justify stopping.
Related Documents
-
The SIGINT Philosopher: The Fallacies Behind the Scenes SIDtoday [pdf]
A 2011 NSA SIDtoday opinion column in the "SIGINT Philosopher" series examining four cognitive fallacies — the Texas Sharpshooter, Gambler's, Sunk-Cost, and Appeal to Probability fallacies — and their implications for how analysts unconsciously distort intelligence assessments and decision-making.
-
The SIGINT Philosopher: Descartes Would Have Been a Lousy SIGINT Reporter SIDtoday [pdf]
A 2012 SIDtoday SIGINT Philosopher column using Cartesian epistemology to examine the fundamental reliability problem in SIGINT reporting — arguing that by the time raw intercepts pass through collection, translation, interpretation, and reporting, the finished intelligence product is several steps removed from ground truth and risks becoming little more than an analyst's painting of a scene described to them secondhand.
Programs: SCQAWK -
The SIGINT Philosopher: Cognitive Overflow? SIDtoday [pdf]
A 2011 NSA SIDtoday opinion column reflecting on whether the SIGINT Directorate's collective analytical capacity has a finite "channel capacity" — borrowing from cognitive psychology to ask whether SID's ever-expanding mission, tools, and information load risks exceeding the combined cognitive limits of its workforce.
Marking: UNCLASSIFIED -
The SIGINT Philosopher: In Praise of Not Knowing SIDtoday [pdf]
A 2012 NSA SIDtoday opinion column in the "SIGINT Philosopher" series arguing that the Intelligence Community — and NSA in particular — too rarely admits the limits of its knowledge, using the misappropriation of the word "agnostic" as a springboard to critique the institutional pressure to produce intelligence reports even when genuine understanding of a target is absent.
People: Kim, Jong-un -
The SIGINT Philosopher Is Back -- with a New Face! SIDtoday [pdf]
The inaugural column of the second SIGINT Philosopher series, in which the new columnist uses a personal polygraph experience and the ethical tension of spying on diplomatic targets to argue — somewhat counterintuitively — that thorough, comprehensive surveillance is more ethical than partial or halfhearted monitoring of non-adversarial targets.
Programs: SCQAWK