The SIGINT Philosopher: Cognitive Overflow?
Open PDFDocument date: 2011-04-15
Type: SIDtoday
Pages: 1
Genre: newsletter
Classification: UNCLASSIFIED
Dissemination: -
A 2011 NSA SIDtoday opinion column reflecting on whether the SIGINT Directorate's collective analytical capacity has a finite "channel capacity" — borrowing from cognitive psychology to ask whether SID's ever-expanding mission, tools, and information load risks exceeding the combined cognitive limits of its workforce.
-
People mentioned:
Chomsky, Noam, Washburn, Sherwood
Countries:
-
Tags:
cognitive psychology, analysis, workforce, information overload
Identifier:
cognitive-overflow
PDF SHA-256:
488f713ca5102f9b16869342478dc51a6ab33de80b5d6c6d35ef96b34f440043
My notes
(U) The SIGINT Philosopher: Cognitive Overflow?
FROM: (U//FOUO) [REDACTED]
Run Date: 04/15/2011
(U) There's a computer sitting atop your shoulders. Granted, real computers can apparently best human brains on Jeopardy with ease, but all the same... Since Noam Chomsky and his cohorts at MIT opened the floodgates to the study of how we think, cognitive psychology has come a long way. Although the ensuing decades of research have highlighted the astounding capabilities of our gray matter, the field has also exposed the limitations our brains are subject to. It may be worth considering the implications these limitations have for our work in SID.
(U) "Channel capacity" is the term some cognitive psychologists have begun to apply to the brain's limits on the amount of certain information it can retain. For instance, research shows that the average person can only differentiate between 5-9 different tones, shapes, or textures at a given time. Any more, and our capacity to categorize becomes overtaxed, and we begin to make mistakes. In other words, the servers overload. It is yet another example of how unprepared humans are, in evolutionary terms, for the information age. Evolutionary biologist Sherwood Washburn once wrote:
(U) "Most of human evolution took place before the advent of agriculture, when we lived in small groups, face-to-face. Man evolved to feel strongly about few people, short distances, and relatively brief intervals."
(U) The question then becomes: If an individual brain has finite "channel capacity," does the vast collective of SID, comprised of thousands of brilliant, yet limited, brains also have a definite "channel capacity"? If so, what is it? How do we know when we've reached it? What if we've already exceeded it? In essence, could SID's reach exceed its grasp? Can the combined cognitive power of SID connect all the necessary dots to avoid, predict, or advise when the improbable, complex, or unthinkable happens?
(U) Take for example the number of tools, clearances, systems, compliances, and administrative requirements we encounter before we even begin to engage in the work of the mission itself. The mission then involves an ever-expanding set of complex issues, targets, accesses, and capabilities. The "cognitive burden," so to speak, must at times feel overwhelming to some of us. The SID is an organism with many moving parts. So how do we ensure our SIGINT potential is in line with, and doesn't overwhelm our collective cognitive capacity? Can we count on our overarching SID mechanism to self-regulate, to organically cull, sort, and retain? Or is there perhaps something extra we ought to be doing to ensure we operate at full exploitative and analytic force?
(U) Surely someone will point out that the burgeoning amalgam of technological advances will aid us in shouldering the burden. However, historically, this scenario doesn't seem to completely bear out. The onslaught of more computing power--often intended to automate some processes--has in many respects demanded an expansion of our combined "channel capacity," rather than curbing the flow of the information that's necessary to retain.
(U) It's an issue worth thinking about and discussing. In the meantime, I'll be working on my 14-character password...
(U) Editor's note: See a Tapioca Pebble on this topic.
Published in the Same Report
(10 documents)
-
Dealing With a 'Tsunami' of Intercept SIDtoday [pdf]
As part of NSAs efforts to implement Human Language Technology, prototype processors located at collection sites will soon be able to query content at "line speed" based on the language, it is written in.
People: Kulman, Anita H.The Intercept ↗ (2019-05-29) · “Inside NSA, Officials Privately Criticize "Collect It All" Surveillance” - The Intercept ↗ (2015-05-28) · Maass, Peter -
Is There a Sustainable Ops Tempo in S2? How Can Analysts Deal with the Flood of Collection? SIDtoday [pdf]
The NSA's Deputy Director for Analysis and Production discusses the unsustainable operational tempo caused by overwhelming data collection volumes, advocating for "Analytic Modernization" that would shift from treating SIGINT as "radioactive" NSA-only material to sharing raw intelligence with other agencies for collaborative exploitation.
Programs: A-SPACE -
'Data Is Not Intelligence' SIDtoday [pdf]
A 2007 NSA SIDtoday summary of a keynote address by Deputy DNI for Analysis Thomas Fingar at the Analytic Transformation Symposium, outlining the Intelligence Community's agenda for improving analytical quality, cross-agency collaboration, and integrated operations through training, shared standards, and new tools like A-Space and the Library of National Intelligence.
Programs: A-SPACE -
"Signal v Noise" Column: Do We Need a Bigger SIGINT Truck? SIDtoday [pdf]
A 2012 NSA SIDtoday opinion column arguing that SID lacks adequate internal metrics to evaluate the value and cost of its SIGINT collection capabilities, using the analogy of melon sellers buying a bigger truck to illustrate how expanding capacity without measuring effectiveness is a flawed response to resource constraints.
-
Op-ed: Leave Bright Pebbles, Not Breadcrumbs, for Those Coming After You SIDtoday [pdf]
A 2010 NSA SIDtoday op-ed by a Chinese language analyst urging analysts to actively document and share their target knowledge through available tools rather than hoarding expertise in personal files or spreadsheets, arguing that the agency's increasing reliance on short tours and rotating assignments makes institutional knowledge-sharing an operational necessity.
-
The SIGINT Philosopher: The Fallacies Behind the Scenes SIDtoday [pdf]
A 2011 NSA SIDtoday opinion column in the "SIGINT Philosopher" series examining four cognitive fallacies — the Texas Sharpshooter, Gambler's, Sunk-Cost, and Appeal to Probability fallacies — and their implications for how analysts unconsciously distort intelligence assessments and decision-making.
-
SIGINT Mission Thread 3 SIDtoday [pdf]
A 2011 NSA SIDtoday article outlining SIGINT Mission Thread 3's strategic initiative to shift the SIGINT Directorate's analytical culture away from data production toward discovery and understanding, introducing tools like the Analytic Body of Knowledge, Analytics Taxonomy, and GAMBIT portal to systematize tradecraft sharing across the Five Eyes enterprise.
Programs: GAMBITPeople: Gladwell, Malcolm -
ELINT Analysts - Overcome by Overload? Help is Here with IM&S SIDtoday [pdf]
A 2011 NSA SIDtoday article announcing the Initial Operational Capability of the ELINT Modernization Information Management and Storage system, designed to give analysts worldwide unified access to five years of ELINT reports and raw data from an expanding range of traditional and non-traditional collection platforms.
-
"Signal v. Noise" Column: Summit Fever SIDtoday [pdf]
A 2012 NSA opinion column in the "Signal v. Noise" series using the mountaineering concept of "summit fever" — the dangerous fixation on reaching a goal despite worsening conditions — as a metaphor for the institutional tendency within SIGINT to continue pursuing failing projects, collection sites, or targets long past the point where objective data would justify stopping.
-
The SIGINT Philosopher: Too Many Choices SIDtoday [pdf]
The inaugural 2011 NSA SIDtoday "SIGINT Philosopher" column by a Russian language analyst, using the everyday paralysis of grocery shopping to introduce the concept of "analysis paralysis" and argue that the SIGINT enterprise's greatest challenge is not a lack of access or information but the cognitive difficulty of prioritizing among an overwhelming abundance of choices.
People: Simon, Herbert
Related Documents
-
The SIGINT Philosopher: The Fallacies Behind the Scenes SIDtoday [pdf]
A 2011 NSA SIDtoday opinion column in the "SIGINT Philosopher" series examining four cognitive fallacies — the Texas Sharpshooter, Gambler's, Sunk-Cost, and Appeal to Probability fallacies — and their implications for how analysts unconsciously distort intelligence assessments and decision-making.
-
The SIGINT Philosopher: Too Many Choices SIDtoday [pdf]
The inaugural 2011 NSA SIDtoday "SIGINT Philosopher" column by a Russian language analyst, using the everyday paralysis of grocery shopping to introduce the concept of "analysis paralysis" and argue that the SIGINT enterprise's greatest challenge is not a lack of access or information but the cognitive difficulty of prioritizing among an overwhelming abundance of choices.
People: Simon, Herbert -
The SIGINT Philosopher: Unlike All My Terrible Teammates, I Am a SIDtoday [pdf]
A 2012 SIDtoday SIGINT Philosopher column using the annual ACE performance review process as a springboard to examine the structural tension between individual competition and collaborative teamwork at NSA, arguing that the agency's promotion and awards system inadvertently incentivizes analysts to hoard work rather than mentor colleagues or enable others.
Programs: SCQAWK -
The SIGINT Philosopher: Descartes Would Have Been a Lousy SIGINT Reporter SIDtoday [pdf]
A 2012 SIDtoday SIGINT Philosopher column using Cartesian epistemology to examine the fundamental reliability problem in SIGINT reporting — arguing that by the time raw intercepts pass through collection, translation, interpretation, and reporting, the finished intelligence product is several steps removed from ground truth and risks becoming little more than an analyst's painting of a scene described to them secondhand.
Programs: SCQAWK -
The SIGINT Philosopher: Lessons for Civil Servants from the American Civil War (That Don't Concern Killing Vampires) SIDtoday [pdf]
The final 2012 SIDtoday SIGINT Philosopher column using the American Civil War as a lens to examine how intelligence professionals should reconcile expert disagreement with national policy, arguing that good civil servants can find peace in the possibility that they might simply be wrong — and that committed execution of even imperfect policy can sometimes produce better outcomes than principled dissent.
Programs: SCQAWK