Tag: pattern-of-life 31 documents
Search documents matching “pattern-of-life” →Free-text subjects the curators added. Unlike the other axes these are not necessarily from the documents' own vocabulary, so they are the loosest thing to browse by (and the most forgiving).
Graphs
By Banner
By Classification
Refine (combine with another filter, via search)
Sort: Title
Documents
-
Blazing Saddles [pdf]
This document describes BLAZING SADDLES, a GCHQ program designed to massively scale the storage and analysis of bulk internet surveillance data through multiple specialized databases that track website visits, online identities, communications patterns, and geolocation queries across the global internet population.
Programs: BLAZINGSADDLES · BLACKHOLE · SOCIALANTHROPOID · AUTOASSOC · HRMAP · INFINITEMONKEYS · KARMAPOLICE · MARBLEDGECKO · MUTANTBROTH · MEMORYHOLE · SAMUELPEPYS · SOCIALANIMAL · HAUSTORIUM · GOLDENAXE · NGE -
Catch of the Day: Abu Mu'sab al-Zarqawi and Friends SIDtoday [pdf]
An NSA analyst deployed with Special Operations Task Force Iraq describes the intelligence and "detainee reporting" that led to the killing of Abu Musab al-Zarqawi on June 7, 2006. Zarqawi was smoked out by uncovering his network and a key advisor who led the military to his hiding place, and also was killed.
The Intercept ↗ (2018-08-15) -
CNE End Point Requirements [pdf]
This NSA/GCHQ document outlines comprehensive requirements for an endpoint surveillance systems that enables analysts to systematically identify intelligence collection needs and discover appropriate tools for data extraction from compromised computers. The framework covers capabilities for remote data collection, cross-platform intelligence integration, query functions, tasking procedures, and visualization tools across implanted networks.
Programs: STARGATE · LOOKING GLASS · QUANTUM · GOLDENEYE · XKEYSCORE · MARINA · JTRIG · BROADOAK · UTT · GLOBALREACH · GLOBALSURGE · THUGGEE · EREPO · DANCINGBEAR · HAUSTORIUM · SHAREOWN · MUTANTBROTH · MOONRAKER · CARBONROD · RUFFLE · ROCKOPERA · QUINCEY · ECLIPSE · MUGSHOT · HIGHNOTE · UDAQ2 · EKB · TURBINE · ACNO · FLAMECARPET · FUMECUPBOARD · JACKPOT · SLIPSTREAM · B13B · PSC · QUINCY · DAREDEVIL · ROADBED -
Come to SID's Identity Intelligence (I2) Day Conference and See Your Target in a Whole New Light! SIDtoday [pdf]
This SIDtoday article promotes NSA's Identity Intelligence (I2) Day Conference, highlighting the importance of using SIGINT tools and techniques to track individuals across time and space. It emphasizes the growing role of biometrics, biographic data, and digital footprints in identifying and targeting foreign persons of interest, with insights from key speakers and case studies.
-
DSD’s Risky Metadata Sharing: Australian Citizens’ Privacy Jeopardized in 5-Eyes Surveillance [pdf]
The document reveals that in 2008, Australia’s Defence Signals Directorate (DSD) was willing to share bulk, unselected, unminimised metadata about ordinary citizens with its 5-Eyes partners, including sensitive medical, legal, and religious information.
Marking: SECRET -
Exploiting Facebook traffic in the passive environment to obtain specific information [pdf]
A GCHQ Global Telecommunications Exploitation presentation on extracting information about Facebook users from passively collected traffic: why online social networks are a rich source, how Facebook's use of the Akamai content delivery network exposes a user's ID inside image URLs, and how profile and album images are then obtained through SPRING BISHOP, GODFATHER and JTRIG.
-
From the Sandbox to Mexico: Applying Wartime Tactical Techniques to Strategic Missions SIDtoday [pdf]
Systems developed for the "sandbox” (Iraq) such as pattern-of-life-analysis and phone geolocation are now used against drug criminals on the US-Mexico border.
People: Carrillo Fuentes, Vicente“Mission Creep: How the NSA’s Game-Changing Targeting System Built for Iraq and Afghanistan Ended Up on the Mexico Border” - The Intercept ↗ (2019-05-29) · “Norges hemmelige krig i Afghanistan” - NRK ↗ (2019-05-29) · The Intercept ↗ (2019-05-29) · Moltke, Henrik · Skille, Øyvind Bye · Døvik, Olav · Hansen, Ståle Ellingsgard · Fjørtoft, Martin -
FY2013 Congressional Budget Justification Bin Laden Excerpts [pdf]
This document includes excerpts from the 2013 National Intelligence Program budget justification describing the integrated intelligence community efforts that led to locating and raiding Osama bin Laden's compound, detailing contributions from NSA's signal intelligence, CIA's geolocation analysis, NGA's imagery modeling, and post-raid forensic DNA confirmation.
People: bin Laden, Osama -
GCHQ Analytic Cloud Challenges [pdf]
The 2012 GCHQ Analytic Cloud document outlines a sophisticated data processing infrastructure handling approximately 50 billion daily events across multiple sites, utilizing QFD databases and HADOOP clusters for various analytic capabilities targeting intelligence gathering and analysis. It describes architectural components, challenges in scaling and enabling analysts to cope with data complexity, and proposes future technology options including consolidation approaches and new cloud architectures to enhance capabilities.
Programs: EVOLVEDMUTANTBROTH · MUTANTBROTH · HARDASSOC · HRMAP · KARMAPOLICE · SOCIALANTHROPOID · AUTOASSOC · GEOFUSION · MVR · TERRAIN · SALAMANCA · BLACKHOLE · SAMUELPEPYS · BROKER · VAIL · GUIDINGLIGHT · FIRSTCONTACT · CLOUDYCOBRA · RUMOURMILL · EVERYASSOC · EVERYPOLICE · EVERYCREATURE · EVERYEAD · EVERYCIPHER · GREYFOX · SILVERFOX · GOLDENAXE · TRIBALCARNEM · PUBLICANEMONE · EPICFAIL · STERLINGMOTH · FOGHORN · LOOKINGGLASS · FIREENGINE · NGGEO · ALPHACENTAURI · CLOUDBASE · ACCUMULO · ASEM · SEM · HAKIM · STREAMING · HBASE · LAUREL · SKINNYCLOUD · HARDY · GCHQCORE -
GCHQ Hopscotch [pdf]
An internal note argues for consolidating “edges”—summarized contact pairs—into a single cloud to unify relationship graphs, streamline analytics, and simplify management of HOPSCOTCH. It’s a mundane-sounding data-migration pitch with sharp operational teeth: centralize the social graph so surveillance queries run faster and wider.
Programs: HOPSCOTCH“Operation Socialist: The Inside Story of How British Spies Hacked Belgium’s Largest Telco” - The Intercept ↗ (2014-12-13) · “Lees hier hoe de Britse geheime dienst GCHQ Belgacom aanviel” - NRC ↗ (2014-12-13) · “Britse geheime dienst bespioneerde jarenlang Belgacom-klanten” - De Standaard ↗ (2014-12-13) · Gallagher, Ryan · Modderkolk, Huib · Vanhecke, Nikolas · Eeckhaut, Mark -
GHOSTHUNTER Tasking Process [pdf]
The document outlines the GHOSTHUNTER (GH) tasking process at Menwith Hill Station, describing how geolocation requests for VSAT terminals and internet-connected targets are managed through coordination with the NSA’s Network Analysis Centre (NAC) and other sites. It details priority levels, task submission procedures, use of locational data from MASTERSHAKE, integration with imagery, and how results are shared with GCHQ and other authorized parties.
-
Graph theory in the operational environment – GCHQ [pdf]
This document details GCHQ’s research on identifying “closed loops” of communication, where targets use a small set of phones to communicate exclusively among themselves, often with cheap, disposable handsets like the Nokia 1100. It explains the methodology for analyzing anonymized metadata, constructing contact graphs, and extracting non-giant, non-tree components to discover operationally relevant closed loops for intelligence and counterterrorism purposes.
Programs: VOICESAILPeople: Rumsfeld, Donald -
HTTP Activity in XKEYSCORE [pdf]
This training presentation from March 2009 provides NSA and Five Eyes analysts with detailed instructions on exploiting HTTP web browsing activity collected by XKEYSCORE, explaining how to differentiate client-to-server requests (GET/POST) from server-to-client responses, extract metadata like search terms, URLs, cookies, language, and browser types, and use this data to discover new surveillance targets, track individuals' online behavior, and conduct "pattern of life" analysis.
-
ICTR Cloud Efforts [pdf]
A GCHQ presentation details how the agency developed cloud-based big data analytics to achieve "population scale" surveillance—processing trillions of internet events to build geographic and behavioral profiles on every online identifier worldwide, enabling discovery of unknown targets through pattern analysis rather than traditional keyword searches.
Programs: EVERYASSOC · PROBABILITYCLOUD · SILVERLINING · CULTWEAVE · KARMAPOLICE · EVERYPOLICE · AWKWARDTURTLE · GORDIANKNOT · SANDIA · BLOODHOUND · FIVEALIVE · NGE · MAPREDUCE -
Identity Intelligence: Image Is Everything [pdf]
This document is a highly classified NSA/CSS briefing detailing Identity Intelligence (i2), a comprehensive methodology for exploiting unique fragments of information to track, identify, and exploit targets of interest. It outlines an expansive architecture for data collection that spans Biometric/Biologic, Biographic, and Contextual/Behavioral domains, essentially mapping every conceivable data point of an individual's physical existence and digital/social footprint.
-
Is There a Sustainable Ops Tempo in S2? How Can Analysts Deal with the Flood of Collection? SIDtoday [pdf]
The NSA's Deputy Director for Analysis and Production discusses the unsustainable operational tempo caused by overwhelming data collection volumes, advocating for "Analytic Modernization" that would shift from treating SIGINT as "radioactive" NSA-only material to sharing raw intelligence with other agencies for collaborative exploitation.
Programs: A-SPACE -
Metadata Policy Conference (2008) [pdf]
This document summarizes the high-level discussions from a 2008 conference focused on the legal, policy, and technical challenges of sharing communications metadata between the NSA, its domestic partners, and the Second Party (Five Eyes) SIGINT agencies. It highlights a strategic shift toward bulk data usage and "pattern of life" analysis, while navigating the complex legal distinctions between metadata and "content" under Executive Order 12333 and FISA.
-
QFD BLACKHOLE Technology Behind INOC [pdf]
A UK SECRET STRAP2 COMINT ORCON GCHQ Applied Research presentation from March 2009 documenting the BLACK HOLE bulk data repository's scale and structure, and the suite of analytical tools — MUTANT BROTH, KARMA POLICE, INFINITE MONKEYS and MARBLED GECKO — built on top of it to answer specific intelligence questions about online presence, browsing activity, forum usage and geolocation searches.
Programs: BLACKHOLE · MESME · NETEZZA · CLOUDS · MUTANTBROTH · KARMAPOLICE · INFINITEMONKEYS · MARBLEDGECKO · GOOB · AUTOASSOC · PSOUP · SOCIALANIMAL · SAMUELPEPYS · MEMORYHOLE · HRMAP · PSOUPALERT · LAUGHINGHYENA -
Real-Time Regional Gateway (RT-RG) [pdf]
This document from GCHQ details the NSA's Real-Time Regional Gateway (RT-RG), a system designed to provide tactical military users with near-instantaneous SIGINT (signals intelligence) support by integrating and analyzing data from multiple sources. It outlines the system’s applications, benefits, and challenges, particularly in enhancing the speed and efficiency of intelligence delivery to military operations in regions like Afghanistan, and highlights its impact on collaboration with GCHQ.
Programs: RT-RG · RT-10 · GOLDMINER · VOICESAIL · GEOT · SHARKFINN · CELLEX · SORTINGLEAD · GREMIO · IMMERGO · HERRICK · AIRHANDLER · TIPPERS · PASHTOVOICE · VIPERFOCUS · SKS · GEOFUSION · EVENTS“Mission Creep: How the NSA’s Game-Changing Targeting System Built for Iraq and Afghanistan Ended Up on the Mexico Border” - The Intercept ↗ (2019-05-29) · “Norges hemmelige krig i Afghanistan” - NRK ↗ (2019-05-29) · Moltke, Henrik · Skille, Øyvind Bye · Døvik, Olav · Hansen, Ståle Ellingsgard · Fjørtoft, Martin -
Real-Time Regional Gateway Cloud Analytics for Forward Users [pdf]
This document outlines the NSA’s Real-Time Regional Gateway (RT-RG) program, a global cloud-based signals intelligence system designed to provide near real-time data analysis and targeting support for military and intelligence operations. It details the transition to scalable cloud architectures such as GHOSTMACHINE and Cloudbase, enabling massive data retention, exploitation, advanced geolocation, and automated analytics for tracking high-value targets across multiple theaters, including Afghanistan, Iraq, and the Horn of Africa.
Programs: RT-RG · GOLDMINER · GEOT · AGENTLOGIC · SHARKFINN · SKS · PANOPTICON · DRT · CIDNE · JUGGERNAUT · LOPERS · TALIS · MATTERHORN · AIRHANDLER · LYCANTHROPE · VOICESAIL · RETURNSPRING · SORTINGLEAD · GHOSTMACHINE · GMROYALE · GMREGAL · GMGEIST · GMIDEA · GMTOTE · GMPEN · GMPAC · GMCALM · GMMATE · GMAPPLE · GMCAVE · GMPEACH · GMDEN · GMMOUNT · GMALAMO · GMLIGHT · GMBALTIC · GMPLACE · GMPARK · GMHALO · GMCARBON · DRAGONFIRE · DOMEEXPOSE · GIANTSQUID · MAINWAY · FURIOUSCHAINSAW · SHARKFURY · NIAGARAFILES · SHARKQUERY · SHARKDOCS · OCTAVE · UTT · BEDDOWN · CHEEKYMONKEY · LAYERCAKE · CYBERTRANS · GMSEMINOLE · GMGULF · GMZILLA · HLT · JEMA · NEVIS · SEDB · CLOUDBASE · MAPREDUCE · CASPORT · WAVELEGAL“Mission Creep: How the NSA’s Game-Changing Targeting System Built for Iraq and Afghanistan Ended Up on the Mexico Border” - The Intercept ↗ (2019-05-29) · “Norges hemmelige krig i Afghanistan” - NRK ↗ (2019-05-29) · Moltke, Henrik · Skille, Øyvind Bye · Døvik, Olav · Hansen, Ståle Ellingsgard · Fjørtoft, Martin