Tag: analytic tools 38 documents
Search documents matching “analytic tools” →Free-text subjects the curators added. Unlike the other axes these are not necessarily from the documents' own vocabulary, so they are the loosest thing to browse by (and the most forgiving).
Graphs
By Banner
By Classification
Refine (combine with another filter, via search)
Sort: Title
Documents
-
Analyzing Mobile/Cellular DNI in XKEYSCORE, May 2009 [pdf]
The XKEYSCORE document explains how the agency analyzes mobile/cellular device internet usage by collecting and processing both converged DNI/DNR data within cellular networks and traditional internet traffic, using various tools and indicators to identify mobile users even when their device type isn't immediately evident. The document demonstrates how the system can track mobile internet activity across applications like Yahoo Mail and identifies devices through various technical "hints" including MSISDN codes, browser fingerprints, and user agent strings.
-
AND THEY SAID TO THE TITANS: « WATCH OUT OLYMPIANS IN THE HOUSE! » [pdf]
This Top Secret CSEC “Olympia” document details a Canadian intelligence program that analyzed and tracked the Brazilian Ministry of Mines and Energy’s telecommunications, mapping IPs, servers, proxies, and mobile devices while automating data collection and network analysis to develop actionable intelligence. It outlines tools, workflows, and contacts used for surveillance, though the presentation does not explain the specific purpose of the operation.
Programs: OLYMPIA · QUOVA · PROMETHEUS · PEITHO · SLINGSHOT · LEVITATE · STRATOS · EVILOLIVE · GCHQ Geofusion · ATLAS · HYPERION · ATHENA · DANAUS · TIDALSURGE · BLACKPEARL · MARINA · STARSEARCH · PEPPERBOX · TRITON · PACKAGEDGOODS · ARK · TOYGRIPPE · FRIARTUCK · MASTERSHAKE · COEUS · STALKER · MAINWAY · FASCIA · SEDB · OCTSKYWARD · FASTBAT · TWINSERPENT · EONBLUE · DISHFIRE · GNDB“Read a CSEC document that was first acquired by Edward Snowden” - The Globe and Mail ↗ (2013-11-30) · “Ministério de Minas e Energia está na mira de espiões americanos e canadenses” - O Globo ↗ (2013-10-06) · “No Place to Hide” - Metropolitan Books ↗ (2014-05-13) · Freeze, Colin · Bridi, Sônia · Greenwald, Glenn -
BLACK HOLE ANALYTICS, ADD/SD briefing, September 2009 [pdf]
This September 2009 GCHQ briefing describes the BLACK HOLE analytics infrastructure and Next Generation Events (NGE) project, which planned to scale from ~8 10-gigabit connections to ~200 10Gs by March 2011, storing intercepted data in massive flat-file repositories at Benhall and Bude before loading it into "Question Focused Dataset" (QFD) databases that power surveillance tools like MUTANT BROTH, KARMA POLICE, INFINITE MONKEYS, and others. The document outlines how "probes" extract Target Detection Identifiers (TDIs) from intercepted data feeds, store them in BLACK HOLE repositories, then enable analysts to profile targets' online activities, create social networks, investigate websites and forums, track web searches and Google Earth usage, and perform large-scale data mining across internet and telephony data.
Programs: BLACKHOLE · MUTANTBROTH · AUTOASSOC · INFINITEMONKEYS · KARMAPOLICE · SOCIALANIMAL · HRMAP · MEMORYHOLE · MARBLEDGECKO · HARDASSOC · SAMUELPEPYS · BLAZINGSADDLES · TELLURIAN · BUFFER · DISTILLERY · LOOKINGGLASS · NGEPeople: bin Laden, Osama -
Charlie Meals: Thoughts as Retirement Approaches SIDtoday [pdf]
Deputy Signals Intelligence Director Charlie Meals is retiring after a 40-year career. He rates SIGINT as now without rival among the intelligence disciplines. But there's room for improvement in analytics tools, IT infrastructure, and staff training.
Programs: ITISThe Intercept ↗ (2018-03-01) -
CTIC: It's Not Just Another Pretty Space SIDtoday [pdf]
The Counterterrorism Innovation Center takes a multidisciplinary approach to solving common problems related to counterterrorism work. Their projects include voice keyword search and data visualization tools.
Programs: VoiceRT -
Customer Feedback Made Easier SIDtoday [pdf]
Introduction of a new form for customer feedback. Only 5 percent of product has documented feedback; analysts encouraged to enter feedback into the database.
Programs: PLUSThe Intercept ↗ (2016-05-16) -
-
Dealing With a 'Tsunami' of Intercept SIDtoday [pdf]
As part of NSAs efforts to implement Human Language Technology, prototype processors located at collection sites will soon be able to query content at "line speed" based on the language, it is written in.
People: Kulman, Anita H.The Intercept ↗ (2019-05-29) · “Inside NSA, Officials Privately Criticize "Collect It All" Surveillance” - The Intercept ↗ (2015-05-28) · Maass, Peter -
ELINT Analysts - Overcome by Overload? Help is Here with IM&S SIDtoday [pdf]
A 2011 NSA SIDtoday article announcing the Initial Operational Capability of the ELINT Modernization Information Management and Storage system, designed to give analysts worldwide unified access to five years of ELINT reports and raw data from an expanding range of traditional and non-traditional collection platforms.
-
GCHQ Hopscotch [pdf]
An internal note argues for consolidating “edges”—summarized contact pairs—into a single cloud to unify relationship graphs, streamline analytics, and simplify management of HOPSCOTCH. It’s a mundane-sounding data-migration pitch with sharp operational teeth: centralize the social graph so surveillance queries run faster and wider.
Programs: HOPSCOTCH“Operation Socialist: The Inside Story of How British Spies Hacked Belgium’s Largest Telco” - The Intercept ↗ (2014-12-13) · “Lees hier hoe de Britse geheime dienst GCHQ Belgacom aanviel” - NRC ↗ (2014-12-13) · “Britse geheime dienst bespioneerde jarenlang Belgacom-klanten” - De Standaard ↗ (2014-12-13) · Gallagher, Ryan · Modderkolk, Huib · Vanhecke, Nikolas · Eeckhaut, Mark -
GCHQ VisWeek 2008 Conference Report [pdf]
This GCHQ document summarizes key findings from the VisWeek 2008 visualization conference in Ohio, highlighting techniques and tools relevant to SIGINT analysis including collaborative analysis capabilities, graph visualization methods, and the Palantir Government platform. The report recommends incorporating features like analyst notebooks for tracking investigations, collaborative workspaces for multiple analysts, and various graph layout algorithms into GCHQ's MONTE VISTA visualization system.
Programs: MONTE VISTA · MAMBA · CHARTBREAKER · PIGS EAR · KNIME · RAPTOR · BROAD OAK · HAUSTORIUM · SALAMANCA · IIB · INFOVIS · PALANTIR -
GLOBALVISION: Accessing Multiple Databases With a Single Log-on SIDtoday [pdf]
"GLOBALVISION" is a new tool that allows for federated queries of 11 NSA databases used by signals intelligence analysts.
Programs: GLOBALVISION · MAINWAY · HOMEBASE · ASSOCIATION · FASCIA · CONTRAOCTAVE · DISHFIRE · OCTAVE · PINWALE · SPOTBEAM · SPEEDBUMP · YACHTSHOP · GLOBALREACH · CREST · UIS · APATS · SIGINT NAVIGATORPeople: Wessel, Gregory L.The Intercept ↗ (2017-09-13) -
Green Dragon and the Advanced Analytic Lab -- What's the Difference? SIDtoday [pdf]
This article explains the difference between “GREEN DRAGON” — a program that tests new tools and technologies in “real-world operations” — and the Advanced Analytic Lab, which uses research to solve “hard SIGINT problems.”
Programs: GREEN DRAGONThe Intercept ↗ (2018-08-15) -
HIDDENSALAMANDER - Alerting and Characterization of Botnet Activity in TURMOIL [pdf]
This NSA briefing describes HIDDENSALAMANDER, a TURMOIL component that detects, tracks, and characterizes botnet command-and-control traffic on passive collection sensors worldwide, generating enriched metadata about bot herders, infected machines, attack commands, and malware families while providing low-latency defensive alerts when botnet activity involves high-value targets or protected networks. The system extends beyond traditional signature matching by decrypting Zeus RC4-encrypted traffic, extracting payload details like target IPs and DDoS commands, tracking C2 servers across multiple sessions, and categorizing botnet lifecycle stages (configuration, infection, reconnaissance, C&C communication, attack, exfiltration) to support both offensive attribution and defensive response.
Programs: HIDDENSALAMANDER · TURMOIL · CLOUDSHIELD · NETEZZA · TUTELAGE · GMPLACE · RONIN · CYBERCLOUD · MARINA · GHOSTMACHINE · QBOT · ASDF · MARIPOSA · XKEYSCORE · GOGADGET · TURQI · TRAFFICTHIEF · FALLOUT · POUNDSAND · BLUESMOKE · AEG · TURNABOUT · QUANTUMBOT -
How to tell if a target is 'foreign' [pdf]
The document describes a human intelligence (HUMINT) report indicating that a specific intelligence target, identified by a Foreign Source ID, is located outside the U.S., including details such as email, telephone number, and mobile network type, with checks confirming no U.S. roaming over a 60-day period. It illustrates the use of HUMINT to corroborate foreign location data for surveillance purposes.
-
IA Town Meeting SIDtoday [pdf]
Intelligence analysts are invited to a meeting to be briefed on tools and trainings.
The Intercept ↗ (2016-12-07) -
Learn About Cutting-Edge Analysis Tools SIDtoday [pdf]
New analysis tools developed by Tailored Access Operations help locate and visualize target devices.
The Intercept ↗ (2018-08-15) -
Letters to the Editor: About 'Roadblocks to Change' SIDtoday [pdf]
SIDtoday readers respond to a recent article about a study which identified “resistance to change” as one of three roadblocks to new technology. One correspondent notes the proliferation of tools for contact chaining and reporting, many of which overlap.
Programs: MAINWAY · PROTON · BANYAN · GRASP · ANALYST COCKPIT · GREEN DRAGON · MISSION MANAGERS COCKPITThe Intercept ↗ (2018-08-15) -
Menwith databases as of Aug 2008 [pdf]
This document outlines database access and SIGINT missions at Menwith Hill Station (MHS) as of August 2008, detailing the specific programs, language branches, and target development teams supported, including repositories like DISHFIRE, MAINWAY, and PINWALE. It also notes that U.S. personnel use the SIGINT Contact Center (SCC) process for access, with certain NOFORN restrictions, and lists additional analytic tools available to MHS analysts.
Marking: CONFIDENTIALPrograms: ASSOCIATION · DISHFIRE · HOMEBASE GEO · MAINWAY · NUCLEON · PINWALE · SPOTBEAM · XKEYSCORE · BANYAN · BROOMSTICK · CULTWEAVE II · MARINA · TRAFFICTHIEF · FASCIA · OCTSKYWARD · ROADBED · TUNNINGFORK · AGILITY · CADENCE · CONTRAOCTAVE · GAMUT · UTT · NKB · OCTAVE · PUZZLECUBE · TKB -
Mobile apps doubleheader: BADASS Angry Birds [pdf]
A joint GCHQ/GTE/CSEC presentation describing BADASS — the BEGAL Automated Deployment and Survey System for rapidly developing and deploying mobile app exploitation rules — illustrated through detailed analysis of Angry Birds' Dataflurry analytics traffic leaking IMEI, IMSI, cell network metadata and device identifiers, alongside AdMob, Mobclix and Mydas ad network traffic leaking UDIDs and IMEIs across iOS, Android, BlackBerry and Windows Phone 7 platforms.
Programs: BADASS · BEGAL · SEM · UNIQUELYCHALLENGED · BLACKHOLE · MOUNTAINVIEW · VOB · BABELFISH · BISHOP · MVR · PPF · AEG · DATAFLURRY