Tag: data processing 29 documents
Search documents matching “data processing” →Free-text subjects the curators added. Unlike the other axes these are not necessarily from the documents' own vocabulary, so they are the loosest thing to browse by (and the most forgiving).
Graphs
By Banner
By Classification
Refine (combine with another filter, via search)
Sort: Title
Documents
-
Running Strategic Analytics Affecting Europe and Africa [pdf]
This Top Secret presentation from the NSA ECC (European Cryptologic Center) outlines the strategic challenges and technical methodology for conducting signal intelligence operations across Europe and Africa. It emphasizes a critical reliance on "Second Party" partnerships, particularly with the UK's GCHQ, and details the use of mass surveillance tools like XKEYSCORE to track terrorism, smuggling, and human trafficking networks.
Programs: XKEYSCORE · RTRG · DISTILLERY · CLOUD · GHOSTMACHINE · NIAGARAFILES · WHIZBANG · MAPREDUCE -
SID and ITD Collocate Watches, Help Centralize Data-Flow Management SIDtoday [pdf]
SID personnel tasked with keeping collected data flowing have moved in with the Global Enterprise Command Center. The collocation results in shorter down times and a more reliable and stable "product."
The Intercept ↗ (2019-05-29) -
Something You Can Put Your Hands On SIDtoday [pdf]
TRAILBLAZER's Technology Demonstration Platform beta version will roll out to 20 analysts in August 2004.
The Intercept ↗ (2016-12-07) -
SSO dictionary relevant entries [pdf]
This document provides a detailed list of relevant entries related to NSA's Special Source Operations (SSO), highlighting various NSA surveillance and data collection systems used to monitor global communications. It includes descriptions of programs such as BIGBIRD and DISHFIRE, which focus on cable and SMS interception, as well as tools like LOPERS and COURIERSKILL for processing telephony metadata and refining target selection. The entries emphasize the extensive and automated nature of the NSA's intelligence-gathering operations, particularly in relation to undersea cables and telecommunication networks, and underscore the secretive and expansive scope of SSO's global surveillance activities.
Programs: ARTIFICE · BIGBIRD · FAIRVIEW · SSO · POORWILL · PINECONE · BLACKBELT · CADENCE · BLACKNIGHT · SHIPMASTER · COURIERSKILL · THEORYMASTER · WEALTHYCLUSTER · CLIFFSIDE · DISHFIRE · MARINA · MAINWAY · NUCLEON · PINWALE · FASCIA · BANYAN · LAMPSHADE · ASSOCIATION · HOMEBASE · SEDB · FRIAR · KEYCARD · TURMOIL · TURBULENCE · UTT · IRISHBEAUTY · OCTAVE · KOZYKOVE · LITHIUM · BLARNEY · LOPERS · MAILORDER · LUMBERYARD · MERLIN · NODDY · SAGUARO · NUTHATCH · CONTRAOCTAVE · XKEYSCORE · PLANK · RODEOSTAR · SAGURA · SERENADE · STARGATE · SILVERCOLLAM · SEALION · SEAGULL · SLIVER · SORA-2 · TITANPOINTE · TUBE · VPCS · STONEGATE“NSA Spying Relies on AT&T’s ‘Extreme Willingness to Help’” - ProPublica ↗ (2015-08-15) · “AT&T Helped U.S. Spy on Internet on a Vast Scale” - The New York Times ↗ (2015-08-15) · “The Wiretap Rooms: The NSA’s Hidden Spy Hubs in Eight U.S. Cities” - The Intercept ↗ (2018-06-25) · Angwin, Julia · Larson, Jeff · Savage, Charlie · Moltke, Henrik · Poitras, Laura · Risen, James · Gallagher, Ryan -
SSO News on MYSTIC SHELLTRUMPET for June 20, 2012 [pdf]
Internal NSA memo describing how SHELLTRUMPET, part of the MYSTIC program, works in conjunction with Real Time-Regional Gateway (RT-RG) and various Special Source Operations (SSO) programs to provide metadata access for RT-RG Texas. The system obfuscates source information and filters irrelevant metadata, enabling RT-RG Texas to efficiently process metadata from DANCINGOASIS and SPINNERET.
“Mission Creep: How the NSA’s Game-Changing Targeting System Built for Iraq and Afghanistan Ended Up on the Mexico Border” - The Intercept ↗ (2019-05-29) · “Norges hemmelige krig i Afghanistan” - NRK ↗ (2019-05-29) · Moltke, Henrik · Skille, Øyvind Bye · Døvik, Olav · Hansen, Ståle Ellingsgard · Fjørtoft, Martin -
The collection challenge [pdf]
A slide stating the collection problem in one line: “Collection is outpacing our ability to ingest, process and store to the ‘norms’ to which we have become accustomed.”
-
When the 'Traffic Fairy' Lets You Down SIDtoday [pdf]
A targeting expert helps users of the PINWALE system diagnose problems that may result in garbled or missing data, leading analysts to believe their target has stopped communicating. This is not always the case; an attempt to acquire Central American airline reservation data failed until it was realized that the data flow was encoded using an old IBM character set, rather than the expected ASCII.
Programs: PINWALE · CADENCE · OUTBLAZE · SCISSORS · WEALTHYCLUSTER · POWERPLANT · SURREY · JACKKNIFEThe Intercept ↗ (2018-03-01) -
WINDSTOP - Last 30 Days [pdf]
The WINDSTOP report shows massive NSA collection activity over a 30-day period, with daily DNI (Digital Network Intelligence) and DNR (Dialed Number Recognition) records reaching up to 600 million per day. Most data volume came from DS-300 and DS-200B collection points, processed primarily through XKEYSCORE and TURMOIL, and included a mix of signal types such as PCS, INMAR, MCIP, VSAT, and PSTN. The chart follows the same structure as BOUNDLESSINFORMANT, the NSA’s global SIGINT visualization tool, using bar and pie charts to track and categorize collection volume by signal type, SIGAD, and processing system.
-
XKEYSCORE Helper Notes [pdf]
This GCHQ document describes new features in the XKEYSCORE Palantir helper tool, including summary/histogram import capabilities that reduce large datasets by aggregating connection data rather than creating individual events for each entry, and data sourcing features that track which XKEYSCORE queries imported specific data into Palantir. The document provides step-by-step screenshots showing how analysts can histogram network traffic by source IP, destination IP, and ports, then import aggregated results showing metadata like total session sizes and connection counts.
Programs: XKEYSCORE