Classification: TOP SECRET 536 documents
Search documents matching “TOP SECRET” →Each document's classification level, as component values. If a document contains multiple classifications, the highest is used here.
Graphs
By document date (14 years)
By Banner
Refine (combine with another filter, via search)
Sort: Title
Documents
-
Writing XKS Fingerprints [pdf]
This internal NSA training manual serves as a technical guide for analysts using the X-KEYSCORE (XKS) system. It provides a comprehensive breakdown of how to write, name, and test "fingerprints"—the specific code signatures used to identify, tag, and categorize various types of internet traffic across the agency's global collection points. The manual transitions from basic naming conventions to advanced Boolean logic and context-sensitive scanning, illustrating how the NSA automates the discovery of high-value targets, such as those using specific encryption tools or those involved in weapons procurement.
-
X-KEYSCORE Application IDs [pdf]
A TOP SECRET XKeyscore developer training presentation teaching how to write the pattern-matching rules that automatically classify every intercepted internet session by application type, with working examples for Gmail detection, Yahoo chat, ICQ, VoIP protocols and a Mujahideen Secrets encryption fingerprint, plus a side-by-side comparison showing the migration from legacy XML-based pattern definitions to the modern C-like AppID syntax.
-
X-KEYSCORE as a SIGDEV tool 2009 [pdf]
A 2009 TOP SECRET NSA presentation describing XKeyscore as a SIGINT development tool — explaining how it captures and temporarily stores the full content of internet traffic (the 95%+ that was previously dropped because it didn't match any target) across 125 sites worldwide, "slowing down the internet" so analysts can retroactively reconstruct a target's entire online session, discover new targets, and search the content of documents, web searches, emails and chats that contain no tasked selector.
Programs: XKEYSCORE · PINWALE · TRAFFICTHIEF · MARINA · AGILITY · PILBEAM · MAILORDER · CADENCE · NKB · PSC · SSO · UIS“XKEYSCORE: NSA’s Google for the World’s Private Communications” - The Intercept ↗ (2015-07-01) · “No Place to Hide” - Metropolitan Books ↗ (2014-05-13) · “FRA has access to controversial surveillance system” - SVT Nyheter ↗ (2013-12-11) · Marquis-Boire, Morgan · Greenwald, Glenn · Lee, Micah · Bergman, Sven · Dyfvermark, Joachim · Gallagher, Ryan · Laurin, Fredrik · Struwe, Filip -
XKEYSCORE Appids & Fingerprints [pdf]
A TOP SECRET XKeyscore developer training presentation describing the complete AppID and fingerprint programming language — the system NSA analysts and developers use to write pattern-matching rules that automatically classify every piece of intercepted internet traffic by application type, protocol, encryption method and target behaviour — including syntax for keyword matching, regular expressions, binary patterns, context-sensitive scanning and embedded C++ code execution against live intercepted sessions.
-
XKEYSCORE for Counter-CNE [pdf]
A TOP SECRET presentation from March 2011 describing how NSA uses XKeyscore for counter-CNE — detecting and exploiting foreign hacking operations — including ingesting NSA's own TAO implant data, hunting for foreign intrusion sets like DISGRUNTLEDDUCK, and a success story in which Menwith Hill used TAO-stolen Iranian implant encryption keys to decrypt and read keylogger data the Iranian Revolutionary Guard's hackers were stealing from their own victims.
Programs: XKEYSCORE · DISGRUNTLEDDUCK · GENESIS · DANDERSPRITZ · SIMBAR · DONUT · AMULETSTELLAR · TRANGRESSION · TRANSGRESSION -
XKEYSCORE Helper Notes [pdf]
This GCHQ document describes new features in the XKEYSCORE Palantir helper tool, including summary/histogram import capabilities that reduce large datasets by aggregating connection data rather than creating individual events for each entry, and data sourcing features that track which XKEYSCORE queries imported specific data into Palantir. The document provides step-by-step screenshots showing how analysts can histogram network traffic by source IP, destination IP, and ports, then import aggregated results showing metadata like total session sizes and connection counts.
Programs: XKEYSCORE -
XKEYSCORE intro [pdf]
A TOP SECRET NSA presentation from 2008 introducing XKeyscore — one of the earliest overview documents in the archive — describing the system as a globally distributed Linux cluster across approximately 150 sites and 700+ servers that stores a ~3-day rolling buffer of all unfiltered internet traffic, and demonstrating its core capabilities for finding previously unknown targets by mining metadata, tracking documents by embedded image hashes, detecting encryption and VPN use, and language tracking.
Programs: XKEYSCORE · TURMOIL · TURBULENCE · TRAFFICTHIEF · WEALTHYCLUSTER · MOONSHINE · SEARCHLIGHT · MARINA · PSC · SSO · TIMBERLINEPeople: bin Laden, Osama“'Brasil é um grande alvo', diz jornalista sobre vigilância dos EUA” - O Globo ↗ (2013-07-07) · “XKeyscore: NSA tool collects 'nearly everything a user does on the internet'” - The Guardian ↗ (2013-07-31) · “No Place to Hide” - Metropolitan Books ↗ (2014-05-13) · “XKEYSCORE: NSA’s Google for the World’s Private Communications” - The Intercept ↗ (2015-07-01) · Greenwald, Glenn · Bridi, Sônia · Marquis-Boire, Morgan · Lee, Micah -
XKeyscore shared with Germany [pdf]
Document excerpt on the sharing of the NSA spy tool XKeyscore with the Federal Office for the Protection of the Constitution (BfV), Germany's domestic intelligence agency
Programs: XKEYSCORE -
XKEYSCORE Sweden Meeting [pdf]
This document is an internal NSA memo ahead of an annually recurring summit meeting between NSA chief Keith Alexander and the FRA chief. The meeting took place on 24–26 April 2013. Six people from Sweden were to participate in the meeting, including then FRA Director-General Ingvar Åkesson and Deputy Director-General Christina Malm.
-
XKEYSCORE System Administration [pdf]
A December 2012 TOP SECRET XKeyscore System Administration training manual — the detailed technical guide for the engineers who ran XKeyscore field-site clusters — covering the system's Red Hat Linux architecture, master/slave cluster design, database and processing pipeline, the GUI (including built-in Tor, botnet and CNE search menus), the DeepDive full-take packet processor, the xks command-line tool, and monitoring and troubleshooting, with live screenshots from the Timberline site (USF-790) and Menwith Hill Station.
Programs: XKEYSCORE · WEALTHYCLUSTER · MAILORDER · CADENCE · ROGUESTITCH · QUANTUMBOT · COTTONCHAINSAW · MPTRII · SCARFACE · ZAMENSIS · MAPREDUCE · GENESIS · REDUCER · DEEPDIVE · ASDF · CYBER · BULKCRYPT · METTLESOME · PACKETSPLAYYER · PROMOTER · DEFRAG · XFIP · TRAFFICTHIEF · ENDACE · TIMBERLINE · MUSCULAR · FIST · STARPROC -
XKEYSCORE Tech Strings in Documents (aka Tech Extractor) 2009 [pdf]
A December 2009 TOP SECRET XKeyscore training presentation on the Tech Extractor (Tech Strings in Documents) — an early context-aware scanning capability that tags keywords only when they appear inside email, chat and document bodies rather than anywhere in raw internet traffic, letting analysts find technically interesting documents by terms too generic for traditional content selection, with an example flagging a Pakistani document mentioning WiMAX and DVB satellite technology by scanning inside the file.
-
XKEYSCORE Tech Strings in Documents (aka Tech Extractor) 2010 [pdf]
An April 2010 TOP SECRET XKeyscore training presentation on the Tech Extractor — an expanded version of the December 2009 briefing — teaching analysts to find intelligence by tagging keywords inside email, chat and document bodies, with new detail on tasking rules (including that terms hit as substrings so "ricin" matches "pricing"), its non-retrospective operation, its limitations versus the 65+ context fingerprint language, and confirmation that the capability was operated jointly with GCHQ, whose Cheltenham analysts submitted tasking via an Excel template and wiki.
-
XKEYSCORE, Cipher Detection, and You! [pdf]
A TOP SECRET presentation from NSA's Mathematics Research Group dated 21 August 2008, explaining how XKeyscore detects encrypted and steganographic communications — describing the fingerprint and C++ plug-in systems used to flag sessions using particular ciphers, VPNs, encrypted archives and hidden-data tools, with worked examples detecting RAR archives, OpenVPN, digital certificates and various encryption products, plus a revealing note that detection of encryption is itself used to identify communications worth targeting.
Programs: XKEYSCORE · WEALTHYCLUSTER · TURMOIL · CADENCE · UTT · PINWALE · PRESSUREWAVE · TRAFFICTHIEF · PHOSPHORESSENCE · SHELLLOCK · SEDENA · SMOKYSINK · PICARESQUE · PRIVAC · WHARFRAT -
XKS Logos Embedded in Docs [pdf]
A TOP SECRET XKeyscore how-to written by a Booz Allen Hamilton consultant, explaining how analysts can track a document across the internet by the hash of a logo or image embedded inside it — extracting the 32-character hash of a company logo from an intercepted spreadsheet, then searching XKeyscore's document metadata for every other file containing that same image, revealing communications between people the analyst has never heard of.
Programs: XKEYSCORE -
XKS Targets Visiting Specific Websites [pdf]
A TOP SECRET XKeyscore how-to written by a Booz Allen Hamilton consultant, demonstrating two techniques — finding German counterterrorism targets in Pakistan by querying who visits specific German-language Salafi websites, and searching NSA's Computer Network Exploitation implant data within XKeyscore by filtering on implant input sources like FOXACID.
-
Yemen backhaul comms collected (Jan 2011) [pdf]
This brief GCHQ document from January 2011 describes intelligence collection operations against Yemen's microwave telecommunications infrastructure, where overhead (OH) tasking confirmed tower activity and analyzed GSM and CDMA backhaul communications using the ICS2 tool, yielding voice intercepts, SMS messages, and at least one dial number recognition (DNR) hit that significantly contributed to counterterrorism work.