Crypt Ops Data Store User Guide
Open PDFDocument date: -
Pages: 4
Genre: guide
Banner: SECRET
Classification: SECRET
Dissemination: -
A SECRET GCHQ user guide for the Crypt Ops Data Store — the internal task management system used by GCHQ's cryptanalytic operations division to receive, triage, assign and track decryption and cryptanalytic requests — notable for its category list which maps task types to operational programmes including BULLRUN, BEARDED PIGGY and VPN exploitation.
BULLRUN, XKEYSCORE, BEGAL, BEARDEDPIGGY
People mentioned:
-
Countries:
-
Tags:
cryptanalysis, operational workflow, VPN exploitation, VPN decryption, target discovery
Identifier:
spiegel_-_media-35547
PDF SHA-256:
bcee86e47723cbeb878398729099cd47609233548dab28b8cdab2d84933fda02
My notes
SECRET
Crypt Ops Data Store User Guide
Crypt Ops Datastore [REDACTED]
DataStore Rota:
[REDACTED]
~Data Store to be reviewed weekly at the DataStore management meeting
The Tasking Process
Submitting a Task
- The customer follows the links to the Data Store page and clicks 'Add Record'.
- The fields 'Crypt Task POC', 'Updates' and 'Team Plan Ref should all be left blank, to be filled in later by Crypt Ops.
- All fields marked with an * must be completed.
- The Required by Date should be changed.
- The 'Task Status' should be left as 'New Task' and the 'Record Status' should be left set to 'Draft'.
- Once all necessary fields are completed click 'Submit'.
Once submitted the task will be dealt with as follows:
Processing a Task
- The DS (Data Store) Admin team is notified of that a Task has been submitted.
- The 'on duty' Admin reviews the task, assessing what category (see below) it falls into and passes it along to the appropriate TL (team leader).
Categories
- BR BULLRUN [REDACTED]
- CTSC [REDACTED] Counter Terrorism and Serious Crime
- EA [REDACTED] Electronic Attack
- GT [REDACTED] Global Targets
- HCA [REDACTED] Hand Crypt and SMS
- MENA [REDACTED] Middle East North Africa
- MOB [REDACTED] Mobile Infrastructure
- PRS [REDACTED] Password Recovery Service
- TD [REDACTED] Generic Target Discovery
- TR [REDACTED] Technical Research
- VPN [REDACTED] Virtual Private Networks
- SIG [REDACTED] Generic or complex signature development,
possibly to include XKS fingerprinting (and TDI/BEGAL in the future?)
And possibly more, including:
1 of 4
This information is exempt from disclosure under the Freedom of Information Act 2000 and may be subject to exemption under other UK information legislation. Refer disclosure requests to GCHQ on [REDACTED]
SECRET
SECRET
- TTT ?? Tech Tracking and Trends – Requests for tech tracking or trends data
- BP ?? Requests BEARDED PIGGY accounts
- The DS Admin notifies the TL of the task and updates it changing the POC to the TL's sid and adding a note to the 'Updates' field in the following format:
'Passed to <TL's sid> on <dd/mm/yy> by <DS Admin's sid>'
- DS Admin then sends an email to the task originator notifying them which TL is handling the task.
- If the task is inappropriate for Crypt Ops or is one that there will be no resources available for in the foreseeable future then the TL changes the Task Status to 'Rejected' and notifies the task originator explaining why the task has been rejected. The task's Record Status is then set to 'Archive'.
- If it is an appropriate achievable task the TL takes the following steps:
- Determine what priority the task should be
- Decide if the timescale is achievable given the available resources and personnel
- Decide if the necessary resources are available
- If an appropriate person is available assign them
7a. If resources are not currently available but the task is one that Crypt Ops will definitely complete some time in the near future when resources are available the TL should contact the tasks originator and inform them of when, realistically, resources will be available and work started.
7b. If they still wish the task to be undertaken then a new timescale should be negotiated.
7c. The Task Status should then be set to 'Suspended' and the Record Status is left as 'Draft'.
- These tasks will be checked as part of the Data Store review to ensure that work starts on them as soon as resources become available.
- Once this is done the tasks Record Status is set to 'Current', the Task Status is set to 'Assigned' and the update field should be filled in as follows:
- Work to be carried out by <assignees sid> starting on <dd/mm/yy> assigned by <TL's sid>
2 of 4
This information is exempt from disclosure under the Freedom of Information Act 2000 and may be subject to exemption under other UK information legislation. Refer disclosure requests to GCHQ on [REDACTED]
SECRET
SECRET
- The TL then informs the task originator of the update.
- Once the assignee begins work the Task Status should be set to 'In Progress'.
- The DS Admin's review all task weekly to ensure they are being acted on and that all timescales and on schedule. If a timescale is deemed unrealistic then the TL should be informed and should negotiate a new deadline with the task originator.
- Once a task is completed the Task Status should be set to 'Complete' and the Record Status changed to 'Archive'.
- The task originator should be informed that the task is officially complete and where possible feed back obtained.
- IMPORTANT: Remember to keep both the 'Record Status' and 'Task Status' fields up to date and make sure that the record is in the correct category. The NEW TASK status should only be used on new tasks still in DRAFT, once
ASSIGNED the task should be moved immediately to CURRENT, once work is started the task status should be IN PROGRESS and once COMPLETE it should be moved to ARCHIVE.
Searching DataStore (Only applicable to those with view privileges)
There are two search options at the top of the page; Text Search and Date Search.
Text Search - this allows searching on a number of fields (listed below) both in the page and within the records themselves. This search type is useful for finding all the tasks owned by a specific individual or all the tasks of a specific type (providing the category tag has been applied to the 'Task Title'.
Task Title
Team Requesting
Task Status
Crypt Task POC
Originator
Task Classification
JIC Points
JIC Priority
Miranda
HRA Justification
Expected Outcome
Business Case
Estimated Resources
Updates
Team Plan Ref
3 of 4
This information is exempt from disclosure under the Freedom of Information Act 2000 and may be subject to exemption under other UK information legislation. Refer disclosure requests to GCHQ on [REDACTED]
SECRET
SECRET
Date Search - there are three sub categories of this search; 'No date search' (which searches for record with no date set in the chosen field), 'Search for a single date', or 'Search over a date range'. These searches can be conducted on several fields; 'Required by Date', 'Date Submitted', 'Date last updated' and 'Date Task Completed'. This search is useful for finding all the tasks that need to be completed by a specific date.
The search types can be used in concert e.g. tasks with SIG in the title with a required by date between 01/05/2011 and 06/10/2011, this is achieved by running one search and then the other.
4 of 4
This information is exempt from disclosure under the Freedom of Information Act 2000 and may be subject to exemption under other UK information legislation. Refer disclosure requests to GCHQ on [REDACTED]
SECRET
Published in the Same Report
(10 of 43 documents)
-
BULLRUN CoI - Briefing Sheet [pdf]
A GCHQ briefing sheet introducing the BULLRUN Community of Interest — the access control framework protecting Five Eyes capabilities to defeat encryption across TLS/SSL, HTTPS, SSH, VPNs, IPSec, encrypted chat and encrypted VoIP — covering the classification structure, handling procedures and protective marking guidance for intelligence derived from cryptanalytic exploitation.
“N.S.A. Able to Foil Basic Safeguards of Privacy on Web” - The New York Times ↗ (2013-09-05) · “Revealed: The NSA's Secret Campaign to Crack, Undermine Internet Security” - ProPublica ↗ (2013-09-05) · “Prying Eyes: Inside the NSA's War on Internet Security” - Der Spiegel ↗ (2014-12-28) · Perlroth, Nicole · Larson, Jeff · Shane, Scott · Appelbaum, Jacob · Gibson, Aaron · Grothoff, Christian · Müller-Maguhn, Andy · Poitras, Laura · Sontheimer, Michael · Stöcker, Christian -
CLASSIFICATION GUIDE FOR CRYPTANALYSIS, 2-12 [pdf]
An NSA/CSS classification guide for cryptanalysis establishing the precise classification level for each type of information about NSA's capabilities to exploit commercial and indigenous encryption systems — from the unclassified acknowledgement that NSA exploits cryptographic devices, through to the Top Secret protection of cryptographic modifications made to commercial products to render them exploitable and industry relationships used to obtain cryptographic details.
“Revealed: how US and UK spy agencies defeat internet privacy and security” - The Guardian ↗ (2013-09-05) · “Prying Eyes: Inside the NSA's War on Internet Security” - Der Spiegel ↗ (2014-12-28) · Ball, James · Borger, Julian · Greenwald, Glenn · Appelbaum, Jacob · Gibson, Aaron · Grothoff, Christian · Müller-Maguhn, Andy · Poitras, Laura · Sontheimer, Michael · Stöcker, Christian -
Innov8 Experiment Profile Template [pdf]
A TOP SECRET STRAP1 joint NSA/GCHQ experiment profile documenting a 2010-2011 Joint Capability Experiment to test hardware-accelerated bulk decryption of common internet encryption technologies at scale, integrating TURMOIL's passive collection with NSA's LONGHAUL key recovery service via the ISLANDTRANSPORT messaging system, as part of the broader BULLRUN assault on internet encryption.
“Prying Eyes: Inside the NSA's War on Internet Security” - Der Spiegel ↗ (2014-12-28) · “Revealed: how US and UK spy agencies defeat internet privacy and security” - The Guardian ↗ (2013-09-05) · Appelbaum, Jacob · Gibson, Aaron · Grothoff, Christian · Müller-Maguhn, Andy · Poitras, Laura · Sontheimer, Michael · Stöcker, Christian · Ball, James · Borger, Julian · Greenwald, Glenn -
TLS Trends: A roundtable discussion on current usage and future directions [pdf]
A presentation by Canada's Communications Security Establishment describing their TLS trend analysis programme, which systematically tracked SSL/TLS encryption parameters across warranted collection and Special Source access to identify cryptanalytic opportunities, monitor target behaviour and collaborate with GCHQ on exploiting weaknesses in widely-used encryption implementations.
-
Secure Sockets Layer (SSL) / Transport Layer Security (TLS) [pdf]
A classified NSA Network Security Products training presentation providing a comprehensive technical overview of SSL/TLS protocol mechanics and NSA's exploitation approaches, including observed usage statistics from intercepted traffic, RSA key exchange decryption methodology, exploitation of the Debian OpenSSL RNG weakness, and the practical challenges of decrypting millions of SSL sessions per day at scale.
Programs: SCARLETFEVER -
TLS trends at GCHQ [pdf]
A GCHQ presentation describing their TLS trends analysis programme, which processed approximately 10 billion SSL/TLS Server Hello events per week from Special Source cable tapping and COMSAT collection to produce weekly trend reports, alongside two operational tools — TargeTLS for matching TLS events against BROAD OAK target profiles, and FLYING PIG, a TLS knowledge base enabling analysts to query certificate, IP and client data across the full intercept base.
-
TURMOIL/APEX/APEX High Level Description Document [pdf]
NSA WikiInfo page providing the high-level design description of APEX — the Active-Passive Integration capability integrating HAMMERMILL router implants with TURMOIL passive collection — enabling real-time exfiltration of targeted VPN (HAMMERSTEIN) and VoIP (HAMMERCHANT) traffic from compromised routers directly into NSA's passive collection and cryptanalytic attack infrastructure, with TURBINE providing automated command and control of the combined active-passive system.
Programs: TURMOIL · APEX · HAMMERMILL · HAMMERCHANT · HAMMERSTEIN · FASHIONCLEFT · TURBINE · TOYGRIPPE · METROTUBE · CHIMNEYPOOL · PIQBLADE · KEYCARD · FASCIA · ISLANDTRANSPORT · PRESSUREWAVE · ASDF · CONVEYANCE · TURBULENCE -
GALLANTWAVE [pdf]
NSA presentation describing GALLANTWAVE — a LONGHAUL capability for VPN decryption — specifically its scaling architecture to handle increased collection volumes and a peering mechanism allowing partner agencies to share single-sided VPN key exchange events so that LONGHAUL can complete decryption attempts that would otherwise fail due to one-sided collection.
-
Intro to the VPN Exploitation Process [pdf]
NSA introduction to the VPN exploitation process from September 2010, presented by the OTP VPN Exploitation Team, covering the full workflow from initial collection through to sustained decryption of IPSec, PPTP, SSL and SSH traffic, with named exploitation successes including airlines, diplomatic missions, banks and intelligence services across Iran, Jordan, Russia, Turkey, Pakistan, Afghanistan, Somalia, Indonesia and Mexico.
Programs: BLEAKINQUIRY · TOYGRIPPE · XKEYSCORE · MAILORDER · CORALREEF · VULCANDEATHGRIP · SCISSORS · TURTLEPOWER · PINWALE · FOURSCORE · CADENCE · UTT · VULCANMINDMELD · CAPRIOS · AGILITY · NKB · FOLLOWTHEMONEY -
Analytic Challenges from Active-Passive Integration [pdf]
This NSA briefing addresses the technical and administrative friction caused by "shaping" operations. Shaping occurs when an active malware implant, typically situated on network infrastructure like a router, copies specific data streams and redirects them past a passive surveillance sensor such as TURMOIL. While this ensures the capture of data that might otherwise be missed, it creates a "double metadata" conflict where a single piece of intelligence carries two competing sets of identifiers: one from the active Tailored Access Operations (TAO) implant and another from the passive collection site. The document tasks analysts with finding a way to reconcile these source notations to ensure the data remains searchable and legally compliant within legacy databases.
Programs: BRAVENICKEL · HAMMERMILL · APEX · TURMOIL · HAMMERSTONE · PRESSUREWAVE · METROTUBE · TOYGRIPPE · TURBULENCE · METAWAVE · MARINA · SSO · CONVEYANCE · NUCLEON · FASCIA · HAMMERCHANT
Related Documents
-
Crypt Discovery Joint Collaboration Activity 20 January 2011 [pdf]
A TOP SECRET NSA/GCHQ joint collaboration activity plan from January 2011 describing a research programme to understand and mitigate the threat that rising encryption adoption poses to target discovery and development — measuring encryption prevalence across SIGINT collection, assessing the impact on metadata-based targeting tradecraft, and developing new techniques for identifying targets behind encrypted traffic using a joint cloud environment fed by MUTANT BROTH, BEARDED PIGGY, KARMA POLICE, MEMORY HOLE, MARBLED GECKO, SOCIAL ANIMAL and ASDF metadata.
Marking: TOP SECRETPrograms: TICKETWINDOW · MUTANTBROTH · BEARDEDPIGGY · KARMAPOLICE · MEMORYHOLE · MARBLEDGECKO · SOCIALANIMAL · XKEYSCORE · ASDF“Prying Eyes: Inside the NSA's War on Internet Security” - Der Spiegel ↗ (2014-12-28) · “Profiled: From Radio to Porn, British Spies Track Web Users' Online Identities” - The Intercept ↗ (2015-09-25) · Appelbaum, Jacob · Gibson, Aaron · Grothoff, Christian · Müller-Maguhn, Andy · Poitras, Laura · Sontheimer, Michael · Stöcker, Christian · Gallagher, Ryan -
BULLRUN [pdf]
A GCHQ TOP SECRET STRAP1 briefing presentation on BULLRUN — summarising the programme's purpose, the network security technologies it targets, the sensitivities surrounding cryptanalytic capabilities, and the access control framework protecting both technical details and the "fact of" capability — notable for explicitly naming three ECIs protecting the technical underpinnings: PICARESQUE, PAWLEYS and AMBULANT.
-
Intro to the VPN Exploitation Process [pdf]
NSA introduction to the VPN exploitation process from September 2010, presented by the OTP VPN Exploitation Team, covering the full workflow from initial collection through to sustained decryption of IPSec, PPTP, SSL and SSH traffic, with named exploitation successes including airlines, diplomatic missions, banks and intelligence services across Iran, Jordan, Russia, Turkey, Pakistan, Afghanistan, Somalia, Indonesia and Mexico.
Programs: BLEAKINQUIRY · TOYGRIPPE · XKEYSCORE · MAILORDER · CORALREEF · VULCANDEATHGRIP · SCISSORS · TURTLEPOWER · PINWALE · FOURSCORE · CADENCE · UTT · VULCANMINDMELD · CAPRIOS · AGILITY · NKB · FOLLOWTHEMONEY -
VALIANTSURF [pdf]
An NSA WikiInfo page for VALIANTSURF — the coverterm for NSA's IPSec VPN decryption capability within the TURMOIL collection platform — describing the four data flow types for intercepting and breaking encrypted VPN traffic, the full deployment roster across collection sites including Menwith Hill, SMOKYSINK, MUSCULAR, CROSSCUT and others, and the architectural taxonomy of the VALIANTSURF programme including its MALIBU and WAIMEA processing architectures and their relationship to LONGHAUL, POISONNUT and GALLANTWAVE.
Programs: VALIANTSURF · TURMOIL · TURBULENCE · HOOKED · HOOKEDHAND · CINDER · CINDERASH · CINDERTRACK · SCARLETFEVER · LONGHAUL · FALLOUT · TOYGRIPPE · PICARESQUE · XKEYSCORE · PRESSUREWAVE · ASDF · MAILORDER · TUBE · KEYCARD · POISONNUT · ISLANDHIDEAWAY · ISLANDTRANSPORT · EXOPUMP · CORALREEF · PINWALE · TUSCARORA · ONEROOF · CONVEYANCE · TURTLEPOWER · WDM · CADENCE · UTT · SCISSORS · FISHWAY · BTUBE · DNCA · ROMULANALE · GALLANTWAVE · ROMULANGAWK · ROMULANGOWL · MALIBU · WAIMEA · WAIMEAVISAGE · ROMULANVISAGE · WAIMEAVISE · ROMULANVISE · APEX · METROTUBE · MADFORGE · JSORCERER · CROSSCUT · CIET · LATTICE · STARQUAKE · SARATOGA · MUSCULAR · SMOKYSINK · SLACKKEY · TUMMS · PURGE · SURGE · NUCLEON · SPAGIC · PPF · SOAP · TUMULT · FIP · PIQBLADE · DEEPDIVE · IBRIDGE -
BULLRUN CoI - Briefing Sheet [pdf]
A GCHQ briefing sheet introducing the BULLRUN Community of Interest — the access control framework protecting Five Eyes capabilities to defeat encryption across TLS/SSL, HTTPS, SSH, VPNs, IPSec, encrypted chat and encrypted VoIP — covering the classification structure, handling procedures and protective marking guidance for intelligence derived from cryptanalytic exploitation.
“N.S.A. Able to Foil Basic Safeguards of Privacy on Web” - The New York Times ↗ (2013-09-05) · “Revealed: The NSA's Secret Campaign to Crack, Undermine Internet Security” - ProPublica ↗ (2013-09-05) · “Prying Eyes: Inside the NSA's War on Internet Security” - Der Spiegel ↗ (2014-12-28) · Perlroth, Nicole · Larson, Jeff · Shane, Scott · Appelbaum, Jacob · Gibson, Aaron · Grothoff, Christian · Müller-Maguhn, Andy · Poitras, Laura · Sontheimer, Michael · Stöcker, Christian