BOUNDLESSINFORMANT - Describing Mission Capabilities from Metadata Records

Open PDF +2 other copies
Creating agency: NSA National Security Agency (US)
Document date: 2012-07-13
Pages: 8
Genre: slides
Banner:
Classification: TOP SECRET SI
Dissemination: NOFORN

This presentation on the Boundless Informant program (BOUNDLESSINFORMANT), which uses big data tools to analyze and visualize global SIGINT metadata collection in near real time. It explains how the system replaced older manual methods, enabling the NSA to track collection volumes, coverage, and trends for specific countries or sites through cloud-based infrastructure.

Long Description:
No extended description available.
Programs:
BOUNDLESSINFORMANT, JUGGERNAUT, LOPER, GAO, CLOUDBASE, MAPREDUCE

People mentioned:
Patel, Vimesh

Countries:
-

Tags:
GAO, Global Access Operations, metadata collection, big data, cloud computing, HDFS, MapReduce, Cloudbase, intelligence infrastructure, real-time analysis, data visualization, collection capabilities, strategic decision making, tactical operations, data aggregation, site coverage, collection volume, anomaly detection, FORNSAT

Identifier:
EFF_-_20131122-dagbladet-boundless_informant
Also known as:
20131122-dagbladet-boundless_informant
NSA_Boundless_Informant_Powerpoint_Slides
nsa-boundlessinformant-no-33m
ACLU_-_NSA_Boundless_Informant_Powerpoint_Slides
Boundless_Informant
ACLU_-_pdfombound-1
ACLU_-_Boundless_Informant
EFF_-_20130608-guard-boundless_informant_capabilities
EFF_-_20131104-mundo-boundless_informant

PDF SHA-256:
681497e1abb29ebe927fc907f16650c9a0f3207c065cd1f83c896c4ded909fef

TOP SECRET//SI//NOFORN

GAO
Global Access Operations
The mission never sleeps...

BOUNDLESSINFORMANT

Describing Mission Capabilities from Metadata Records

Vimesh Patel
13 July 2012


TOP SECRET//SI//NOFORN

GAO
Global Access Operations
The mission never sleeps...

THE QUESTION

(U//FOUO) How do we describe the collection capabilities and posture of our SIGINT infrastructure?

TOP SECRET//SI//NOFORN
2


TOP SECRET//SI//NOFORN

GAO
Global Access Operations
The mission never sleeps...

THE OLD WAY

(U//FOUO) Typical SIGINT Data Calls/Questions

  1. How many sites do we have in the region? How many records are they producing?
  2. What type of coverage do we have on country X?
  3. What type of collection and volume do we get out of site A? How do these
    types/volumes compare against site B? Against site C?

(U//FOUO) Ways to Get Answers

  1. Map out the physical location of SIGINT assets
  2. Send out a data call based on best guesses for who can answer the question
  3. Review static reports/spreadsheets from previous data calls
  4. Ask a 30-year SIGINTer

TOP SECRET//SI//NOFORN
3


TOP SECRET//SI//NOFORN

GAO
Global Access Operations
The mission never sleeps...

THE NEW WAY BOUNDLESSINFORMANT

(U//FOUO) Use Big Data technology to query SIGINT collection in the cloud to produce near real-time business intelligence describing the agency's available SIGINT infrastructure and coverage.

(U//FOUO) Key Questions

  1. How many records are collected for an organizational unit (e.g. FORNSAT) or country?
  2. Are there any visible trends?
  3. What assets collect against a specific country? What type of collection?
  4. What is the field of view for a specific site? What type of collection?

(U//FOUO) Potential Users

  1. Strategic decision makers (leadership team)
  2. Tactical users (mission and collection managers)

TOP SECRET//SI//NOFORN
5


TOP SECRET//SI//NOFORN

GAO
Global Access Operations
The mission never sleeps...

DETAILS

1) (U//FOUO) Current focus is on SIGINT/COMINT

2) (U//FOUO) Review every valid DNI and DNR metadata record passing through the NSA SIGINT infrastructure
a) (U//FOUO) For the Map View, only display aggregated counts of records with a normalized number or an administrative region populated.
b) (U//FOUO) For the Org View, display aggregated counts of every valid record.

3) (U//FOUO) Raw data, analytics, and back-end database are all conducted in the cloud (HDFS, MapReduce, Cloudbase).

(U//FOUO) BOUNDLESSINFORMANT is hosted entirely on corporate services
and leverages FOSS technology (i.e. available to all NSA developers).

TOP SECRET//SI//NOFORN
6


TOP SECRET//SI//NOFORN

GAO
Global Access Operations
The mission never sleeps...

DEMO

TOP SECRET//SI//NOFORN
7


TOP SECRET//SI//NOFORN

GAO
Global Access Operations
The mission never sleeps...

ROAD MAP

1) (U//FOUO) Add technology type (e.g. JUGGERNAUT, LOPER) to provide additional granularity in the numbers

2) (U//FOUO) Integrate Site Similarity capability (i.e. Gephi Charts)

3) (U//FOUO) Anomaly detection and alerts

4) (U//FOUO) Other "INT” data (e.g. ELINT, FISINT)

5) (U//FOUO) Add survey data and display delta between collected metadata
and survey data

6) (U//FOUO) Add in selected (vs. unselected) data indicators

TOP SECRET//SI//NOFORN
8


OSSIBLE CLASSIFICATION IS TOP SECRET//SI//TK//NOFORN DERIVED FROM: NSA/CSSM 1-52, DATED 08 JAN 2007 DECLASSIFY: ON 20320108
OP SECRET//SI//TK//NOFORN DERIVED FROM: NSA/CSSM 1-52, DATED 08 JAN 2007 DECLASSIFY: ON 20320108
NFORMANT
Map View Org View
Site Specific

Trial Version 26 Days Left
Archive note: The Guardian published this presentation first, on 8 June 2013, but only four slides of it: the title page, THE OLD WAY, THE NEW WAY and DETAILS. El Mundo (4 November 2013) and Dagbladet Information (22 November 2013) each published eight. Dagbladet's is the copy shown here — the best quality, and the only one whose demo screenshot is legible — but its title page lacks the redaction box and the date "13 July 2012" that both other copies show, which is where the document's creation date comes from. El Mundo's copy carries a different, poorer demo screenshot and places it before the ROAD MAP slide rather than after it. No published copy includes the deck's printed page 4: the page numbering runs 2, 3, 5, 6, 7, 8 in all three.