SSO Collection Optimization

Open PDF
Creating agency: NSA National Security Agency (US)
Document date: -
Pages: 7
Genre: slides
Banner:
Classification: TOP SECRET SI
Dissemination: NOFORN
Part of an assembly: SSO Collection Optimization

This is another presentation on problems with the National Security Agency's overcollection of address books and buddy lists and its efforts to weed out useless content. See also EFF_-_20131104-wapo-optimization_google

Long Description:
No extended description available.
Programs:
MARINA, MAINWAY, PINWALE, CLOUD, SCISSORS, MUSCULAR, DANCINGOASIS, SPINNERET, MOONLIGHTPATH, SSO, XKEYSCORE, CLOUDS

People mentioned:
-

Countries:
-

Tags:
SSO, SSO Collection Optimization, address books, buddy lists, metadata, overcollection, data reduction, collection optimization, Yahoo, Hotmail, Gmail, Facebook, Microsoft, Google, JPMQ, DGOT, DGOD, SPNN, EGLP, QMPJ, TOGD, DOGD, NNPS, PLGE, Site Codes, AUC-393, AUC-395, CAC-98CG, DS-200A, DS-200B, DS-200X, DS-300, DS-410, DS-800, NZC-333, UKC-125, UKC-206D, UKC-215, UKC-302A, UKJ-260D, US-3101M, US-3105, US-3145, data storage, repetitive data, SSO Major Accesses, traffic analysis, emergency detasks, internal wiki, emails, webmail, fingerprints

Identifier:
EFF_-_20131014-wapo-content_acquisition_optimization1
Also known as:
nsa-scissors-2
nsa-sso-slides

PDF SHA-256:
5a284ca9984f135405402d22c9730f0c1a5e6a90330a940d2f28f08f125737ea

TOP SECRET//SI//NOFORN

SPECIAL SOURCE OPERATIONS

Special Source Operations

SSO Collection Optimization

Core SSO Team:
[REDACTED]
[REDACTED]

TOP SECRET//SI//NOFORN


TOP SECRET//SI//NOFORN

SPECIAL SOURCE OPERATIONS

Address Books

  • Email address books for most major webmail are collected as stand-alone sessions (no content present*)
  • Address books are repetitive, large, and metadata-rich
  • Data is stored multiple times (MARINA/MAINWAY, PINWALE, CLOUDS)
  • Fewer and fewer address books attributable to users, targets
  • Address books account for ~ 22% of SSO's major accesses (up from ~ 12% in August)
Access (10 Jan 12) Total Sessions Address Books
US-3171 1488453 237067 (16% of traffic)
DS-200B 938378 311113 (33% of traffic)
US-3261 94132 2477 (3% of traffic)
US-3145 177663 29336 (16% of traffic)
US-3180 269794 40409 (15% of traffic)
US-3180 (16 Dec 11) 289318 91964 (32% of traffic)
TOTAL 3257738 712366 (22% of traffic)
Provider Collected Attributed Attributed%
Yahoo 444743 11009 2.48%
Hotmail 105068 1115 1.06%
Gmail 33697 2350 6.97%
Facebook 82857 79437 95.87%
Other 22881 1175 5.14%
TOTAL 689246 95086 13.80%

TOP SECRET//SI//NOFORN


TOP SECRET//SI//NOFORN

SPECIAL SOURCE OPERATIONS

Address Books

  • Enabled in SCISSORS for various SSO sites:
    • JPMQ (metadata: QMPJ) - DS-200B (MUSCULAR) 29 Feb 2012
    • DGOT (metadata: TOGD) - US-3171 (DANCINGOASIS) 13 Mar 2012
    • DGOD (metadata: DOGD) - US-3171 (DANCINGOASIS) 13 Mar 2012
    • SPNN (metadata: NNPS) - US-3180 (SPINNERET) 03 May 2012
    • EGLP (metadata: PLGE) - US-3145 (MOONLIGHTPATH) 08 May 2012

TOP SECRET//SI//NOFORN


TOP SECRET//SI//NOFORN

SPECIAL SOURCE OPERATIONS

Address Books

(S//SI) Ownerless Address Books Blocked by SCISSORS (MB)

140,000
120,000
100,000
80,000
60,000
40,000
20,000
0
3/1/2012
3/6/2012
3/11/2012
3/16/2012
3/22/2012
3/27/2012
4/1/2012
4/6/2012
4/11/2012
4/16/2012
4/21/2012
4/26/2012
5/1/2012
5/6/2012
5/11/2012
5/16/2012
5/21/2012
5/26/2012
5/31/2012
6/5/2012
6/10/2012
6/15/2012
6/20/2012
6/25/2012
6/30/2012
7/5/2012
7/10/2012
7/15/2012
7/20/2012
7/25/2012
7/30/2012

Total

TOP SECRET//SI//NOFORN


TOP SECRET//SI//NOFORN

SPECIAL SOURCE OPERATIONS

Address Books

40000
35000
30000
25000
20000
15000
10000
5000
0
AUC-393
AUC-395
CAC-98CG
DS-200A
DS-200B
DS-200X
DS-300
DS-410
DS-800
NZC-333
UKC-125
UKC-206D
UKC-215
UKC-302A
UKJ-260D
US-3101M
US-3105
US-3145
7/1/2012
7/2/2012
7/3/2012
7/4/2012
7/5/2012
7/6/2012
7/7/2012
7/8/2012
7/9/2012
7/10/2012
7/11/2012
7/12/2012
7/13/2012
7/14/2012
7/15/2012
7/16/2012
7/17/2012
7/18/2012
7/19/2012
7/20/2012
7/21/2012
7/22/2012
7/23/2012
7/24/2012
7/25/2012
7/26/2012
7/27/2012
7/28/2012
7/29/2012
7/30/2012
7/31/2012
8/1/2012
8/2/2012
8/3/2012
8/4/2012
8/5/2012
8/6/2012
8/7/2012
8/8/2012
(blank)

TOP SECRET//SI//NOFORN


TOP SECRET//SI//NOFORN

SPECIAL SOURCE OPERATIONS

Selector Detasks

Emergency Detasks

140
120
100
80
60
40
20
0
Nov-11 Dec-11 Jan-12 Feb-12 Mar-12 Apr-12 May-12

TOP SECRET//SI//NOFORN


TOP SECRET//SI//NOFORN

SPECIAL SOURCE OPERATIONS

So What?

  • Store less of the wrong data
    • 20% reduction (so far) in content to long-term repositories
    • Data still resides at site for SIGDEV
  • Increase data variety
    • Hole left by "wrong data" filled with more "right data"
    • More signals and case notations can be tasked at site
  • Shifting collection philosophy at NSA
    • "Memorialize what you need” versus “Order one of everything off the menu and eat what you want"

WIKI: https://wiki.nsa.ic.gov/wiki/Collection_Optimization
XKEYSCORE: fingerprint/defeats/atrouter and fingerprint/defeats/atxks

TOP SECRET//SI//NOFORN