SSO Collection Optimization
Open PDFDocument date: -
Pages: 7
Genre: slides
Banner: TOP SECRET//SI//NOFORN
Classification: TOP SECRET SI
Dissemination: NOFORN
This is another presentation on problems with the National Security Agency's overcollection of address books and buddy lists and its efforts to weed out useless content. See also EFF_-_20131104-wapo-optimization_google
My notes
TOP SECRET//SI//NOFORN
SPECIAL SOURCE OPERATIONS
Special Source Operations
SSO Collection Optimization
Core SSO Team:
[REDACTED]
[REDACTED]
TOP SECRET//SI//NOFORN
TOP SECRET//SI//NOFORN
SPECIAL SOURCE OPERATIONS
Address Books
- Email address books for most major webmail are collected as stand-alone sessions (no content present*)
- Address books are repetitive, large, and metadata-rich
- Data is stored multiple times (MARINA/MAINWAY, PINWALE, CLOUDS)
- Fewer and fewer address books attributable to users, targets
- Address books account for ~ 22% of SSO's major accesses (up from ~ 12% in August)
| Access (10 Jan 12) | Total Sessions | Address Books |
|---|---|---|
| US-3171 | 1488453 | 237067 (16% of traffic) |
| DS-200B | 938378 | 311113 (33% of traffic) |
| US-3261 | 94132 | 2477 (3% of traffic) |
| US-3145 | 177663 | 29336 (16% of traffic) |
| US-3180 | 269794 | 40409 (15% of traffic) |
| US-3180 (16 Dec 11) | 289318 | 91964 (32% of traffic) |
| TOTAL | 3257738 | 712366 (22% of traffic) |
| Provider | Collected | Attributed | Attributed% |
|---|---|---|---|
| Yahoo | 444743 | 11009 | 2.48% |
| Hotmail | 105068 | 1115 | 1.06% |
| Gmail | 33697 | 2350 | 6.97% |
| 82857 | 79437 | 95.87% | |
| Other | 22881 | 1175 | 5.14% |
| TOTAL | 689246 | 95086 | 13.80% |
TOP SECRET//SI//NOFORN
TOP SECRET//SI//NOFORN
SPECIAL SOURCE OPERATIONS
Address Books
- Enabled in SCISSORS for various SSO sites:
- JPMQ (metadata: QMPJ) - DS-200B (MUSCULAR) 29 Feb 2012
- DGOT (metadata: TOGD) - US-3171 (DANCINGOASIS) 13 Mar 2012
- DGOD (metadata: DOGD) - US-3171 (DANCINGOASIS) 13 Mar 2012
- SPNN (metadata: NNPS) - US-3180 (SPINNERET) 03 May 2012
- EGLP (metadata: PLGE) - US-3145 (MOONLIGHTPATH) 08 May 2012
TOP SECRET//SI//NOFORN
TOP SECRET//SI//NOFORN
SPECIAL SOURCE OPERATIONS
Address Books
(S//SI) Ownerless Address Books Blocked by SCISSORS (MB)
140,000
120,000
100,000
80,000
60,000
40,000
20,000
0
3/1/2012
3/6/2012
3/11/2012
3/16/2012
3/22/2012
3/27/2012
4/1/2012
4/6/2012
4/11/2012
4/16/2012
4/21/2012
4/26/2012
5/1/2012
5/6/2012
5/11/2012
5/16/2012
5/21/2012
5/26/2012
5/31/2012
6/5/2012
6/10/2012
6/15/2012
6/20/2012
6/25/2012
6/30/2012
7/5/2012
7/10/2012
7/15/2012
7/20/2012
7/25/2012
7/30/2012
Total
TOP SECRET//SI//NOFORN
TOP SECRET//SI//NOFORN
SPECIAL SOURCE OPERATIONS
Address Books
40000
35000
30000
25000
20000
15000
10000
5000
0
AUC-393
AUC-395
CAC-98CG
DS-200A
DS-200B
DS-200X
DS-300
DS-410
DS-800
NZC-333
UKC-125
UKC-206D
UKC-215
UKC-302A
UKJ-260D
US-3101M
US-3105
US-3145
7/1/2012
7/2/2012
7/3/2012
7/4/2012
7/5/2012
7/6/2012
7/7/2012
7/8/2012
7/9/2012
7/10/2012
7/11/2012
7/12/2012
7/13/2012
7/14/2012
7/15/2012
7/16/2012
7/17/2012
7/18/2012
7/19/2012
7/20/2012
7/21/2012
7/22/2012
7/23/2012
7/24/2012
7/25/2012
7/26/2012
7/27/2012
7/28/2012
7/29/2012
7/30/2012
7/31/2012
8/1/2012
8/2/2012
8/3/2012
8/4/2012
8/5/2012
8/6/2012
8/7/2012
8/8/2012
(blank)
TOP SECRET//SI//NOFORN
TOP SECRET//SI//NOFORN
SPECIAL SOURCE OPERATIONS
Selector Detasks
Emergency Detasks
140
120
100
80
60
40
20
0
Nov-11 Dec-11 Jan-12 Feb-12 Mar-12 Apr-12 May-12
TOP SECRET//SI//NOFORN
TOP SECRET//SI//NOFORN
SPECIAL SOURCE OPERATIONS
So What?
- Store less of the wrong data
- 20% reduction (so far) in content to long-term repositories
- Data still resides at site for SIGDEV
- Increase data variety
- Hole left by "wrong data" filled with more "right data"
- More signals and case notations can be tasked at site
- Shifting collection philosophy at NSA
- "Memorialize what you need” versus “Order one of everything off the menu and eat what you want"
WIKI: https://wiki.nsa.ic.gov/wiki/Collection_Optimization
XKEYSCORE: fingerprint/defeats/atrouter and fingerprint/defeats/atxks
TOP SECRET//SI//NOFORN