Bulk collection of webmail address books and emerging protocols

Open PDF
Creating agency: NSA National Security Agency (US)
Document date: -
Pages: 3
Genre: slides
Banner:
Classification: TOP SECRET SI
Dissemination: NOFORN

TOP SECRET NSA document details the large-scale collection of email address books and contact lists from major webmail and social media providers, emphasizing their metadata value despite low attribution rates to known targets. It also highlights ongoing efforts to identify and analyze emerging communication protocols, such as those used by Hotmail Messenger.

Long Description:
This is a TOP SECRET//SI//NOFORN NSA Special Source Operations presentation excerpt covering two topics: bulk address book collection statistics across major webmail providers, and two "serendipity" protocol examples showing data from a new protocol and HTTP session data. The address book section documents SSO's bulk collection of email address books from major webmail providers as of January 2012. Address books are described as collected as stand-alone sessions containing no content — meaning they are pure metadata — but are described as "repetitive, large, and metadata-rich" and stored redundantly across MARINA, MAINWAY, PINWALE and CLOUDS. The document notes a significant trend: address books had grown from approximately 12% of SSO's major accesses in August 2011 to 22% by January 2012, representing an increasing proportion of bulk collection volume. Five SIGADs are listed with session counts and address book volumes. US-3171 generated 1,488,453 total sessions with 237,067 address books representing 16% of traffic. DS-200B — MUSCULAR, the joint NSA/GCHQ programme tapping the private fibre links between Google's and Yahoo's data centres outside the US, as The Washington Post reported — generated 938,378 sessions with 311,113 address books representing 33% of traffic, the highest address book proportion of any SIGAD. US-3261 generated 94,132 sessions with only 2,477 address books, a low 3% rate. US-3145 generated 177,663 sessions with 29,336 address books at 16%. US-3180 generated 269,794 sessions with 40,409 address books at 15%. The attribution table reveals a striking asymmetry across providers. Of 689,246 total address book sessions collected across all five SIGADs, only 95,086 — 13.8% — could be attributed to known users or targets. Facebook showed by far the highest attribution rate at 95.87%, reflecting Facebook's strong identity binding between accounts and real identities. Hotmail showed the lowest attribution at 1.06% — 98.94% of the Hotmail address books collected could not be attributed to known users or targets. Yahoo was 2.48% attributed, Gmail 6.97%. In all, 86.2% of the 689,246 address books in the attribution table could not be attributed to known users or targets. The serendipity section illustrates a separate concept — the incidental collection of unexpected protocol data during bulk internet collection. The first example shows binary data from what appears to be an encrypted authentication exchange including a security question ("What was your first phone number") from a Hotmail account, captured as a byproduct of collection. The second example shows a raw HTTP session from Windows Live Messenger (MSN) gateway traffic — a POST request to baymsg1030124.gateway.messenger.live.com with session polling parameters, user agent, cookie data and MSN authentication headers — demonstrating that bulk collection was capturing instant messenger session traffic in addition to email. The term "serendipity" in this context refers to the discovery of previously unrecognised collection opportunities — new protocol types or data formats found unexpectedly within existing bulk collection streams that could be exploited for additional intelligence value. The document demonstrates that the overwhelming majority of bulk address book collection — about 594,000 of the 689,246 address books in the attribution table — came from people with no established intelligence connection, collected solely because their email address appeared in a target's or non-target's contact list. It also shows NSA actively mining bulk collection for previously unidentified protocol types.
Programs:
MARINA, MAINWAY, PINWALE, CLOUDs, Serendipity, MUSCULAR, SSO

People mentioned:
-

Countries:
-

Tags:
Yahoo, Hotmail, Gmail, Facebook, address books, metadata, attribution, bulk collection, serendipity, Windows Live Messenger, MSN, HTTP, SIGAD, content acquisition, incidental collection, webmail, email addresses, emails, contact book, contact lists, social media, SSO, targeting

Identifier:
EFF_-_20131126-wapo-microsoft_cloud_exploitation
Also known as:
ACLU_-_address-book-wapo
nsa-microsoft-cloud-exploit

PDF SHA-256:
508b01ff2f5230c6ad2389e87d99548b5edfcce976ce390d824a3a6819528b6e

TOP SECRET//SI//NOFORN

Address Books

  • Email address books for most major webmail are collected as stand-alone sessions (no content present*)
  • Address books are repetitive, large, and metadata-rich
  • Data is stored multiple times (MARINA/MAINWAY, PINWALE, CLOUDS)
  • Fewer and fewer address books attributable to users, targets
  • Address books account for ~ 22% of SSO's major accesses (up from ~ 12% in August)
Access (10 Jan 12) Total Sessions Address Books
US-3171 1488453 237067 (16% of traffic)
DS-200B 938378 311113 (33% of traffic)
US-3261 94132 2477 (3% of traffic)
US-3145 177663 29336 (16% of traffic)
US-3180 269794 40409 (15% of traffic)
US-3180 (16 Dec 11) 289318 91964 (32% of traffic)
TOTAL 3257738 712366 (22% of traffic)
Provider Collected Attributed Attributed%
Yahoo 444743 11009 2.48%
Hotmail 105068 1115 1.06%
Gmail 33697 2350 6.97%
Facebook 82857 79437 95.87%
Other 22881 1175 5.14%
TOTAL 689246 95086 13.80%

TOP SECRET//SI//NOFORN


TOP SECRET//SI//NOFORN

Serendipity – New Protocols

(. .œ.......õ...
].0.‚.. [REDACTED]@hotmMJðî0. What was your first phone numberÚ..[REDACTED]ú..

].Êú’¼.˜..„.. ..ˆ.. ..–ÿ’¼...6 .à‰ÖÁ...K .¼ËÄ...  .ϬæÅ...7˜.βÄÍ...ž. .¼ð¸Õ.
X.. .ÍÍÃý...«!-.¼âþ  .ðB" ..Ó.Ø..â..[REDACTED]ê..BDò..ø.žãåÔ°%Ô.АÍîß°¢èîö§â¢ð.
!..X@÷áی۝±.HÀÉö™©Í¢...

TOP SECRET//SI//NOFORN


TOP SECRET//SI//NOFORN

Serendipity – HTTP Demux

**eoc2c

GUOX1HdS/4k8YWAcliiPGd/Nvri0vYalboluzcaFdZcyfpHeg9rFTIytsjXoUyZnngI417JMAJHZ9M9ZXYwZU9qxvBWOLKZGBYlsvC43iUBvCrf4elcP2Pxs35+L
Cache-Control: no-cache

POST /gateway/gateway.dll?Action=poll&Lifespan=60&SessionID=868216649.1709645966 HTTP/1.1
Host: baymsg1030124.gateway.messenger.live.com
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:14.0) Gecko/20100101 Firefox/14.0.1
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,\*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip, deflate
Connection: keep-alive
X-Requested-Session-Content-Type: text/html
Content-Type: text/html; charset=utf-8
Pragma: No-Cache, no-cache
X-MSN-Auth: Use-Cookie
Referer: http://baymsg1030124.gateway.messenger.live.com/xmlProxy.htm?vn=9.090515.0&domain=live.com
Content-Length: 0
Cookie: wlidperf-latency=14338&throughput=0; mkt0=en-AF; wla42=cHJveHktYmF5LnB2dC1jb250YWN0cy5tc24uY29tfGJ5MS0xLDgzMTYzNjI1N
Cache-Control: no-cache

NENE

**eotxt

POST in middle of session

TOP SECRET//SI//NOFORN