Converged Analysis of Smartphone Devices

Open PDF
Creating agency: NSA National Security Agency (US)
Document date: 2010-05-01
Pages: 14
Genre: slides
Banner:
Classification: TOP SECRET COMINT
Dissemination: REL TO USA, FVEY

This 2010 document outlines NSA methods for identifying, processing, and exploiting data from smartphones by targeting both telephony and digital network intelligence (DNI). It details how analysts use tools like XKEYSCORE and metadata extraction to collect geolocation, app data, call logs, unique identifiers, and user activity from popular mobile apps and services (e.g., Google Maps, Facebook, Flickr), emphasizing the intelligence potential of smartphones as rich surveillance targets.

Long Description:
This provides a comprehensive overview of the agency’s strategy and technical capabilities for exploiting the rapidly growing ecosystem of smartphones. It frames smartphones as “converged mobile devices,” blending telecommunications, computing, and the Internet, and highlights their significance as intelligence targets due to their powerful processors, open operating systems, and the increasing amount of personal data they generate. The document explains how the NSA leverages these devices for identification, processing, and tasking, integrating both telephony and Digital Network Intelligence (DNI) collection. It details how analysts can extract IMEI/IMSI identifiers, call logs, SMS, SIM card information, email addresses, and other unique identifiers, alongside app-level data. Popular apps and services such as Google Maps, Flixster, Flickr, Photobucket, and mobile versions of Facebook are identified as particularly valuable sources, as they often transmit geolocation data and media in the clear. The slides highlight that Android phones pass GPS data unencrypted, and that image files contain EXIF metadata (including device type, location, and timestamps) that can be fingerprinted and queried through XKEYSCORE’s EXIF plugin. The document presents a “Golden Nugget!” scenario where a target uploads a geotagged photo to a social media site—an ideal situation for extracting device, location, and activity data. It also shows how user activity can be profiled through phone settings, networks visited, websites accessed, buddy lists, documents downloaded, and encryption settings, allowing analysts to build a comprehensive behavioral and technical profile of the target. Additionally, the slides discuss tasking systems and tagging challenges, explaining how smartphones enable analysts to geo-locate targets globally and correlate data across both traditional telephony and internet traffic. The emphasis is on the intelligence value smartphones provide for target knowledge, technological profiling, and additional exploitation opportunities, as they act as constant sensors producing rich streams of data. Overall, the document reveals how by 2010, the NSA had developed a sophisticated framework for integrating smartphone data into SIGINT operations, treating mobile devices not just as communication tools but as multipurpose intelligence collection platforms.
Programs:
XKEYSCORE, MARINA

People mentioned:
Kuruc, Paula

Countries:
-

Tags:
smart phones, smartphone surveillance, mobile phones, mobile exploitation, telephony, Digital Network Intelligence, DNI, geolocation, GPS, EXIF, IMEI, IMSI, SIM cards, call logs, SMS interception, app data, Google, Google Maps, Flixster, Flickr, Photobucket, Facebook mobile, Android, Apple, iPhone, geotagging, metadata extraction, target profiling, user activity, network analysis, encryption detection, tasking, telecommunications convergence, mobile apps, BlackBerry, VoIP, WiFi, GPRS, Push2Talk, WinZip, buddy lists, contact lists, contacts, User-Agent, email addresses

Identifier:
EFF_-_20140127-nyt-converged_analysis_on_smartphone_devices
Also known as:
nsa-smartphones-analysis
ACLU_-_Social_Convergence
Social_Convergence

PDF SHA-256:
7c701524e45e276607c407718eabd625160d9cfc8e82b41cd167ad78230e4891

TOP SECRET//COMINT/REL TO USA, FVEY

(U) Converged Analysis of Smartphone Devices

Identification/Processing/Tasking – All in a day's work

[REDACTED]Paula Kuruc, NSA
May 2010

TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Smartphone

Converged mobile devices offering advanced capabilities, often with PC-like functionality. No set industry standard definition.

Boasts powerful processors, memory, larger screens and open operating systems.

2
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Economics of Transportation

  • The gradual "blurring" of telecommunications, computers, and the Internet
  • Multifaceted layering technologies
  • Examples of convergence in SIGINT:
    • Blackberry, iPhone data, Smartphones
    • VOIP
    • Wireless Local Loop
    • GPRS - General Packet Radio Service
BlackBerry
12:21 PM
Sunday, April 25
(3) Messages
Messages SMS Contacts Calendar Browser Media Clock Camera

3
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

SmartPhone Applications

  • Visual Communicator – Free application that combines Instant Messaging, Photo-Messaging and Push2Talk capabilities on a mobile platform. VC used on GPRS or 3G networks; [REDACTED]heavily used in AQI Mosul Network
  • Symbian Operating System supporting encryption programs.
  • WinZip, compression and encryption program.

4
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Usage/Features

  • Social Networking via Flixster Social Networking site allowing users to share movie ratings, discover new movies and meet
    others with similar movie taste.
  • Google Maps features
  • Photo capture and editing capabilities
  • Phone settings
  • Mobile Facebook Apps (iPhone/Android)

6
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Location Based Services

Where is the target?

  • GPRS Dataset – breaking down barriers Providers catering to users based on location
  • Android Phones pass GPS data in the clear
  • No longer DNI/DNR

7
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Taking a Closer Look

Photo Capture Software -

  • iPhone Geotags for Photos
    Raw tags coming through from a variety of devices
  • Flixster App uses GPRS
  • Flickr/Photobucket
  • Mobile Facebook Apps Uploads

8
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Processing

All in the Metadata, not the pretty pictures

  • Unique applications require unique analysis
  • GPS Indicators (sent to the server and towers for both phone and application)
  • VoIP Indicators (multiple services)
  • Type of Phone and Apps

9
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Identification via Xkeyscore

  • Make use of fingerprints in Xkeyscore via the EXIF metadata plugin
  • Fingerprints for images (jpeg, tiff, gifs etc.)
  • Examine the raw XML
  • Provides device and time/location for the image

[REDACTED]

fingerprint('image/exif/gpsCoordinates') =
    file_ext('jpeg' or 'pjpeg' or 'jpg' or 'pjpg' or 'tiff' or 'gif' or 'png' or 'riff' or'wav') and
    'exif:GPSLatitude' or 'exif:GPSLongitude' or 'exif:GPSDestLatitude' or
    'exif:GPSDestLongitude';

10
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Golden Nugget!

Perfect Scenario – Target uploading photo to a social media site taken with a mobile device.

What can we get?

11
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

User Activity Leads

  • Examine settings of phone as well as service providers for geo-location; specific to a certain region
  • Networks connected
  • Websites visited
  • Buddy Lists
  • Documents Downloaded
  • Encryption used and supported
  • User Agents

12
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Targeting

Targeting both Telephony and DNI systems

  • Call Logs
  • SMS
  • SIM Card Leads
  • Email address
  • IMEI/IMSI
  • Unique Identifiers
  • Blackberry PINS
BlackBerry Weather
BlackBerry facebook

13
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Why do we care?

  • Additional exploitation
  • Target Knowledge/Leads
  • Location
  • Target Technology
  • Denote Media used
SonyEricsson
Safaricom
M-PESA
Send money
Withdraw cash
Buy airtime
Pay Bill
Buy Goods
Select Cancel

14
TOP SECRET//COMINT/REL TO USA, FVEY


TOP SECRET//COMINT/REL TO USA, FVEY

Conclusion

  • Challenge is how to tag data for analysts
  • We can geo phones from virtually anywhere
  • Buried GeoStamp from Phone or Apps
  • Xkeyscore/Marina
  • Tasking systems
LEAVE TRAFFIC HERE

15
TOP SECRET//COMINT/REL TO USA, FVEY