Email Address vs User Activity

Open PDF +1 other copy
Creating agency: NSA National Security Agency (US)
Document date: 2009-06-24
Pages: 20
Genre: slides
Banner:
Classification: TOP SECRET COMINT
Dissemination: REL TO USA, AUS, CAN, GBR, NZL

This 2009 NSA training presentation explains how to use the XKEYSCORE system to search raw SIGINT, detailing the differences between the "Email Address" query, which finds email addresses in full content, and the more flexible "User Activity" query, which can search for selectors like cookies, usernames, and phone numbers.

Long Description:
This NSA document is an analyst training guide on how to use the XKEYSCORE surveillance system to query for information related to specific selectors. The presentation focuses on the distinction between two main query types: the "Email Address" query and the "User Activity" query. The Email Address query allows an analyst to search for full email addresses within the body of emails, documents, and webpages, but the guide warns that it can be imprecise, as it simply looks for strings containing the "@" symbol. The "User Activity" query is presented as a more flexible and powerful option, as it is based on APPROC (application processing) collection and allows searching for a wider range of selectors beyond just email addresses. These include cookies, usernames for web forums, VoIP selectors, and phone numbers. The guide provides a detailed scenario on how an analyst can pivot from a single cookie, use both XKEYSCORE User Activity queries and queries in the MARINA metadata database, and successfully identify all user accounts that have been active on a specific computer.
Programs:
XKEYSCORE, MARINA, ASDF

People mentioned:
-

Countries:
Malaysia, Iran, Azerbaijan, Bahrain, Bangladesh, Austria, Belarus

Tags:
training, analyst guide, email addresses, raw traffic, AppProc, selectors, target development, cookies, IP addresses, usernames, phone numbers, VoIP, webmail, chat, browsing history, full content analysis, metadata, strong selectors, Huawei

Identifier:
email-address-vs-user-activity

PDF SHA-256:
be66657a58fd4206c22bb0b16047a231357f6f020a177f8969b4d46bf3e640c8

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123

XKEYSCORE

Email Address vs User Activity

24 June 2009

Derived From: NSA/CSSM 1-52
Dated: 20070108
Declassify On: 20291123
DERIVED FROM: NSA/CSSM 1-52
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123
08


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Email Addresses

  • The Email Address search allows you to search on:
    • Full Email Address
      • Do not search on/wildcard JUST the username, always include a specific domain
    • Foreign-hosted domains (e.g. @cnc.cn)
  • The query searches within bodies of emails, webpages and documents for.... (you guessed it)...Email Addresses
    • To, From, CC, BCC lines..
    • "Contact Us" pages on websites
    • Signature blocks

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Email Address

  • Email Addresses are found in many parts of traffic
DNI Display Raw Data DNI Format
Subject:     RE: Malaysia Tax
From:        [REDACTED]
To:          [REDACTED]
Cc:          [REDACTED]
Date:        Tue Jun 23 12:41:25 GMT 2009
Attachments: 01.jpg (12013 bytes);

XKEYSCORE has picked up traffic with email addresses in it..

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Email Address

DNI Display Raw Data DNI Format
Subject:     RE: Malaysia Tax
From:        [REDACTED]
To:          [REDACTED]
Cc:          [REDACTED]
Date:        Tue Jun 23 12:41:25 GMT 2009
Attachments: image001.jpg (12013 bytes);

X-KEYSCORE C2C Session Viewer

Session 9 of 18
Datetime Case Notation From IP To IP From Port To Port Protoco Len

| 2009-06-23 12:41:28 | PRPA07550000000 | 198.[REDACTED] (United States) | 219.[REDACTED] (Malaysia) | 39247 | 25 | tcp | 486

Session | Header (3) | Attachments (5) | Meta (10)
attribute_info.txt email_addresses.txt tech.html application_id.xml appproc.asdf xks_snippet.txt phone_number.html fingerprints.xml user_activity.xml ip_lc_trie.txt

email_addresses.txt
Formatter AUTO

Using TXT formatter
[REDACTED]
[REDACTED]
[REDACTED]
[REDACTED]

XKEYSCORE parses out everything it 'thinks' is an email address, so don't be fooled by mis-hits

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Creating Email Address Queries

  • Enter usernames and domains into query
Search: Email Addresses

* Query Name: [REDACTED]
* Justification: aqi in iran sample
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Day Start: 2009-06-23 00:00 Stop: 2
* Email Username: badguy or baddude1 or badguysemail
* @Domain: yahoo.com
* Subject: [REDACTED]

Mulitiple usernames from SAME domain can be OR'd

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Creating Email Address Queries

  • BE VERY CAREFUL of OR'ing domains
Search: Email Addresses

* Query Name: [REDACTED]
* Justification: aqi in iran sample
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Day Start: 2009-06-23 00:00 Stop: 2009
* Email Username: badguy or baddude1 or badguysemail
* @Domain: yahoo.com or hotmail.com
* Subject: [REDACTED]

When working with multiple domains, create separate Email Address queries for each. i.e. Group your queries by domain names.

Mulitiple domains means either badguy@yahoo.com or badguy@hotmail.com. Are both your targets?

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Email Address

  • Sample Search: baku@huawei.com
Search: Email Addresses

* Query Name: [REDACTED]
* Justification: azerbaijiani huawei bubba
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Week Start: 2009-06-17 00:00 Stop: St
* Email Username: baku
* @Domain: huawei.com

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Email Address

  • Email Addresses are found in many parts of traffic
DNI Display | Raw Data | DNI Format
HTTP Header Information | Content Type: HTTP/HTML

Services

Fax: 0061-2-94118533

Vienna, Austria
Ezone Office Building, 4th Floor/ Top 7, Ernst-Melchior-Gasse 20, 1020 Vienna, Austria
Tel: 

Baku, Azerbaijan
Caspian Plaza Centre, block 610-611, J.Jabbarly St., Baku
Azerbaijan, Az1065
Tel: 0099412-510-5644/5744/5844
Fax: 0099412-510-5944
E-mail: baku@huawei.com

Results here are from someone viewing a website that contained the email address

Building 647, Road 2811Seef District 428 Kingdom of Bahrain
Tel: 00973-17568708
Fax: 00973-17568701

Bahrain, Bahrain
Villa NO.1, Mohamedia Garden, Gate NO.36,Road
No.3431, Block No.334, Bahrain
Tel: 00974-3443296/00973-9580085

Dhaka, Bangladesh
R.M. Centere(2nd Floor),101, gulshan Avenue Gulshan Model
Town Dhaka 1213 Bangladesh

Minsk, Belarus
Korolya str., 51, floor-2, office-28, Minsk, Belarus
Tel: 00375-17-2048903

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

User Activity Query

  • User Activity query is based on APPROC collection (such as chat, webmail, etc)
  • Allows more flexible search criteria than Email Address query
    • Can search on: Cookies, numeric logins (e.g. web forums & OSN), VoIP selectors, webcam first images, Webmail profile information from registration (birthdays), general usernames

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

KEYSCORE

Creating User Activity Queries

  • The fields in a User Activity query can be confusing
Datetime: Custom | Start: 2009-06-23 11:00 | Stop: 20
Search For:
Search Value:
Realm:
Attribute Type:
Attribute Value:
Activity:
Source:
IP Address:

Enter target selectors/identifiers here:
-Phone No
-Cookie
-Username/EMAD (then add REALM)
-

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Creating User Activity Queries

  • The fields in a User Activity query can be confusing
Search For Search Value Attribute Type Attribute Value
username [REDACTED]@yahoo communicants saifdes ziad 197
username [REDACTED]@yahoo contact_list 0920273966 999999 a_salty a_t_love_me aa
username [REDACTED]@yahoo direction server-to-client
username [REDACTED]@yahoo from [REDACTED]
username [REDACTED]@yahoo previous_user [REDACTED]
username [REDACTED]@yahoo raw_metadata [REDACTED]
username [REDACTED]@yahoo to [REDACTED]
username [REDACTED]@yahoo user_realm emailAddr
username [REDACTED]@yahoo yahoo [REDACTED]
username [REDACTED] emailAddr [REDACTED]@yahoo
username [REDACTED]@yahoo app_provider YMSG

Notice partial email addresses in the "Search Value" field..

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Creating User Activity Queries

  • Scenario:
    • You have a target's email address:
      • [REDACTED]@hotmail.com
    • Known: One email address
    • Unknown: Alternate ID's, IPs, Location, Photo, etc... (lots of stuff)
  • Where do we begin?

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

I want to....

  • I have an Email Address and want to see if it's being collected?
    • Do an Email Address query on username and domain
      Email Username: baku
      @Domain: huawei.com
    • Do a User Activity query on the email address in the "Selector Value"
      Search Value: baku@huawei*

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

I want to....

  • I have a Cookie and want to see what other accounts access this computer
    • Do TWO separate User Activity query on the cookies
    • 1. Attribute Value: dg8q0od4u0li4
    • Brings back THESE results...
Search For Search Value Attribute Type Attribute Value
username [REDACTED]@yahoo yahooBcookie dg8q0od4u0li4
username [REDACTED]@yahoo B_cookie dg8q0od4u0li4
username [REDACTED]@yahoo B_cookie dg8q0od4u0li4
username [REDACTED]@yahoo yahooBcookie dg8q0od4u0li4
username [REDACTED]@yahoo yahooBcookie dg8q0od4u0li4
username dg8q0od4u0li4 B_cookie dg8q0od4u0li4
username [REDACTED]@yahoo B_cookie dg8q0od4u0li4
username [REDACTED]@yahoo B_cookie dg8q0od4u0li4
username [REDACTED]@yahoo yahooBcookie dg8q0od4u0li4
username [REDACTED]@yahoo yahooBcookie dg8q0od4u0li4
username [REDACTED]@yahoo B_coo

Notice redundancy.. So you MAY miss traffic if you select "B_cookie" or "yahooBcookie" (don't know why)

TOP SECRET//COMINT//RE


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

I want to....

  • I have a Cookie and want to see what other accounts access this computer
    • Do TWO separate User Activity query on the cookies
    • 2. Search Value: dg8q0od4u0li4
    • Brings back THESE results...
Search For Search Value Attribute Type Attribute Value
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo

Notice redundancy.. So you MAY miss traffic if you select "B_cookie" or "yahooBcookie" (don't know why)

TOP SECRET//COMINT//RE


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

I want to....

  • I have a Cookie and want to see what other accounts access this computer
    • Do a Marina query on the cookie as well (why not)?
    Specify Date Range (YYYYMMDD [hhmmss]): 20090614 to 20090620
    <S Data

    for User Activity by... Strong Selectors (Emads, IDs, Cookies, Mail Tokens, Phone
    that... exactly match
    the value(s)... dg8q0od4u0li4<yahoobcookie>

    it is reached, return... newest data ? (100,000 raw metadata result limit)
    where value is. active user?
                    in user_a or user_b column?
    filter by... Add Field | Condition | Criteria
    ?

    *Emiclunent Options: All None Select
    Query Justification (optional): iranian b cookie in esfahan

    Submit Reset Form Clear Form

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

I want to....

  • I have a Cookie and want to see what other accounts access this computer
    • Do a Marina query on the cookie as well (why not)?
USER_A ACTIVITY USER_B COOKIE
[REDACTED]<yahoo> seen with machine ID dg8q0od4u0li4<yahooBcookie> dg8q0od4u0li4<yahooBcookie>
[REDACTED]<yahoo> seen with machine ID dg8q0od4u0li4<yahooBcookie> dg8q0od4u0li4<yahooBcookie>
[REDACTED]<yahoo> seen with machine ID dg8q0od4u0li4<yahooBcookie> dg8q0od4u0li4<yahooBcookie>

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

I want to....

  • So let's put the cookie query all together...
    • Between Marina and XKS, I should have an idea of all the accounts..
    • Results pulling on dg8q0od4u0li4 as a Search Value
Search For Search Value Attribute Type Attribute Value
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 yahoo [REDACTED]@yahoo
username dg8q0od4u0li4 raw metadata <commEventSummary> <appPro
  • Plus my Marina results
USER_A ACTIVITY USER_B COOKIE
[REDACTED]<yahoo> seen with machine ID dg8q0od4u0li4<yahooBcookie> dg8q0od4u0li4<yahooBcookie>
[REDACTED]<yahoo> seen with machine ID dg8q0od4u0li4<yahooBcookie> dg8q0od4u0li4<yahooBcookie>
[REDACTED]<yahoo> seen with machine ID dg8q0od4u0li4<yahooBcookie> dg8q0od4u0li4<yahooBcookie>

RESULTS: Three users on the a computer..

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

I want to....

  • I have an IP address and want to know what users/accounts are collected in that network? (I.E. a Café's IP address, or mail/web server for an organization)
    • Do an Email Address query on the IP address
       Email Username:
       @Domain:
       Subject:
       IP Address: [REDACTED] From
  • Do a User Activity query on the IP address
       Search For:
       Search Value:
       Realm:
       Attribute Type:
       Attribute Value:
       Activity:
       Source:
       IP Address: [REDACTED]

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL


TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL

XKEYSCORE

Moral of the story

  • Email Address query looks for the @ symbol in traffic
  • User Activity search allows you to query on more than just an email address

TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL