Email Address vs User Activity
Open PDF +1 other copyDocument date: 2009-06-24
Pages: 20
Genre: slides
Banner: TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123
Classification: TOP SECRET COMINT
Dissemination: REL TO USA, AUS, CAN, GBR, NZL
This 2009 NSA training presentation explains how to use the XKEYSCORE system to search raw SIGINT, detailing the differences between the "Email Address" query, which finds email addresses in full content, and the more flexible "User Activity" query, which can search for selectors like cookies, usernames, and phone numbers.
My notes
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123
XKEYSCORE
Email Address vs User Activity
24 June 2009
Derived From: NSA/CSSM 1-52
Dated: 20070108
Declassify On: 20291123
DERIVED FROM: NSA/CSSM 1-52
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL//20291123
08
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Email Addresses
- The Email Address search allows you to search on:
- Full Email Address
- Do not search on/wildcard JUST the username, always include a specific domain
- Foreign-hosted domains (e.g. @cnc.cn)
- Full Email Address
- The query searches within bodies of emails, webpages and documents for.... (you guessed it)...Email Addresses
- To, From, CC, BCC lines..
- "Contact Us" pages on websites
- Signature blocks
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Email Address
- Email Addresses are found in many parts of traffic
DNI Display Raw Data DNI Format
Subject: RE: Malaysia Tax
From: [REDACTED]
To: [REDACTED]
Cc: [REDACTED]
Date: Tue Jun 23 12:41:25 GMT 2009
Attachments: 01.jpg (12013 bytes);
XKEYSCORE has picked up traffic with email addresses in it..
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Email Address
DNI Display Raw Data DNI Format
Subject: RE: Malaysia Tax
From: [REDACTED]
To: [REDACTED]
Cc: [REDACTED]
Date: Tue Jun 23 12:41:25 GMT 2009
Attachments: image001.jpg (12013 bytes);
X-KEYSCORE C2C Session Viewer
Session 9 of 18
| Datetime | Case Notation | From IP | To IP | From Port | To Port | Protoco | Len |
|---|
| 2009-06-23 12:41:28 | PRPA07550000000 | 198.[REDACTED] (United States) | 219.[REDACTED] (Malaysia) | 39247 | 25 | tcp | 486
Session | Header (3) | Attachments (5) | Meta (10)
attribute_info.txt email_addresses.txt tech.html application_id.xml appproc.asdf xks_snippet.txt phone_number.html fingerprints.xml user_activity.xml ip_lc_trie.txt
email_addresses.txt
Formatter AUTO
Using TXT formatter
[REDACTED]
[REDACTED]
[REDACTED]
[REDACTED]
XKEYSCORE parses out everything it 'thinks' is an email address, so don't be fooled by mis-hits
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Creating Email Address Queries
- Enter usernames and domains into query
Search: Email Addresses
* Query Name: [REDACTED]
* Justification: aqi in iran sample
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Day Start: 2009-06-23 00:00 Stop: 2
* Email Username: badguy or baddude1 or badguysemail
* @Domain: yahoo.com
* Subject: [REDACTED]
Mulitiple usernames from SAME domain can be OR'd
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Creating Email Address Queries
- BE VERY CAREFUL of OR'ing domains
Search: Email Addresses
* Query Name: [REDACTED]
* Justification: aqi in iran sample
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Day Start: 2009-06-23 00:00 Stop: 2009
* Email Username: badguy or baddude1 or badguysemail
* @Domain: yahoo.com or hotmail.com
* Subject: [REDACTED]
When working with multiple domains, create separate Email Address queries for each. i.e. Group your queries by domain names.
Mulitiple domains means either badguy@yahoo.com or badguy@hotmail.com. Are both your targets?
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Email Address
- Sample Search: baku@huawei.com
Search: Email Addresses
* Query Name: [REDACTED]
* Justification: azerbaijiani huawei bubba
* Additional Justification: [REDACTED]
* Miranda Number: [REDACTED]
* Datetime: 1 Week Start: 2009-06-17 00:00 Stop: St
* Email Username: baku
* @Domain: huawei.com
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Email Address
- Email Addresses are found in many parts of traffic
DNI Display | Raw Data | DNI Format
HTTP Header Information | Content Type: HTTP/HTML
Services
Fax: 0061-2-94118533
Vienna, Austria
Ezone Office Building, 4th Floor/ Top 7, Ernst-Melchior-Gasse 20, 1020 Vienna, Austria
Tel:
Baku, Azerbaijan
Caspian Plaza Centre, block 610-611, J.Jabbarly St., Baku
Azerbaijan, Az1065
Tel: 0099412-510-5644/5744/5844
Fax: 0099412-510-5944
E-mail: baku@huawei.com
Results here are from someone viewing a website that contained the email address
Building 647, Road 2811Seef District 428 Kingdom of Bahrain
Tel: 00973-17568708
Fax: 00973-17568701
Bahrain, Bahrain
Villa NO.1, Mohamedia Garden, Gate NO.36,Road
No.3431, Block No.334, Bahrain
Tel: 00974-3443296/00973-9580085
Dhaka, Bangladesh
R.M. Centere(2nd Floor),101, gulshan Avenue Gulshan Model
Town Dhaka 1213 Bangladesh
Minsk, Belarus
Korolya str., 51, floor-2, office-28, Minsk, Belarus
Tel: 00375-17-2048903
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
User Activity Query
- User Activity query is based on APPROC collection (such as chat, webmail, etc)
- Allows more flexible search criteria than Email Address query
- Can search on: Cookies, numeric logins (e.g. web forums & OSN), VoIP selectors, webcam first images, Webmail profile information from registration (birthdays), general usernames
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
KEYSCORE
Creating User Activity Queries
- The fields in a User Activity query can be confusing
Datetime: Custom | Start: 2009-06-23 11:00 | Stop: 20
Search For:
Search Value:
Realm:
Attribute Type:
Attribute Value:
Activity:
Source:
IP Address:
Enter target selectors/identifiers here:
-Phone No
-Cookie
-Username/EMAD (then add REALM)
-
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Creating User Activity Queries
- The fields in a User Activity query can be confusing
| Search For | Search Value | Attribute Type | Attribute Value |
|---|---|---|---|
| username | [REDACTED]@yahoo | communicants | saifdes ziad 197 |
| username | [REDACTED]@yahoo | contact_list | 0920273966 999999 a_salty a_t_love_me aa |
| username | [REDACTED]@yahoo | direction | server-to-client |
| username | [REDACTED]@yahoo | from | [REDACTED] |
| username | [REDACTED]@yahoo | previous_user | [REDACTED] |
| username | [REDACTED]@yahoo | raw_metadata | [REDACTED] |
| username | [REDACTED]@yahoo | to | [REDACTED] |
| username | [REDACTED]@yahoo | user_realm | emailAddr |
| username | [REDACTED]@yahoo | yahoo | [REDACTED] |
| username | [REDACTED] | emailAddr | [REDACTED]@yahoo |
| username | [REDACTED]@yahoo | app_provider | YMSG |
Notice partial email addresses in the "Search Value" field..
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Creating User Activity Queries
- Scenario:
- You have a target's email address:
- [REDACTED]@hotmail.com
- Known: One email address
- Unknown: Alternate ID's, IPs, Location, Photo, etc... (lots of stuff)
- You have a target's email address:
- Where do we begin?
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
I want to....
- I have an Email Address and want to see if it's being collected?
- Do an Email Address query on username and domain
Email Username: baku
@Domain: huawei.com - Do a User Activity query on the email address in the "Selector Value"
Search Value: baku@huawei*
- Do an Email Address query on username and domain
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
I want to....
- I have a Cookie and want to see what other accounts access this computer
- Do TWO separate User Activity query on the cookies
- 1. Attribute Value: dg8q0od4u0li4
- Brings back THESE results...
| Search For | Search Value | Attribute Type | Attribute Value |
|---|---|---|---|
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | dg8q0od4u0li4 | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_cookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | yahooBcookie | dg8q0od4u0li4 |
| username | [REDACTED]@yahoo | B_coo |
Notice redundancy.. So you MAY miss traffic if you select "B_cookie" or "yahooBcookie" (don't know why)
TOP SECRET//COMINT//RE
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
I want to....
- I have a Cookie and want to see what other accounts access this computer
- Do TWO separate User Activity query on the cookies
- 2. Search Value: dg8q0od4u0li4
- Brings back THESE results...
| Search For | Search Value | Attribute Type | Attribute Value |
|---|---|---|---|
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
Notice redundancy.. So you MAY miss traffic if you select "B_cookie" or "yahooBcookie" (don't know why)
TOP SECRET//COMINT//RE
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
I want to....
- I have a Cookie and want to see what other accounts access this computer
- Do a Marina query on the cookie as well (why not)?
Specify Date Range (YYYYMMDD [hhmmss]): 20090614 to 20090620
<S Data
for User Activity by... Strong Selectors (Emads, IDs, Cookies, Mail Tokens, Phone
that... exactly match
the value(s)... dg8q0od4u0li4<yahoobcookie>
it is reached, return... newest data ? (100,000 raw metadata result limit)
where value is. active user?
in user_a or user_b column?
filter by... Add Field | Condition | Criteria
?
*Emiclunent Options: All None Select
Query Justification (optional): iranian b cookie in esfahan
Submit Reset Form Clear Form
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
I want to....
- I have a Cookie and want to see what other accounts access this computer
- Do a Marina query on the cookie as well (why not)?
| USER_A | ACTIVITY | USER_B | COOKIE |
|---|---|---|---|
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
I want to....
- So let's put the cookie query all together...
- Between Marina and XKS, I should have an idea of all the accounts..
- Results pulling on dg8q0od4u0li4 as a Search Value
| Search For | Search Value | Attribute Type | Attribute Value |
|---|---|---|---|
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | yahoo | [REDACTED]@yahoo |
| username | dg8q0od4u0li4 | raw metadata | <commEventSummary> <appPro |
- Plus my Marina results
| USER_A | ACTIVITY | USER_B | COOKIE |
|---|---|---|---|
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
| [REDACTED]<yahoo> | seen with machine ID | dg8q0od4u0li4<yahooBcookie> | dg8q0od4u0li4<yahooBcookie> |
RESULTS: Three users on the a computer..
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
I want to....
- I have an IP address and want to know what users/accounts are collected in that network? (I.E. a Café's IP address, or mail/web server for an organization)
- Do an Email Address query on the IP address
Email Username:
@Domain:
Subject:
IP Address: [REDACTED] From
- Do a User Activity query on the IP address
Search For:
Search Value:
Realm:
Attribute Type:
Attribute Value:
Activity:
Source:
IP Address: [REDACTED]
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL
XKEYSCORE
Moral of the story
- Email Address query looks for the @ symbol in traffic
- User Activity search allows you to query on more than just an email address
TOP SECRET//COMINT//REL TO USA, AUS, CAN, GBR, NZL