NSA Course Materials Module 6 for Technical Personnel
Open PDFDocument date: 2011-10-13
Type: FOIA
Pages: 30
Classification: TOP SECRET SI
Dissemination: NOFORN
Module 6 of 2011 NSA Course Materials regarding the agency’s metadata collection programs under Sections 501 and 402 of FISA. ACLU/EFF FOIA Litigation.
My notes
TOP SECRET//SI//NOFORN
COURSE: (TS//SI//NF) OVSC1206 Special Training on FISA (Technical)
Module 6: (U) The Technical Work Role
DATE/PREPARER: SLS
FRAME ID: 7010
NEXT FRAME ID: 7020
BACK FRAME ID: n/a
ALT TAG:
GRAPHIC/AV:
(U) Image of Technical Character sitting at
a desk
Topic
(U) Module
Introduction
Page Classification
TOP SECRET//COMINT//NOFORN-
Home | Exit | Glossary | Back | Next
Version 25 (Final)
Updated 10/13/11
Includes CAO feedback changes
Screen Number
1 of 20
(U) Module 6
(U) The Technical Work Role
(U) This module will enable you to:
- (TS//SI//NF) Identify the various technical roles that support the BR and PR/TT Bulk
Metadata Programs - (U) Identify the responsibilities of each of the technical roles
- (U) Recognize key points of the compliance certification process for mission
systems and data flows - (TS//SI//NF) Practice applying BR and PR/TT authorities in real-life scenarios
applicable to technical personnel
(TS//SI//NF) (OGC Attorney): During this part of our trip, we discuss several topics of particular interest to those of you in technical roles, or supervising
staff in a technical role, supporting the BR and PR/TT Bulk Metadata Programs. It is important for you to remember that the essential support you provide
enables all of the roles to perform their BR- and PR/TT-related work in compliance with applicable legal documents and relevant authorities. As we
discussed in Module 5, because of this great responsibility, technical personnel have been given tremendous access to touch the data in order to make it
available and usable for the analysts.
(TS//SI//NF) (Technical Character): In this module we are going to discuss the authorizations, roles, and responsibilities of the Technical Personnel. This
module will enable you to:
- (TS//SI//NF) Identify the various technical roles that support the BR and PR/TT Bulk Metadata Programs
Classified By: slsanc2
Derived From: NSA/CSSM 1-52
Dated: 20070108
Declassify On: 20350501
TOP SECRET//SI//NOFORN
Page 1 of 30
TOP SECRET//SI//NOFORN
- (U) Identify the responsibilities of each of the technical roles
- (U) Recognize key points of the compliance certification process for mission systems and data flows
- (TS//SI//NF) Practice applying BR and PR/TT authorities in real-life scenarios applicable to technical personnel
TOP SECRET//SI//NOFORN-
Page 2 of 30
DATE/PREPARER: SLS
FRAME ID: 7020
NEXT FRAME ID: 7030
BACK FRAME ID: 7010
ALT TAG:
GRAPHIC/AV:
(U) Image of Technical Character sitting at
a desk
TOP SECRET//SI//NOFORN
Topic
(U) Two General Categories of
Technical Support Roles
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
2 of 20
(U) Two General Categories of Technical Support Roles
(U) Collection and Metadata [REDACTED]
(U) Storage, Presentation, and Maintenance of the Metadata
(TS//SI//NF) (Technical Character): In Module 5, we explained there are two major areas where technical support is provided for the BR and PR/TT Bulk
Metadata Programs. The first is the group of technical personnel who are responsible for the collection and metadata [REDACTED] process. The second is the
group responsible for storage, presentation, and maintenance of the BR and PR/TT metadata. In the next few screens, we will describe in more detail these
two main areas of responsibility.
TOP SECRET//SI//NOFORN-
Page 3 of 30
DATE/PREPARER: SLS
FRAME ID: 7030
NEXT FRAME ID: 7040
BACK FRAME ID: 7020
ALT TAG:
GRAPHIC/AV:
(U) Have the Collection and Metadata
box expand to reveal the
[REDACTED] and Mission Capabilities boxes as shown
TOP SECRET//SI//NOFORN
Topic
(U) Collection and Metadata
[REDACTED] Support
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
3 of 20
(U) Collection and Metadata Extraction Support
(U) Collection and Metadata [REDACTED]
(U) Mission Capabilities
(U//FOUO) (Technical Character): Let's examine more closely the work roles responsible for the collection and metadata [REDACTED] processes. This
category of technical staff currently includes the technical professionals in NSA's [REDACTED] and Mission
Capabilities staff within the Technology Directorate (TD) organizations. As we proceed through this module you will find out more about the roles in each of
these three organizations.
(TS//SI//NF) Note that in addition to these key roles, there are other technical roles that are important to the implementation of these programs. These roles
include individuals involved in the acquisition, processing, presentation, storage, retention, and support to operations which are authorized under the BR
and PR/TT Orders.
TOP SECRET//SI//NOFORN
Page 4 of 30
DATE/PREPARER: SLS
FRAME ID: 7040
NEXT FRAME ID: 7050
BACK FRAME ID: 7030
ALT TAG: (U//FOUO) [REDACTED] Logo
GRAPHIC/AV
(U) Have the [REDACTED] logo and info box appear
and grey out the [REDACTED] and
Mission Capabilities boxes while the [REDACTED]
info is displayed.
[REDACTED]_logo_sm.png
-TOP SECRET//SI//NOFORN
Topic
(S//SI//RFI) Collection and
Metadata [REDACTED] Support from [REDACTED]
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
4 of 20
(U) Collection and Metadata [REDACTED] Support
(U) Collection and Metadata [REDACTED]
(S//ST/REL) [REDACTED] is responsible for [REDACTED]
Mission Capabilities [REDACTED]
(TS//SI//NF) Some of the rules that apply to [REDACTED]:
- Acquire data [REDACTED] authorized by the FISC
- Identify all m[REDACTED]
- [REDACTED] is promptly destroyed
- Changes to systems require approval by the Chief of S3
(TS//SI//NF) (Technical Character): The first Technical Work Role that supports the collection and metadata [REDACTED] processes is [REDACTED]
(TS//SI//NF) For BR. the [REDACTED] role is similar in that [REDACTED]
-TOP SECRET//SI//NOFORN
Page 5 of 30
-TOP SECRET//SI//NOFORN-
(TS//SI//NF) Some of the rules that apply to [REDACTED] are to provide reasonable assurance that:
- NSA is only [REDACTED] that have been authorized by the FISC
- All of the metadata is identifiable as BR or PR/TT data
- Data which does not fall within FISC specified requirements regarding [REDACTED] and must be
promptly destroyed - Changes to systems under [REDACTED] purview are approved by the Chief of S3 before implementation
(TS//SI//NF) The staff in [REDACTED] will rarely come in contact with human intelligible BR and/or PR/TT metadata. Scroll over the [REDACTED] logo
to find out more about [REDACTED]
Scroll over text bo [REDACTED]
(S//SI//REL) The [REDACTED]
TOP SECRET//SI//NOFORN-
Page 6 of 30
DATE/PREPARER: SLS
FRAME ID: 7050
NEXT FRAME ID: 7060
BACK FRAME ID: 7040
ALT TAG: (U) [REDACTED] Logo
GRAPHIC/AV:
(U) Have the [REDACTED] logo and info box appear
and grey out the [REDACTED] and Mission Cap[REDACTED]es while the [REDACTED]
info is displayed.
[REDACTED] Logo.jpg
-TOP SECRET//SI//NOFORN
Topic
(S//S[REDACTED]) Collection and Metadata
Support from [REDACTED]
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
5 of 20
(U) Collection and Metadata [REDACTED] Support
(U) Collection and Metadata [REDACTED]
(U) Mission Capabilities
(TS//SI//NF) Some of the roles that [REDACTED]
- Provide reasonable assurance that all [REDACTED] are in
compliance with FISC Orders - Validate that only properly [REDACTED]
(TS//SI//NF) (Technical Character): The [REDACTED] organization, and to a lesser extent the Mission Capabilities organization, supports the
collection and metadata [REDACTED] processes for [REDACTED]
(TS//SI//NF) Some of the roles that [REDACTED] include:
- Provide reasonable assurance that all [REDACTED] are in compliance with the
FISC Orders. - Validate that only properly [REDACTED] metadata is forwarded to the [REDACTED] for analytic use.
TOP SECRET//SI//NOFORN-
Page 7 of 30
TOP SECRET//SI//NOFORN
(TS//SI//NF) These individuals have direct and continual access and interaction with both [REDACTED] Scroll over the [REDACTED]
logo to find out more about [REDACTED]
Scroll over text box for [REDACTED] logo: [REDACTED]
Pop-up screen for [REDACTED] logo: (S//SI//REL) The [REDACTED] Branch analyzes new digital communication [REDACTED] and researches new digital
network communications technologies to pro[REDACTED]quired for their exploitation.
TOP SECRET//SI//NOFORN-
Page 8 of 30
-TOP SECRET//SI//NOFORN
DATE/PREPARER: SLS
FRAME ID: 7060
NEXT FRAME ID: 7070
BACK FRAME ID: 7050
ALT TAG: (U) Mission Capabilities Logo
GRAPHIC/AV:
(U) (Have the TD logo and info box appear
and grey out the [REDACTED] and
[REDACTED] TD in [REDACTED]
boxes while the [REDACTED]
td-logo-small.gif (or td-logo-med.gif)
Topic
(U) Collection and Metadata
Support from TD
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
6 of 20
(U) Collection and Metadata [REDACTED] Support
(U) Collection and Metadata [REDACTED]
(U) Mission Capabilities
(TS//SI//NF) Mission Capabilities
staff integrates the PR/TT [REDACTED]
(TS//SI//NF) Some of the rules that apply to Mission Capabilities:
- All metadata remains identifiable as PR/TT
- [REDACTED] is promptly destroyed
- [REDACTED]
(TS//SI//NF) (Technical Character): Finally the Mission Capabilities, or TD, staff support the collection and metadata [REDACTED] processes by integrating the [REDACTED]
(TS//SI//NF) Some of the rules that apply to Mission Capabilities staff within the Technology Directorate (TD) are to provide reasonable assurance that:
- All of the metadata remains identifiable as PR/TT data
- [REDACTED]
- [REDACTED]
TOP SECRET//SI//NOFORN
Page 9 of 30
- [REDACTED]
TOP SECRET//SI//NOFORN
(TS//SI//NF) This staff will rarely come in contact with human intelligible PR/TT metadata. Scroll over the logo to find out more about Mission Capabilities.
Scroll over text box for Mission Capabilities logo: [REDACTED]
(S//SI//REL) Mission Capabilities [REDACTED]
-TOP SECRET//SI//NOFORN
Page 10 of 30
DATE/PREPARER: SLS
FRAME ID: 7070
NEXT FRAME ID: 7080
BACK FRAME ID: 7060
ALT TAG:
GRAPHIC/AV:
(U) NOTE: Use a matching format
(responsibilities listed on one
side and the organizations listed
on the other side) so that the
user matches up the
organization to the appropriate
responsibilities.
TOP SECRET//SI//NOFORN
Topic
(U)
Knowledge
Check 1
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
7 of 20
(U) Knowledge Check 1
(U) Match the organization to its corresponding roles and responsibilities:
- (TS//SI//NF) Staff in [REDACTED] is responsible for developing the [REDACTED]
a) (U) Mission Capabilities
b) [REDACTED]
c) [REDACTED]
d) (U) Homeland Mission Coordinators
- (TS//SI//NF) Staff in [REDACTED] is responsible for integrating the PR/TT [REDACTED]
including conducting related testing prior to system [REDACTED]
a) (U) Mission Capabilities
b) [REDACTED]
c) [REDACTED]
d) (U) Homeland Mission Coordinators
- (TS//SI//NF) Staff in [REDACTED] is responsible for [REDACTED]
a) (U) Mission Capabilities
b) [REDACTED]
c) [REDACTED]
d) (U) Homeland Mission Coordinators
(U) (Technical Character): Let's make a few notes in our travel journal and check to see what you remember from this topic!
-TOP SECRET//SI//NOFORN
Page 11 of 30
-TOP SECRET//SI//NOFORN
For this knowledge check, simply display the correct answers using the format below:
Question 1. (TS//SI//NF) Staff in [REDACTED] is responsible for [REDACTED]
Question 2. (TS//SI//NF) Staff in Mission Capabilities is responsible for integrating the PR/TT [REDACTED]
Question 3. (TS//SI//NF) Staff in [REDACTED] is responsible for [REDACTED]
TOP SECRET//SI//NOFORN
Page 12 of 30
DATE/PREPARER: SLS
FRAME ID: 7080
NEXT FRAME ID: 7090
BACK FRAME ID: 7070
ALT TAG:
GRAPHIC/AV:
(U) Have the Storage, Presentation, and
Maintenance of the Metadata box expand
to reveal the Mission Capabilities and
[REDACTED] boxes as shown
-TOP SECRET//SI//NOFORN
Topic
(U) Storage, Presentation, and
Maintenance of the Metadata
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
8 of 20
(U) Storage, Presentation, and Maintenance of the Metadata
(U) Storage, Presentation, and Maintenance of the Metadata
(U) Mission Capabilities [REDACTED]
(TS//SI//NF) (Technical Character): Now let's discuss the work roles responsible for the storage, presentation, and maintenance of both the BR and PR/TT
metadata. This category of technical staff currently includes the technical professionals in Mission Capabilities and [REDACTED]
-TOP SECRET//SI//NOFORN
Page 13 of 30
DATE/PREPARER: SLS
FRAME ID: 7090
NEXT FRAME ID: 7100
BACK FRAME ID: 7080
ALT TAG: (U) Mission Capabilities Logo
GRAPHIC/AV:
(U) Have the TD logo and info box appear
and grey out the [REDACTED]
boxes while the Mission Capabilities info is
displayed
[REDACTED] td-logo-small.gif (or td-logo-med.gif)
TOP SECRET//SI//NOFORN
Topic
(U) Storage, Presentation, and
Maintenance of the Metadata by TD
Home | Exit | Glossary | Back | Next
Page Classification
TOP
-SECRET//COMINT//NOFORN
Screen Number
9 of 20
(U) Storage, Presentation, and Maintenance of the Metadata
(U) Storage, Presentation, and Maintenance of the Metadata
(U) Mission Capabilities
(TS//SI//NF) Mission Capabilities is
responsible for:
- Developing, maintaining, and operating
repositories that store and present BR and
PR/TT metadata - [REDACTED]
(TS//SI//NF) Some of the rules that apply to Mission Capabilities:
- Metadata must be maintained in secure NSA repositories
- Data must be identifiable as BR or PR/TT
- Implement technical controls to prevent unauthorized access
- Restrict intelligence analysis queries to RAS-approved identifiers (e.g. the EAR)
- Ensure intelligence analysis queries remain within authorized number of hops
- Create auditable records of all intelligence analysis queries
- Destroy all metadata before the end of the five year authorized retention period (no
exceptions!) - Changes to systems must be certified by the TD Compliance Office before
implementation - Automated queries are prohibited without approval
TOP SECRET//SI//NOFORN
Page 14 of 30
TOP SECRET//SI//NOFORN
(TS//SI//NF) (Technical Character): You will recall that Mission Capabilities supports collection and metadata [REDACTED] and other branches of Mission
Capabilities support storage, presentation, and maintenance of the metadata. For the latter, the staff is typically database management and user interface
professionals who are responsible for developing, maintaining, and operating the [REDACTED] that store and present BR and PR/TT metadata, as well as [REDACTED]
(TS//SI//NF) Some of the rules that apply to Mission Capabilities include:
- Metadata must be maintained in secure NSA repositories
- Data items must be identifiable as BR or PR/TT data
- Implement technical controls to prevent unauthorized access
- Implement technical controls to restrict intelligence analysis queries to RAS-approved identifiers (e.g. the EAR)
- Implement technical controls to provide reasonable assurance that the results of intelligence analysis queries remain within the authorized number
of hops - Create auditable records of all intelligence analysis queries
- Destroy all metadata before the end of the five year authorized retention period (no exceptions for backup data)
- [REDACTED]
- [REDACTED]
(TS//SI//NF) This staff will come in contact with human intelligible BR and PR/TT metadata.
TOP SECRET//SI//NOFORN-
Page 15 of 30
DATE/PREPARER: SLS
FRAME ID: 7100
NEXT FRAME ID: 7110
BACK FRAME ID: 7090
ALT TAG: (U) [REDACTED] Logo
GRAPHIC/AV:
(U) Have the PE logo and info box appear
and grey out the Mission Capabilities boxes
while the [REDACTED] info is
displayed
[REDACTED] Logo.jpg
TOP SECRET//SI//NOFORN
Topic
(U) Storage, Presentation, and
Maintenance of the Metadata by PE
Home | Exit | Glossary | Back | Next
Page Classification
TOP-
-SECRET//COMINT//NOFORN
Screen Number
10 of 20
(U) Storage, Presentation, and Maintenance of the Metadata
(U) Storage, Presentation, and Maintenance of the Metadata
(U) Mission Capabilities [REDACTED]
(TS//SI//NF) Protocol Exploitation is
responsible for:
- Ensuring data is normalized and is
presented in a usable format - Providing support to intelligence analysts
(TS//SI//NF) For BR, [REDACTED] performs unique functions including:
- Normalizing [REDACTED]
- Reviewing data to ensure records include only data [REDACTED]
- Assist in ensuring that data to be presented to analysts will be in a usable format
- Providing operational support to intelligence analysts; support is limited to RAS-approved identifiers
within the authorized number of hops
(TS[REDACTED]) (Technical Character): As you recall for PR/TT, [REDACTED] provides support to [REDACTED] for
BR, [REDACTED] performs both a
[REDACTED] assists in ensuring accurate representation and integrity of the metadata. In this context, [REDACTED]
[REDACTED] must apply the rules governing the specific
[REDACTED] upporting role for intelligence analysts. Because of this dual role, [REDACTED]
function it is performing at the time. When performing a technical role, the technical rules apply which allow broader access to the data. However, when
supporting the intelligence analyst, the [REDACTED] staff must operate within the same rules applicable to the intelligence analyst which are more
TOP SECRET//SI//NOFORN
Page 16 of 30
TOP SECRET//SI//NOFORN
restrictive.
(TS//SI//NF) For BR, [REDACTED] performs unique functions to include:
- Normalizing all of the disparate data formats
- Reviewing the data to validate that the records include only data [REDACTED]
- Assist in ensuring that the data to be presented to the analysts will be in a usable format
- Providing operational support as necessary to intelligence analysts; support is limited to RAS-approved identifiers within the authorized number of
hops
TOP SECRET//SI//NOFORN
Page 17 of 30
DATE/PREPARER: SLS
FRAME ID: 7110
NEXT FRAME ID: 7130
BACK FRAME ID: 7100
ALT TAG:
GRAPHIC/AV:
-TOP SECRET//SI//NOFORN
Topic
Knowledge
Check 2
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
11 of 20
(U) Knowledge Check 2
- (TS//SI//NF) Which one of these is not one of the roles and responsibilities of the technical personnel?
a) (U//FOUO) Manipulating and validating the metadata to make it usable for intelligence analysis
purposes
b) (TS//SI//NF) Developing new tools to support querying of BR and PR/TT metadata
c) (S//SI//REL) Running an intelligence analysis query using a RAS-approved identifier for an analyst
who is experiencing problems recreating their query results
d) (S//SI//REL) Running an intelligence analysis query using a non-RAS-approved identifier for
an analyst who is experiencing problems recreating their query results
e) (U) Both C and D
- (TS//SI//NF) [REDACTED] provides support to the BR program by doing the following (check all
that apply):
a) (U) Normalizing all of the disparate data formats
b) (U) Reviewing the data to validate that the records include data [REDACTED]
c) (U) Ensuring metadata is maintained in secure NSA repositories.
d) (U) Assist in ensuring that the data to be presented to the analysts will be in a usable format
e) (U) Destroy all metadata before the end of the five year authorized retention period (no exceptions
for backup data
f) (S//SI/REL) Providing operational support as necessary to intelligence analysts on RAS-
approved identifiers within the authorized number of hops
- (TS//SI//NF) Database management and user interface professionals in [REDACTED] develop,
maintain, and operate the [REDACTED] that store and present BR and PR/TT metadata, and develop
algorithms/processes that prepare, optimize, and characterize the metadata for analytic utilization.
a) [REDACTED]
b) [REDACTED]
c) [REDACTED]
d) (U) Homeland Mission Coordinators
(U) (Technical Character): Let's check what you remember from this topic!
Question 4. (TS//SI//NF) Correct! Running an intelligence analysis query using a non-RAS-approved identifier for an analyst who is experiencing problems
[REDACTED]
TOP SECRET//SI//NOFORN
Page 18 of 30
TOP SECRET//SI//NOFORN
recreating their query results is not one of the roles and responsibilities of the technical personnel.
(TS//SI//NF) Incorrect. The correct answer is d). Running an intelligence analysis query using a non-RAS-approved identifier for an analyst who is
experiencing problems recreating their query results is not one of the roles and responsibilities of the technical personnel.
Question 5. (TS//SI//NF) Correct! [REDACTED] provides support to the BR program by doing the following:
a) (U) Normalizing all of the disparate data formats
b) (U) Reviewing the data to validate that the records include data [REDACTED]
d) (U) Assist in ensuring that the data to be presented to the analysts will be in a usable format
f) (S//SI//REL) Providing operational support as necessary to intelligence analysts on RAS-approved identifiers within the authorized
number of hops
(TS//SI//NF) Incorrect [REDACTED] provides support to the BR program by doing the following:
a) (U) Normalizing all of the disparate data formats
b) (U) Reviewing the data to validate that the records include data [REDACTED]
d) (U) Assist in ensuring that the data to be presented to the analysts will be in a usable format
f) (S//SI//REL) Providing operational support as necessary to intelligence analysts on RAS-approved identifiers within the authorized
number of hops
Question 6. (TS//SI//NF) Correct! Database management and user interface professionals in Mission Capabilities develop, maintain, and operate the [REDACTED]
that store and present BR and PR/TT metadata, and develop algorithms/processes that prepare, optimize, and characterize the metadata [REDACTED]
(TS//SI//NF) Incorrect. The correct answer is a). Database management and user interface professionals in Mission Capabilities develop, maintain, and
operate the [REDACTED] that store and present BR and PR/TT metadata, and develop algorithms/processes that prepare, optimize, and characterize the
metadata [REDACTED]
TOP SECRET//SI//NOFORN-
Page 19 of 30
DATE/PREPARER: SLS
FRAME ID: 7130
NEXT FRAME ID: 7140
BACK FRAME ID: 7110
ALT TAG:
GRAPHIC/AV:
(U) Image of Technical Character sitting at
a desk
TOP SECRET//SI//NOFORN
Topic
(U) The Compliance
Certification Process
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
12 of 20
(U) The Compliance Certification Process
(U//FOUO) Compliance certification is a mandatory check for all systems handling U.S.
person or FISA data
(U) Guidelines governing the certification process are maintained by the TD Compliance
Office
(U) Compliance should be integrated into the development process
(TS//SI//NF) (Technical Character): Next we will discuss the compliance certification process used by technical personnel who develop mission
technologies that include those supporting the BR and PR/TT Programs. Compliance certification is a mandatory check for all systems handling U.S. person
or FISA data. Guidelines governing the certification process are maintained by the TD Compliance Office. This process represents compliance with the
applicable laws and authorities and supports the NSA Way. The NSA Way is a unified framework for building large (or small), complex, primarily software
systems that meet the diverse needs of NSA missions. An important point is that compliance should be integrated into the development process.
TOP SECRET//SI//NOFORN
Page 20 of 30
DATE/PREPARER: SLS
FRAME ID: 7140
NEXT FRAME ID: 7150
BACK FRAME ID: 7130
ALT TAG:
GRAPHIC/AV:
(U) Insert Compliance Gates image - if
image is too large for the window, create a
separate pop-up to view in full screen.
Note: Compliance Gates graphic from
Compliance_Gates_updated 2-28-11.pptx
Display the screen shot of [REDACTED]
when the "To begin the cer[REDACTED]
process..." topic is discussed
Redisplay the Compliance_Gates.png
graphic
TOP SECRET//SI//NOFORN
Topic
(U) The Compliance
Certification Process
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN-
Screen Number
13 of 20
(U) Following the Compliance Certification Process
(U) The goal of the compliance certification process is to integrate compliance into the
development phase
(TS//SI//NF) (Technical Character): The goal of the compliance certification process is to integrate compliance into the development phase. The gates
shown in the compliance process represent distinct requirements that must be satisfied in order to provide reasonable assurance of compliance. The
architects of the new technology develop engineering documents to support these requirements. The TD certification group reviews the artifacts to verify
the compliance process requirements are being met.
(TS//SI//NF) The compliance certification process begins by registering in [REDACTED]. Access the site by typing [REDACTED] into your web
browser. Once registration is complete, you will receive a requirements pa[REDACTED]
(U//FOUO) Compliance is an ongoing process. Any change or update to previously certified software requires recertification to remain compliant. In other
words, if you develop a modification or upgrade to the software, then you need to register the software modification in [REDACTED] to begin the
recertification process.
-TOP SECRET//SI//NOFORN-
Page 21 of 30
TOP SECRET//SI//NOFORN
(TS//SI//NF) Formal approval is required for all new and/or different BR and PR/TT systems. Under no circumstances can a change be made to a software
system (even for testing purposes) without going through the compliance certification (or recertification) process.
TOP SECRET//SI//NOFORN-
Page 22 of 30
DATE/PREPARER: SLS
FRAME ID: 7150
NEXT FRAME ID: 7170
BACK FRAME ID: 7140
ALT TAG:
GRAPHIC/AV:
(U) Image of Technical Character sitting at
a desk
TOP SECRET//SI//NOFORN
Topic
(U) The Dataflow Process
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
14 of 20
(U) The Dataflow Process
(U//FOUO) The goal of dataflow governance is to provide reasonable assurance of
accountability and compliance for NSA mission data as it moves throughout NSA systems
(U//FOUO) Triggers for entering the dataflow governance process include (but are not
limited to):
- Adding a [REDACTED]
- Replacing an existing repository
- Inserting a process or system into the flow
- Adding a new mission element
- Legacy migration
(TS//SI//NF) (Technical Character): The Collection Strategies and Requirements Center (CSRC) is responsible for dataflow governance, which provides
reasonable assurance of accountability and compliance for NSA mission data as it moves throughout NSA systems. This is critical to protect the data, and
when we are talking about volumes of U.S. person data you can understand why this is so important.
(TS//SI//NF) The process begins by submitting a dataflow request (usually done by the system builder or access owner) for a new dataflow solution. Then
some level of research is needed to determine the type of request and associated needs. Once the requirements are determined, a new processing
capability may be developed, or an existing flow may be reconfigured to meet the new requirement. The solution must then be tested and obtain official
sign-off at which time CSRC authorization to operate would be issued.
(U//FOUO) In general, triggers for entering the dataflow governance process include (but are not limited to):
- [REDACTED]
- Replacing an existing repository
- Inserting a process or system into the flow
- Adding a new mission element
- Legacy migration (moving an existing unmanaged flow to a managed flow)
(TS//SI//NF) Formal approval is required for all new and/or different BR and PR/TT data flows. Under no circumstances can a change be made to a data
flow (even for testing purposes) without going through the dataflow governance process.
(U//FOUO) To find out more about the dataflow process, please refer to the Dataflow webpage by typing 'go dataflow' in your web browser.
TOP SECRET//SI//NOFORN
Page 23 of 30
DATE/PREPARER: SLS
FRAME ID: 7170
NEXT FRAME ID: 7180
BACK FRAME ID: 7150
ALT TAG:
GRAPHIC/AV:
TOP SECRET//SI//NOFORN
Topic
(U) Knowledge
Check 3
Home | Exit | Glossary | Back | Next
Page Classification
-TOP SECRET//COMINT//NOFORN
Screen Number
15 of 20
(U) Knowledge Check 3
- (TS//SI//NF) The compliance certification process for new systems is triggered by [REDACTED]
a) (U) Entering a ticket into [REDACTED]
b) (U//FOUO) Contacting NSA Way Team
c) (U//FOUO) Entering the new software or system into [REDACTED]
d) (U) All of the above
- (TS//SI//NF) Which of the following is [REDACTED] a reason for entering the dataflow governance process?
a) [REDACTED]
b) (U) Replacing an existing repository
c) (U) Inserting a process or system into the flow
d) (U) Modifying a bulk metadata query
e) (U) Moving an existing unmanaged flow to a managed flow
- (TS//SI//NF) Before an analytic software upgrade is released on a system that handles BR or PR/TT data,
the developers would need to [REDACTED] in order to remain compliant.
a) (U) contact the CSRC and undergo compliance recertification
b) (U) register the software release in [REDACTED] and undergo compliance recertification
c) (U) obtain OGC approval
d) (U) register your system with ODOC
(U) (Technical Character): Let's make a few notes in our travel journal and check to see what you remember from this topic!
Question 7 (U//FOUO) Correct! The compliance certification process for new systems is triggered by entering the new software or system in [REDACTED]
[REDACTED]ect. The correct answer is c). The compliance certification process for new systems is triggered by entering the new software or system in [REDACTED]
Question 8. (U//FOUO) Correct! Modifying a bulk metadata query is not a reason for entering the dataflow governance process.
(U//FOUO) Incorrect. The correct answer is d). Modifying a bulk metadata query is not a reason for entering the dataflow governance process.
Question 9. (U//FOUO) Correct! Before an analytic software upgrade is released on a system that handles BR or PR/TT data, the developers would need to
register the software release in [REDACTED] and undergo compliance recertification in order to remain compliant.
(U//FOUO) Incorrect. The correc[REDACTED] Before an analytic software upgrade is released on a system that handles BR or PR/TT data, the developers
would need to register the software release in [REDACTED] and undergo compliance recertification in order to remain compliant.
TOP SECRET//SI//NOFORN
Page 24 of 30
TOP SECRET//SI//NOFORN
recreating their query results is not one of the roles and responsibilities of the technical personnel.
(TS//SI//NF) Incorrect. The correct answer is d). Running an intelligence analysis query using a non-RAS-approved identifier for an analyst who is
experiencing problems recreating their query results is not one of the roles and responsibilities of the technical personnel.
Question 5. (TS//SI//NF) Correct! [REDACTED] provides support to the BR program by doing the following:
a) (U) Normalizing all of the disparate data formats
b) (U) Reviewing the data to validate that the records include data [REDACTED]
d) (U) Assist in ensuring that the data to be presented to the analysts will be in a usable format
f) (S//SI//REL) Providing operational support as necessary to intelligence analysts on RAS-approved identifiers within the authorized
number of hops
(TS//SI//NF) Incorrect [REDACTED] provides support to the BR program by doing the following:
a) (U) Normalizing all of the disparate data formats
b) (U) Reviewing the data to validate that the records include data [REDACTED]
d) (U) Assist in ensuring that the data to be presented to the analysts will be in a usable format
f) (S//SI//REL) Providing operational support as necessary to intelligence analysts on RAS-approved identifiers within the authorized
number of hops
Question 6. (TS//SI//NF) Correct! Database management and user interface professionals in Mission Capabilities develop, maintain, and operate the [REDACTED]
that store and present BR and PR/TT metadata, and develop algorithms/processes that prepare, optimize, and characterize the metadata [REDACTED]
(TS//SI//NF) Incorrect. The correct answer is a). Database management and user interface professionals in Mission Capabilities develop, maintain, and
operate the [REDACTED] that store and present BR and PR/TT metadata, and develop algorithms/processes that prepare, optimize, and characterize the
metadata [REDACTED]
TOP SECRET//SI//NOFORN-
Page 19 of 30
DATE/PREPARER: SLS
FRAME ID: 7180
NEXT FRAME ID: 7190
BACK FRAME ID: 7160
ALT TAG:
GRAPHIC/AV:
TOP SECRET//SI//NOFORN
Topic
(U) Practice Scenario 1
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
16 of 20
(U) Practice Scenario 1
(TS//SI//NF) You are one of the [REDACTED] cleared technical personnel responsible for metadata management
within NSA's metadata repositories. You are working with other [REDACTED] -cleared developers on new query
processes and tools. You [REDACTED] a set of properly marked recor[REDACTED] y your team for development
purposes from the PR/TT metadata. This set of PR/TT metadata records is stored on a physically isolated system
within NSA's secure network and is accessible only to the members of your team. Are your actions in
compliance with the terms of the PR/TT Orders?
(U) Please select the BEST answer:
a) (TS//SI//NF) Yes, because the PR/TT Orders explicitly authorize properly trained technical
personnel to develop and test new technologies to be used with the PR/TT metadata.
b) (TS//SI//NF) No, because the PR/TT Orders prohibit the use of new query processes against any of
the PR/TT metadata.
c) (TS//SI//NF) Yes, because the [REDACTED] PR/TT metadata records still carry the unique
markings and software controls on the physically isolated system to restrict access to
those records to [REDACTED] cleared personnel.
d) (U) None of the above are correct.
(U) (Technical Character): Now let's practice what we have learned using real-life scenarios. Carefully read the scenario and then select the best answer.
ANSWER:
a) (TS//SI//NF) Incorrect. This statement is accurate, but this is not what makes your actions compliant. The correct answer is c). Yes, because the
[REDACTED] PR/TT metadata records still carry the unique markings and software controls on the physically isolated system to restrict access to
those records to [REDACTED] cleared personnel.
b) (TS//SI//NF) Incorrect. The current Court Orders authorize NSA to develop new query processes. The correct answer is c). Yes, because the
[REDACTED] PR/TT metadata records still carry the unique markings and software controls on the physically isolated system to restrict access to
those records to [REDACTED] cleared personnel.
c) (TS//SI//NF) Correct! The best answer is c). Yes, because the [REDACTED] PR/TT metadata records still carry the unique markings and
software controls on the physically isolated system to restric[REDACTED]e records to [REDACTED] cleared personnel.
d) (TS//SI//NF) Incorrect. The correct answer is c). Yes, because the [REDACTED] PR/TT metadata records still carry the unique markings and
software controls on the physically isolated system to restrict access to those records to [REDACTED] cleared personnel.
TOP SECRET//SI//NOFORN
Page 25 of 30
DATE/PREPARER: SLS
FRAME ID: 7190
NEXT FRAME ID: 7200
BACK FRAME ID: 7180
ALT TAG:
GRAPHIC/AV:
-TOP SECRET//SI//NOFORN-
Topic
(U) Practice Scenario 2
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
17 of 20
(U) Practice Scenario 2
(TS//SI//NF) You are a [REDACTED]-cleared developer of contact chaining analytic tools. Your
management chain has requested a briefing to demonstrate your progress on the latest version of the tool.
You provide the briefing, which includes screen shots of the tool and query results generated by the tool. Are
your actions in compliance with the Orders?
(U) Please select the BEST answer:
a) (U//FOUO) No, unless all of those on your development team and all those who
attended your briefing held current [REDACTED] clearances.
b) (U) No, because the Court Orders do not permit testing of tools under development using
real data.
c) (U) Yes, as long as the query results shared during the briefing are never used for
intelligence analysis purposes.
d) (U) None of the above are correct.
ANSWER:
a) (U) Correct! This is the best answer. You cannot provide a demonstration unless all of the individuals who attended the briefing have
completed the required training and received the necessary accesses.
b) (U//FOUO) Incorrect. The correct answer is a). No, unless all of those on your development team and all those who attended your briefing held
current [REDACTED] clearances.
c) (U//FOUO) Incorrect. The correct answer is a). No, unless all of those on your development team and all those who attended your briefing held
current [REDACTED] clearances.
d) (U//FOUO) Incorrect. The correct answer is a). No, unless all of those on your development team and all those who attended your briefing held
current [REDACTED] clearances.
-TOP SECRET//SI//NOFORN
Page 26 of 30
DATE/PREPARER: SLS
FRAME ID: 7200
NEXT FRAME ID: 7210
BACK FRAME ID: 7190
ALT TAG:
GRAPHIC/AV:
TOP SECRET//SI//NOFORN
Topic
(U) Practice Scenario 3
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
18 of 20
(U) Practice Scenario 3
(TS//SI//NF) You are one of the [REDACTED] cleared technical personnel responsible for metadata
management within NSA's metadata repositories. You are responsible for the maintenance of backup
systems and Continuity of Operations (COOP) planning and implementation. You have control over the
backup tapes that hold PR/TT metadata collected since the inception of the PR/TT authority [REDACTED]. In
accordance with your COOP plans, you know that if a disaster strikes and NSA's online metadata
repositories are destroyed, you could use these backup tapes to repopulate the repositories with PR/TT
metadata. Although the backup tapes contain information older than five years, the processes you would
employ to repopulate the online analytic metadata repositories would select only metadata collected within
the last five years. Is your maintenance of backup tapes holding PR/TT metadata collected more than five
years ago in compliance with the terms of the PR/TT Orders?
(U) Please select the BEST answer:
a) (TS//SI//NF) Yes, because the older-than-five-years PR/TT metadata on the backup tapes
will never be available for intelligence analysis purposes.
b) (TS//SI//NF) Yes, because the PR/TT Orders specifically authorize NSA to maintain backup
tapes of the PR/TT metadata.
c) (TS//SI//NF) No, because the PR/TT Orders mandate the destruction of the PR/TT
metadata no later than five years after its initial collection, with no exception for
metadata on backup tapes.
d) (U) None of the above are correct.
ANSWER:
a) (TS//SI//NF) Incorrect. The correct answer is c). No, because the PR/TT Orders mandate the destruction of the PR/TT metadata no later than five
years after its initial collection, with no exception for metadata on backup tapes. This is different from other authorities, for example FAA 702 does
not require the destruction of data in the archives.
b) (TS//SI//NF) Incorrect. The correct answer is c). No, because the PR/TT Orders mandate the destruction of the PR/TT metadata no later than five
years after its initial collection, with no exception for metadata on backup tapes.
c) (TS//SI//NF) Correct! This is the best answer. No, because the PR/TT Orders mandate the destruction of the PR/TT metadata no later than
five years after its initial collection, with no exception for metadata on backup tapes.
d) (TS//SI//NF) Incorrect. The correct answer is c). No, because the PR/TT Orders mandate the destruction of the PR/TT metadata no later than five
years after its initial collection, with no exception for metadata on backup tapes.
TOP SECRET//SI//NOFORN
Page 27 of 30
TOP SECRET//SI//NOFORN
DATE/PREPARER: SLS
FRAME ID: 7210
NEXT FRAME ID: 7220
BACK FRAME ID: 7200
ALT TAG:
GRAPHIC/AV:
(U) Image of Technical Character sitting at
a desk
Topic
(U) Summary
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
19 of 20
(U) Now that you have completed this module you should be able to:
- (TS//SI//NF) Identify the various technical roles that support the BR and PR/TT Bulk
Metadata Programs - (U) Identify the responsibilities of each of the technical roles
- (U) Recognize key points of the compliance certification process for mission
systems and data flows - (TS//SI//NF) Practice applying BR and PR/TT authorities in real-life scenarios
applicable to technical personnel
(U//FOUO) If you have questions or wish to find out more, please contact your manager or
any of the following BR or PR/TT points of contact:
TD Compliance Office website: go td compliance
OGC email alias: [REDACTED]
OGC Phone: [REDACTED]
OGC website: go GC
Oversight and Compliance email alias: DL SV42_all
(TS//SI//NF) (Technical Character): As we stated earlier in the course, the bulk metadata includes sensitive data that must be protected accordingly. By
nature of the kinds of technical support provided to the BR and PR/TT programs, technical personnel have the authority and unrestricted access to touch
unminimized/unevaluated (or raw), and very sensitive data (that contains a lot of U.S. person identifiers). Remember, we need to maintain a clear
distinction between the roles of technical and analytical personnel. All personnel are held to a high standard of integrity, but in your technical role you must
be particularly cautious because the tools you work with do not provide the same safeguards as those tools used by the analytical personnel.
TOP SECRET//SI//NOFORN
Page 28 of 30
TOP SECRET//SI//NOFORN
(TS//SI//NF) In conclusion, it is your responsibility to keep the BR and PR/TT information within the confines of those who have the proper authorizations to
touch and view the data.
(U) Now that you have completed this part of our road trip, you should be able to:
- (TS//SI//NF) Identify the various technical roles that support the BR and PR/TT Bulk Metadata Programs
- (U) Identify the responsibilities of each of the technical roles
- (U) Recognize key points of the compliance certification process for mission systems and data flows
- (TS//SI//NF) Practice applying BR and PR/TT authorities in real-life scenarios applicable to technical personnel
(U) You are encouraged to reach out to your management or to any of the points of contact listed here if you have any questions or if you want to find out
more.
TOP SECRET//SI//NOFORN
Page 29 of 30
TOP SECRET//SI//NOFORN
DATE/PREPARER: SLS
FRAME ID: 7220
NEXT FRAME ID: 7230
BACK FRAME ID: 7210
ALT TAG:
GRAPHIC/AV:
(U) Image of Technical Character sitting at
a desk
Topic
(U) Next Step
Home | Exit | Glossary | Back | Next
Page Classification
TOP SECRET//COMINT//NOFORN
Screen Number
20 of 20
(U) PLEASE READ: Important Assessment Information
- (U) You will view the questions in a separate Assessment Questions Document
- (U) You will enter your responses in a separate QuestionMark online answer sheet
- (U) You will have only one attempt to successfully complete the assessment
- (U) Allow yourself sufficient time (approximately 30 minutes) to complete the assessment
(U) To Complete the Assessment:
- (U) Click the link to open the Assessment Questions Document(note)
- (U) Go to the VUport SumTotal Content Player page, click on the Assessment link, and follow the
instructions to complete the required exam
note: Comment [SLS1]: Please make this a link that will open the Assessment Question pdf for Analytical Personnel (we will actually connect the link later).
(U//FOUO) (OGC Attorney): The final part of your trip will be to successfully complete the assessment for the course. Please be aware that for the
assessment you will view the questions in a pdf file and enter your responses in a separate QuestionMark online answer sheet. Please be sure that you
open the .pdf with the questions first before opening the QuestionMark online answer sheet. You will have one attempt to complete the assessment. Please
allow yourself sufficient time (approximately 30 minutes) to complete the assessment.
(U//FOUO) Please click the Assessment Questions Document link to open the .pdf question file and keep the window open. Then go to the VUport SumTotal Content Player page, click on the Assessment link on the left, and follow the instructions to complete the required exam.
TOP SECRET//SI//NOFORN
Page 30 of 30