What's Happening with Metadata

Open PDF
Creating agency: NSA National Security Agency (US)
Document date: 2004-12-13
Type: SIDtoday
Pages: 2
Genre: newsletter
Banner:
Classification: SECRET SI
Dissemination: -

A description of SID's Metadata Strategy and the plan to implement it.

Long Description:
This SIDtoday article describes SID's COMINT Metadata Strategy, explaining that metadata refers to information about a communication rather than its content. It outlines the end-to-end vision including a Global Metadata Service, automated analysis, tailored presentation tools, and feeding target metadata to collection systems. It also details the first six months of implementation work focused on Digital Network Intelligence, including DNI contact chaining through MAINWAY, incorporating event data into FASCIA, and pursuing new storage approaches like CONDENSER.
Programs:
MAINWAY, FASCIA, CONDENSER

People mentioned:
-

Countries:
-

Tags:
metadata, comint, DNI, contact chaining, data acquisition, strategy

Identifier:
2004-12-13_SIDToday_-_Whats_Happening_with_Metadata

PDF SHA-256:
25dde0c35179f808edda6ff524426faf3203f66bf0ce9089165c2897012ea648

DYNAMIC PAGE -- HIGHEST POSSIBLE CLASSIFICATION IS
TOP SECRET // SI / TK // REL TO USA AUS CAN GBR NZL

SIDtoday

(U) What's Happening with Metadata

FROM: [REDACTED]
Implementation Lead, SID COMINT Metadata Strategy
Run Date: 12/13/2004

(S//SI) "Metadata" refers to information about a communication, rather than the actual content
of the communication. For example, this includes data used to route the communication, details
needed for billing, tracking or authentication, formatting, etc. All of the SIGINT System's wide-
ranging activities to collect, analyze, present, and use COMINT metadata are summed up in the
SID Metadata Strategy.

(S//SI) For SID's Deputy Directorate for Data Acquisition (DA, S3), the Metadata Strategy goes
beyond the obvious requirements for DA to develop and access metadata: DA is recognized as
playing an important analytic role and as such is a critical customer of the Strategy, as well as a
provider. It is also important to recognize that no element of the Strategy belongs to an
individual line organization within SID -- implementation of all of its components must be
orchestrated across the many stakeholder organizations.

(S//SI) The end-to-end vision of the Metadata Strategy includes:

  • A Global Metadata Service that delivers all the metadata necessary for SID's analytic needs;
  • Automated analysis that both frees the analyst from repetitive tasks and discovers potentially lucrative information;
  • Tools, tailored to an analyst's needs, for presenting metadata information; and
  • Making metadata associated with targets and technologies immediately accessible to the collection systems, for constant improvement of the quality of COMINT.

(S//SI) During the first six months of the Strategy implementation, the lead team has focused
on areas related to Digital Network Intelligence (DNI), specifically target-related metadata. For
example, we are:

  • Developing a new DNI "rich" metadata architecture and a strategy for achieving the Global Metadata Service;
  • Merging tasking interfaces;
  • Creating DNI contact chaining through MAINWAY ;
  • Incorporating DNI communication event data into FASCIA ; and
  • Pursuing new storage paradigms (e.g. CONDENSER) that meet wide-ranging needs.

(S//SI) More broadly, work continues across SID on everything from link and network
characterization, to advanced analytic techniques in research. There are four full-time members
of the Strategy team, a larger "core" team working on a wide variety of implementation aspects
and guiding the strategy, and others working the development and advancement of analytic
methods. Details of the Strategy can be found at " go metadata " on NSAnet. The team can be
contacted via email at "DL METADATA".

"(U//FOUO) SIDtoday articles may not be republished or reposted outside NSANet
without the consent of S0121 (DL sid comms)."

DYNAMIC PAGE -- HIGHEST POSSIBLE CLASSIFICATION IS
TOP SECRET // SI / TK // REL TO USA AUS CAN GBR NZL
DERIVED FROM: NSA/CSSM 1-52, DATED 08 JAN 2007 DECLASSIFY ON: 20320108