Coming Soon! A Tool that Enables Non-Linguists to Analyze Foreign-TV News Programs
Open PDFDocument date: 2008-10-23
Type: SIDtoday
Pages: 1
Genre: newsletter
Classification: UNCLASSIFIED
Dissemination: FOUO
This document introduces eViTAP (Enhanced Video Text and Audio Processing), a fully automated system designed to monitor and translate international television broadcasts. Primarily aimed at analysts who do not possess specific foreign language skills, the tool leverages automated processing to transform open-source media into actionable intelligence.
-
People mentioned:
-
Countries:
China, Russia, Spain
Tags:
OSINT, speech recognition, machine translation, foreign news monitoring, language analysis, video analysis, alerting, transcription, media mining
Identifier:
sidtoday-non-linguists-final
PDF SHA-256:
3bdd20eb870dc9d6ee998a11bccbd7d2f6b2976813fdc3c09695486233d31abf
My notes
(U//FOUO) Coming Soon! A Tool that Enables Non-Linguists to Analyze Foreign-TV News Programs
FROM: [REDACTED]
Center for Time-Sensitive Information (S2413)
Run Date: 10/23/2008
(U//FOUO) Have you ever wanted to use foreign-TV news broadcasts to enhance your SIGINT, but couldn't because you didn't understand the language? Soon you can! It is currently only available to NSOC Desk Officers until logistical issues are resolved. However, the goal is to migrate Enhanced Video Text and Audio Processing (eViTAP) into other areas. Additional information regarding how to get accounts will be announced in the coming year, so stay tuned.
(U//FOUO) EViTAP is a fully-automated news monitoring tool. The key feature of this Intelink-SBU-hosted tool is that it analyzes news in six languages, including Arabic, Mandarin Chinese, Russian, Spanish, English, and Farsi/Persian. "How does it work?" you may ask. It integrates Automatic Speech Recognition (ASR) which provides transcripts of the spoken audio. Next, machine translation of the ASR transcript translates the native language transcript to English. Voila! Technology is amazing.
(U//FOUO) Figure 1: Example of video, native language transcript and English translation
EViTAP(U//FOUO) This all sounds wonderful, but is it easy to use? Absolutely! EViTAP has an intuitive and easy to use browser-based interface. The User Guide includes everything you need to successfully use the tool. It is perfect for the analyst who usually prefers classroom over manual instruction. The interface provides advanced search and retrieval capabilities, real-time fully automated alerting, ability to create clips from videos, ability to edit transcripts and translations, ability to export video and transcripts to PowerPoint, XML and text formats, and much more.
(U//FOUO) EViTAP's capabilities are far reaching, and go beyond the scope of this article, but it is clear that this tool can significantly enhance SIGINT analysis and reporting. Open Source is becoming more significant in the Intelligence Community, and eViTAP is an open source resource that can play a big role in enabling SIGINT prosecution.
(U//FOUO) Want to learn more about EViTAP or other open source resources? Simply type "go AIRS" in your browser window and explore the information there. AIRS, Advanced Intelligence Research Services, provides a multitude of open source and all collateral products and services. EVITAP is a new open source tool AIRS introduced at NSA.
(U//FOUO) POC: [REDACTED]
Published in the Same Report
(9 documents)
-
For Media Mining, the Future Is Now! SIDtoday [pdf]
A number of new "media mining" tools allow analysts to search intercepted content in near-real time, no matter if text, audio or visual. This includes retroactive word-search in intercepted communications.
People: Picone, Joseph“How the NSA Converts Spoken Words Into Searchable Text” - The Intercept ↗ (2015-05-05) · “Finding Your Voice: Forget About Siri and Alexa — When It Comes to Voice Identification, the “NSA Reigns Supreme”” - The Intercept ↗ (2018-01-19) · The Intercept ↗ (2019-05-29) · Froomkin, Dan · Kofman, Ava -
For Media Mining, the Future Is Now! (conclusion) SIDtoday [pdf]
In the future, thanks to Human Language Technology (HLT), an analyst will be able to sort through millions on intercepted phone calls each day "and focus on only the small percentage that is relevant". He or she will also be able to get precise answers to queries such as "Where is the mayor of Baghdad?"
People: Picone, Joseph“How the NSA Converts Spoken Words Into Searchable Text” - The Intercept ↗ (2015-05-05) · The Intercept ↗ (2019-05-29) · Froomkin, Dan -
“Black Budget” — FY 2013 Congressional Budget Justification/National Intelligence Program, p. 262 (February 2012) [pdf]
This excerpt from the Fiscal Year 2013 Congressional Budget Justification (the "Black Budget") details the NSA's financial and performance metrics for "Analytics Modernization," specifically focusing on the transition to high-volume, automated speech-to-text systems. It records the decommissioning of legacy voice processing systems (VoiceRT) in favor of more robust, scalable capabilities aimed at rendering millions of intercepted voice files searchable via text queries and paired dialogue transcription.
Programs: VoiceRT -
“Black Budget” — FY 2013 Congressional Budget Justification/National Intelligence Program, pp. 360-364 (February 2012) [pdf]
The "Human Language Technology (HLT) Research" section of the FY 2013 "Black Budget" details a specialized research project focused on creating "force multipliers" for the NSA workforce through automated speech-to-text, machine translation, and content extraction. With a requested budget of $29.4 million, the project aims to bridge the gap between foundational academic research (via Johns Hopkins University) and the practical exploitation of the volume and velocity of global SIGINT.
Programs: HLT -
Classification Guide for Human Language Technology (HLT) Models (May 18, 2011) [pdf]
This document is an NSA administrative policy document that establishes the rules for what information regarding speech analytics remains public versus what must be kept secret. It explicitly confirms that the NSA possesses automated tools for gender, language, dialect, and speaker recognition, as well as speech-to-text and phonetic tokenization. While the existence of these capabilities is unclassified, the specific data used to "train" the models and the actual identity of targeted speakers are protected at the SECRET level.
Programs: HLT -
RT10 Overview [pdf]
This RT10 overview document is a high-level briefing on the implementation of a real-time SIGINT architecture designed to modernize intelligence operations in the Iraq theater, specifically Baghdad. The project aims to replace legacy, "manual-intensive" processes with a "SIGINT Brain"—a distributed database and automated analytic framework capable of processing over 50 million GSM metadata events per day.
Programs: RT10 · OBELISK · WISPYKNIT · VICTORYUNIFORM · JUGGERNAUT · COBRAFOCUS · MATTERHORN · EXPIATION · VoiceRT · GREENDRAGON · TAREX · KEYCARD -
Finding Nuggets -- Quickly -- in a Heap of Voice Collection, From Mexico to Afghanistan SIDtoday [pdf]
A 2011 article by an NSA Texas analyst describing the deployment of Human Language Technology analytics — including speech-to-text, speaker identification, gender recognition and language identification — to Special Collection Service sites in the Americas and to the Afghanistan Remote Operations Cryptologic Center, with operational examples ranging from tunnel detection in Tijuana to intelligence support in Kandahar.
Programs: HLT -
How Is Human Language Technology (HLT) Progressing? SIDtoday [pdf]
This document provides an operational update on the deployment of "HLT Labs"—a specialized suite of voice analytics designed to automate the discovery of intelligence "nuggets" within massive volumes of audio collection. The document highlights successful field applications in Afghanistan, Georgia, Texas, and Latin America, noting that these tools are becoming "force multipliers" that allow linguists to bypass manual listening in favor of automated keyword searching and speaker recognition.
-
SIRDCC Speech Technology WG assessment of current STT technology [pdf]
This secret document from the SIRDCC Speech Technology Working Group provides a technical assessment of Speech-to-Text (STT) capabilities for the Security Service (MI5) and GCHQ. The report acknowledges that while automated transcription of intercepted speech remains highly challenging, the technology offers immediate "force multiplier" benefits for specific tasks like identifying spoken telephone numbers or keywords. The Working Group recommends continued investment in bespoke training and a transition toward a common system—specifically the BBN Byblos engine—to facilitate the sharing of classified linguistic models between UK and US agencies.
Programs: BYBLOS
Related Documents
-
“Black Budget” — FY 2013 Congressional Budget Justification/National Intelligence Program, p. 262 (February 2012) [pdf]
This excerpt from the Fiscal Year 2013 Congressional Budget Justification (the "Black Budget") details the NSA's financial and performance metrics for "Analytics Modernization," specifically focusing on the transition to high-volume, automated speech-to-text systems. It records the decommissioning of legacy voice processing systems (VoiceRT) in favor of more robust, scalable capabilities aimed at rendering millions of intercepted voice files searchable via text queries and paired dialogue transcription.
Programs: VoiceRT -
New Tool Identifies Non-Productive Phone Numbers (repost) SIDtoday [pdf]
Repost of article on a new tool that helps weed out phone numbers that are tasked for collection but are providing no intelligence value, based on reports showing how much of "each phone number's traffic has been reviewed, deemed relevant, and reported on." The idea is to avoid needlessly "consuming precious SIGINT resources." The tool is part of a larger project called "RAINMAN" to automatically prioritize traffic scanned by language analysts.
People: Curet, NormanThe Intercept ↗ (2017-09-13) -
Human-Language Technology -- Everywhere SIDtoday [pdf]
The best Human Language Technology (HLT) functions "behind the desktop" making sure the analyst receives relevant, filtered information. In the near future, analysts will have more and better HLT at their disposal.
People: Kulman, AnitaThe Intercept ↗ (2019-05-29) -
“Black Budget” — FY 2013 Congressional Budget Justification/National Intelligence Program, pp. 360-364 (February 2012) [pdf]
The "Human Language Technology (HLT) Research" section of the FY 2013 "Black Budget" details a specialized research project focused on creating "force multipliers" for the NSA workforce through automated speech-to-text, machine translation, and content extraction. With a requested budget of $29.4 million, the project aims to bridge the gap between foundational academic research (via Johns Hopkins University) and the practical exploitation of the volume and velocity of global SIGINT.
Programs: HLT -
SIRDCC Speech Technology WG assessment of current STT technology [pdf]
This secret document from the SIRDCC Speech Technology Working Group provides a technical assessment of Speech-to-Text (STT) capabilities for the Security Service (MI5) and GCHQ. The report acknowledges that while automated transcription of intercepted speech remains highly challenging, the technology offers immediate "force multiplier" benefits for specific tasks like identifying spoken telephone numbers or keywords. The Working Group recommends continued investment in bespoke training and a transition toward a common system—specifically the BBN Byblos engine—to facilitate the sharing of classified linguistic models between UK and US agencies.
Programs: BYBLOS