Write Right: A Note on Validity Wording (repost)

Open PDF
Creating agency: NSA National Security Agency (US)
Document date: 2005-07-15
Type: SIDtoday
Pages: 1
Genre: newsletter
Banner:
Classification: UNCLASSIFIED
Dissemination: FOUO

(Repost) A reader asked the author about whether the words "possible" and "probable" should still be used to indicate 20 percent and 80 percent confidence, respectively. In the past, the signals intelligence Reporters' Style Manual suggested terms to indicate various levels of confidence, but today "the Reporting Board recommends that reporters use validity terms in a way that they themselves are comfortable with and can defend if questions arise about their reports."

Long Description:
This SIDtoday column (a repost) addresses a reader's question about whether SIGINT reporters still use terms like 'possible' and 'probable' to convey confidence levels of roughly 20% and 80%. The author notes that past attempts to quantify these validity terms, including a scale in an old version of USSID 300 and a 1985 SIGINT Reporters' Style Manual, sought uniformity but conflated distinct skills. The Reporting Board now recommends reporters use validity terms in a way they are comfortable with and can defend, while remaining consistent within a report.
Programs:
-

People mentioned:
-

Countries:
-

Tags:
reporting, writing, style guide, validity, confidence levels

Identifier:
2005-07-15_SIDToday_-_Write_Right_A_Note_on_Validity_Wording_repost

PDF SHA-256:
813e7312015b0c39551641927544edc892d11cf7d3f2611565411fd9bb1d20e3

DYNAMIC PAGE -- HIGHEST POSSIBLE CLASSIFICATION IS
TOP SECRET // SI / TK // REL TO USA AUS CAN GBR NZL

SIDtoday

(U) Write Right: A Note on Validity Wording (repost)

FROM: [REDACTED]
of the Reporting Board (S12A)
Run Date: 07/15/2005

(U//FOUO) A longtime reporter asked a more detailed question relating to the column on
"possible" and "probable" : "In years past, SIGINT reporters would use [these words] to convey
confidence levels on the order of 20% or 80%, respectively. Beyond correct grammar usage,
does contemporary reporting still use those expressions to suggest confidence factors?"

(U//FOUO) Our correspondent is right about past attempts to quantify those terms. A Reporting
Board member recalled that a scale was specified in an old version of USSID 300, and produced
a 1985 version of the SIGINT Reporters' Style Manual with a table showing A through D Validity,
a numerical equivalent of certainty, and a list of words suggested for each level (B-val:
"probably," "apparent"; D-val: "suggests," "tenuous," etc.). Apparently (oops, our information
was A val, so no validity wording required) this codification resulted from a desire to conform
with the same scale used by linguists in transcriptions and translations -- a case of comparing
apples and oranges. Determining what someone said and what they meant, or how other factors
affected the situation, are very different skills.

(U) Official attempts to insure uniformity are often motivated by a desire to make intelligence
assessments completely objective and certain. The usual result, however, is something like the
scene in the movie "Dead Poets Society" where the teacher reads from a textbook that outlines
the two-axis scale of qualifications necessary for a poem to be considered "great." Such systems
distract from the ability to judge a report.

(U) The Reporting Board recommends that reporters use validity terms in a way that they
themselves are comfortable with and can defend if questions arise about their reports; it's
particularly important to be consistent within a report (e.g., don't toss in a "possibly" for the
sake of variety when you've been referring to something as "likely"). Yes, there have been
recent rumors of high-level discussions that raise the question of how to quantify everything
possible in an intelligence report, but we believe that "not everything that counts can be
counted, and not everything that can be counted counts."

"(U//FOUO) SIDtoday articles may not be republished or reposted outside NSANet
without the consent of S0121 (DL sid_comms)."

DYNAMIC PAGE -- HIGHEST POSSIBLE CLASSIFICATION IS
TOP SECRET // SI / TK // REL TO USA AUS CAN GBR NZL
DERIVED FROM: NSA/CSSM 1-52, DATED 08 JAN 2007 DECLASSIFY ON: 20320108