PROJECT TREASURE ISLANLD EXPLOITATION OF OPEN SOURCE SLAVIC PUBLICATIONS
Document Type:
Collection:
Document Number (FOIA) /ESDN (CREST):
CIA-RDP81-00706R000100230035-8
Release Decision:
RIPPUB
Original Classification:
S
Document Page Count:
25
Document Creation Date:
December 23, 2016
Document Release Date:
December 11, 2013
Sequence Number:
35
Case Number:
Publication Date:
October 12, 1948
Content Type:
MEMO
File:
Attachment | Size |
---|---|
![]() | 1.66 MB |
Body:
Pw- elir-roi-A- 11-
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
IA-R D P81-00706 R000100230035-8 j MP EteelitiVe Registry
es- /3/f
OCT 1 2 1948
itSgOitati.alg FOR: Director of InteLligence
Headquarters, ',Tilted States Air Force
SUB.h;CT: ereject i'ressere eriend (Fxpletteelen er leen
Source elavic eublications)
1. Refereace your eemorendum, saae ueject, dated 20 September,
the Treasure Island project has been reviewed as reveeted.
2. Althotteh your three quetitio.ls are concise ane logically
acLiressai to tele Agency, the ?mewled plan of operation, co contained
In your enclosure, isnot sufficiently specific to eereit either erief
or categorizal replies to your curies. The comments attached as Tab A
point out certain ineoneistencies in the project, ane sone or the
prOblOMS WhiCh Maild arLOO if the plan were implemented in its present
form.
e. The following provitional answers are submitted for your
consideration, subject to the qualifications of paragraph 2, above.
a) "Will the Air Force be duplicating similar projeete
being conducted by other agencies?"
If the scope of ehe project is as extensive as paraeraph
4r, page 10 of the brier would indtcate, the enemy is in the
affirmative. Ir the definition of the pertinent iftformation to
be extracted is limited, as etated in paragraph 44 of the brief,
to "the fields of economic and iudustrial informaeion related to
strategic veleerability, technioal air iftformetion and air arm
and civil air information, biographical air irforustion and air
geography, *the answer is still in Ube affirmativo eince Foreign
Uocueents branch, CIA, is ereeently extracting irom current
Russian neweeapery and periodicals information-wherh-falls into
these categorise.
If it were presumed that the 7reasere leleed PrOect
would, on the other hand, make use of roroign Pocuments ':e.anon
erase ?attracts and the Joint Press eeadieg Service Presa Summary
iiriRpIcifation of the Foeiet prees, althouge not under Alr
igenog control, then duplication would still exist in the proposal
(paragraph 5) that the Army Library handle current periodicals and
that the Library of ecngress handle "government periodicals."
Inasmuch as all Soviet periodicals are eovernmant periodicals, the
distinction is somewhat illoeical. eevertheless, since Foreign
Doc.attents Branch is at present abstracting all periodicals that it
is possible to get from the rasa, duplicatioa would necesearily
result.
Declassified in Part - Sanitized Copy Approved for Release a 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 LILU 1L
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8) IIP
Although the extent of air geogriehe ifs not clearly defined,
it is believed that in the exploitation of balite information on
this subjectthere would be some duplication vith the work done
tYY the Array fte Service.
rt in possible that processing oe the baoklee =telt delicate
some of the work done oy the Inter-departmental Committee for the
keluisittnn of 'oreign euhlicatione end the tore. en economic Admin?
istration during the ear, and that ehionLems done ee the Liffice of
tntereetional Trade, Deddrtment of Commerc-, and the Intellieence
Devi/Lon, V006, especially am contained in the latterve war-time
publication entitled eInformetion from the europeen eress.e German
material, already processed kV CIA, also conteins the results of
exploitation of etwever b]vie.publications and captured doeumonts
for ineustrial and SCOnOlda inforsevion.
einally, it is Assumed that tne proposed project would be
coordinated wiun erojtot 307-t ef the esrausiot1cs1 Churt ervics
nad with the extousive abetraetine et fersien ate techeical
puolications as carried un by e-2, AMC (Wright )ield), to avoid
duplication within the Department of the Air Poses.
erfth the Air Force be operatine in its field of dominant
interest?"
In *newer to this, it muet be stAed that the exploitatioa of
Glen seurcemotertel Involving tile eeleetion and extraction of zilch
beeio informaLion as exists inehreign publLeeiene.eannot, with
certain to.naisal exceptione, be said to lie within eey ono field
of dominent interest. A pub1iano4 1teaon tin, construction of new
sten factory in the ussit in of Interest to C/A and other intell-
igence ageecies as well as to the Air Force. Deminent or deoert-
tentml interest lies in the interpretation, analysis and use of
the raw informat4on. Aecordingly, it o*i. only be stated that by
itr very nature, this tyee of operation must to of cencerm to all
the IAC seencies.
o) VA final queetien asks: wWill such a. project lead to
unheeltey coapetition for trenslatorsiet This is gleaned by a state.
sent, in pareeraph 3 that only lo* order non-technIcs1 translators
are envisioned.
tn ecnnection wite the latter, a queatien ariees as to how
technical. air xnformatIon (paragraph los of tee brief) will be ex-
tradited by non-teohnical traaelators. It is believed that experience
will show theL tee *Aployment oi really low order tronelatore is
inefficient, time.constaaa, QZ3 costly. This has teen recoenised
in the preperetion or the tentative T/0 (Annex /) mach cella for
22 P-40e, 14 P-ale, etc. Trailalators of such grades are considered
by CIA and the Civial eervice Commies-tor: to be of extremely high
calibre. Thus, the administration of the proposed project would be
recruitieg the best-trained lineuiste it could find, which then put
-
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11 :
CIA-RDP81-00706R000100230035-8 unkipvio Mu. n
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
in the field another competitor for experienced and qualified
linguists and translators. Experience has shown that for every
low grade translator (1.e.? CAP-5), one qualified and experienced
tranelaeor is needed to check and correct the work, and in the end
less time wonlA ec spent if medium grade translators were hired.
The answer is therefore mainly affirmative, in that *competition
for translators" would result. nether or not this comeetition
would be "unhealthy" would neeend on whether a coordinated recreit.
:sent plan could be worked out with other agencies.
It is believed that the competition for translators might be
less serious than the competition for sources and source materials,
La view of the difficulty of obtaining even one copy of many current
USSR publications in Moscow.
4. The opeortunity to comment on the proposed project is appreciated
by this Agency, and if you should desire further discussion or clarification
of any af the points sent_ened above, a conference between the appropriate
branch chiefs of the CIA end the Directorate of Intelligence can be
arraneed at your conveeience.
BRIGADIER GENERAL. USA
4444444. DIRECTOR
LAD:abc
Di04464140n
cc: Signori:: Copy
Central Records
00 Please return to 2 A 116,1ards te Docks
FDB
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 t
50X1
_
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11 :
CIA-RDP81-00706R000100230035-8
Director of Central Intelligence
Assistant Director for Operations
Air Force Project "Treasure Island" (Exploitation of Open Source
Slavic Publications)
1. The "Treasure Island" project, as proposed by the Department of
the Air Force and forwarded by memo of the Director of Intee3igeoce, USAF,
dated 20 September 19, 48 has been studied by this Office and Foreign Docu-
ments Breneb.
Although the memorandum of transmittal limits the project to fit
program to extract basic air intelligence information from Slavic publications
in the Library of Congress*, and proposes "not a super extracting agency,
but a modest effort in the air intelligence field", the Treasure Island brief
discusses the larger problems of coordinating the proposed effort with other
government agencies which are active in the field of processing foreign
publications for intelligence information. It also suggests an allocation
of sources and division of labor between the Library of Congress, the Army
Library, and CIA, and mentions other organisations, such as the Aeronautical
Chart Service and the Britith JIB as possible participants in the over-all
program. It recommends the etahlishment of a Basic Information Section
in the Directorate of Intellieence USAF, to supervise a service for the ex-
traction of information from Slavic open source materials, authorised to
negotiate a contract eith the Library of Congress for the processing of
current and backlog material. In addition it states: "this administration*
to be located in the library of Congress, would control procurement of
materials, maintain Liaison with the Acquisitions bivisioc in ie Library,
keep a central file, and publish the extracts. The administration would
control the various extracting units, lo-ated in the Library of Coneress
and in other government agencies. The work would most advantageously be
divided op asach a manner that each participating 44e.ncy would handle
One maaor category of open source 'materials."
It is felt that the functions of coordinating and controlling the
various abstracting and publications procurement programs already under-
taken by the IAC agencies and other government departments cannot properly
be assumed by a new and see:ordinate unit of the Department of the Air Force.
The copplex problems of inter-agency coordinations control of procurements
and allocation of effort in regard to open source material require planning
and action on a higher level. Under the provisions of Section 102 (d) 2
of the National Security Act and NSCID 3, Para, 1 a (Basic Intelligence)
such action could more appropriately be taken by CIA.
2. Considered from the point of view of an operating unit (omitting
the function of coordination), the mission of "the Treasure Island" project
is not Clearly defined. It discusses air intelligence requirements (pare
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
_
Declassified in Part- Sanitized Cop?y Approved for Release 50-Yr2013/12/11 :
"
CIA-RDP81-00706R000100230035-8
--.- it
2
4e, p. 10) and yet mention the ailvisability of indexing all information in
order to achieve cLIniacto coveraiie st. that this would be available to another
agency wthieh might wish to participate in the program in the future (pare 4f,
p. 10). It suggests an oilAnization of 76 people to accomplish this uncertain
mission within five years, without relating the proposed workload to the
figures quoted for the present backlog of publications and th,. current and
Mere accessions of Slavic matlrial. It does not define certain tares which
it employs, although any estimate of workload dependa upon the accurate defi...
nitions of each terms. For /wimple, it uses *abstracting* and *extracting*
apparently interchangeably and without differentiation. It also speaks of
Slavic publications of ail kinds without olariiying whether this includes
material iroo al Satellite countries or Slavic countrioa only (omitting
Btak:ary end Finlane). It farther mention intelligence exploitation throutths.
out, yet would place the major portion of the operation under contract with
the Library of Congress, a non-intelligence agency and the second largest
share of the operation under the Army Library, also a non-intelligence unit.
? 3. Accordingly, before an eetimate of the work load can be made, the
following premises must be established in line with the general tone of that
accomrlishment is Oesiredt
a. That all intelligence material will be extracted except political
and sociological..
b. That extracting or abstract.tng as used in thc Audi means the
reporting in ieiglish or all information of intelligence vAue appearing
in all availaLle Slavic lancuage publications.
c. That Slavic publications are presumed to include only Polish,
Ukrainian, Bulgerian, Serbian, Croatian, Slovenian, Slovak and Bdhemian
in addition to Ritalialls and will exclude publications in the some one
hundred. and tea (110) nowatilavic languages used in the MM.
4. That all information of intelligence value will be indexed,
orosaisindeaced and filed.
e. That backlog figures as given in the study aro accepted.
f. That all information extracted will be published and disas
nominated.
g. That uncleared personnel would be authorised for use in the
operation.
4. Based on the above premises, the following figures can than be com-
puted for the involved,
a. Baeklog plank
(2) Newspapers (100,000). Experience has shown that the average
extractor can cover five Slavic language newspapers per day. There..
fore, for 10Q300 newspapers over a five-year period 17 people would
be required.
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
-;IA-RDP81-00706R000100230035-8 .?_
_ 4?
Declassified in Part - Sanitized Copy Approved for Release 6-50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 r
- 3 ?
(2) periodicals (30,000). The average Slavic periodical
is estimeeed to contain 80 pages. To read and extract the in-
telligens* information from the average periodical *old require
eight days on the Weis that the extra:tort:an cover 10 peps a
day. To: the backlog of 30,000 periodicals than 200 extractors
mould be required.
(3) Books and othermblications (20,000). Meperienes has
shown that prObtay only _101: or 2,006 of this backlog would be of
intelligence interest. Since the average book mast be considered
to have 250 pages and for the books selected approximately 50% on
the average is worth extrecting, the average linguist should
savor a book in 25 deo. Therefore, h4 translators mould be
needed for this phase.
b. Current publications
(1) leespapersi For an estimated 80 aliment Slavic news..
papers on the basis of five newspapers per tur per person, 18
extractors would be required.
(2) Periodicals: ale estimated that at least 140 Russian
and 100 Giber Slavic 'language periodicals would be processed of
'high 25% mould be a-monthly. On the sane basis as used inies(2)
above 76 linguists would be required,
(3) nooks and other publication's An estimate of current
available Sfavfo Looks and publfostions of intelligence interest
would plum the Liguria at 75 a month. On the basis used in 10(3)
above this phase would require 85 people.
44 For the other phases of the operation, experience nae sheen
that the Winging numbers of personnel would be required. Supervision
and direction $9 intelligence *Moors. Rough..draft typing 50
typists. Screening analysts to sort all publications - 20. Sditeriel
and reproduetion 104. Indexing, orouwindexing, filing and searehi.
ing - 80. Administration - including personnel, supply and services
and correspondence files 25.
6. In the fallowing figures
show that a total of
summation,
770 people would be required*
Linguist extractors
440
Supervisory
59
Bditorial
104
Typists
SO
Files
80
Warners
20
Administrative
778
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 r c ii
AFOIR-CO-6
AEMORANDUM
SU3TeCT:
HEADkOARTERS UNTIED STATES AIRORCE
4AS.qIN3TON 20 Sep 1948
FOR 2.HE DIRECTOR OF CENTRAL INTELLIIENCE
Project Treasure Island (Explitation of Open Source
51avic Publications)
1. Considerable preliminary discussion ha a taken place in
connection with a program designed to extract basic air intelligence
information from Slavic publications in the Library of Congress. The
Air P'orce has assigned the name "Treasure Island" to this project.
2. Inforual discussions have given rise to the following
questions:
a. Will the Air i-lorce be duplicating similar projects being
conducted by other agencies?
b. Will the Air Force be operating in its field of dominant
interest?
c. 4111 such a project lead to unhealthy coelpetition for
translators?
Z. In view of the fact that this project is designed for the
procurement of air inforfaation it is believed that the answer to 2 b.
above is in the affirmative. However, it is considered that the Central
Intelligence Agency is the proper medium through which to arrive at
answers 2 a and 2 c. In this connection, only low order, nontechnical
translators are envisioned. This nucleus of translators would tend to
broaden rather than narrow the field. Yoreover, the intent is to sat up
not a super extracting agency but a modest effort in the air intelligence
fle1d.
4. A brief of the proposed project is inclosed. It Is requested
that such comment be made, as you consider appropriate, in connection
with paragraph 2 above.
1 Incl
Treasure Island Brief
C. P. CABELL
Yajor Jeneral, USAF
Director of Intellience, Office of
Deputy Chief of staff, Operations
_
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11 :
CIA-RDP81-00706R000100230035-8
7IDeclassified in Part- Sanitized Copy Approved for Relea-ser?d 50-Yr 2013/12/11 :
A-RDP81-00706R000100230035-8 r
ie il ol?
5. It is apparent from the above cesenstatione that the 50 abstracters
proposed for the projest (para Ise) or the tentative T/O of 76 persons
(Annex I) would be inatiesteate for the task. The 50 abstrastors egad
seareely do more au sake bibliographies and translate headlines old
tables of contents in five years, and to upset them to handle ourrent
books sod government, reports sinultanseuely would be unreallatie.
6. It nut be coneluded that the projost would be limited to *the
fields of erronsate and industrial information related to strategic valnerer
batty, technical sir Information? air ens and civil air Informations bie.
graphleal air infuriation, and air geography,* although the next paragraph
(4f, p.10) inetteates a asch wider scope of subject natter. With regard to
the statement, It would be a good walling point to have all the iatormation
indexed and crose-indexad se that extrasts of any kind can be made, two
quartieu arises
a. Does this OM that information would be indexed previous
to the extracting, is., using linguists for indexers?
b. Does *all the informations neon
ill all information from the limited eategories above?
2 all information of intelligens* wane?
3 all information?
7. The fellordng minor points in the Treasure Inland study seem worth
mentioning as sontradietory, lasseelarate, or open to disagreements
a. Pare Pls, (P. _6) mantiens the leek if flow of informatien
al *pea sours, but pant to ()), p. 6, OINSPISASS of the volume of
the loseaseerdinated digests* at present issued by various agensiee.
b. Pe_piLN..21,1_2.0_ states that Most of the estrasts are
astually? piasso Mow with air intelligence require-
ments. Many digests, espesially the Daily Reports en Foreign Mite
*readouts, attempt to reproduce current nen and promos.** but
eensistemtly calit intelligence data.* aenitored industrial and
workmate information is invariably insluded FRU in this publi?
cation within the limits of space and with regard to the relative
Imports's** of the information. FBIB is at present providing all
mdisearde* containing such material not published in the Doily
Report direst to the Strategic Vulnerability Branch. The Foreign
Domments Branch, 0Ia, *doh abstracts foreign periodicals and
newspapers en ropiest, his not reseivod any solution direetives
free the strategies Vulnerability Branch stating air intelligens)*
requirements in this field.
0. Para 20014 P. 6) due met take into asennt the resent
astivities cg Foredo Doeumente Branch, CIA, with regard to books,
nem etc.
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
5
ut? Pare ,414(P. 9) is imeorrest In stating that the Library
of Congress iithe 'government's purchasing agent for fornypt publio
aldose*, sines prosuretent of suet, material abroad is handled by
the State Departmont.
*Ai Pea WA fr. 9). The method of extracting by entering the
istormation on u&ouh shoots with s limited number of pertinent as
times is thought pratioable only for target data and by no meal
applicable to the wider field of istelligense. At least 3/14 of the
Wort used in exploiting theme decussate would be wasted by this
method. A ate* strew of information reports flowing into the
hands of wellsqualified anskyste as the result of definite anew.
ties directives is believed to be the met effigies% method of
hendling foreign published material,
8. Conclusions t
a. The necessity for adequate intelligelos expleitottion of
foreign publications to nest the specialised requirements of the
Dugouts's% of the AV Fero*, and 11111p01114.4 those of the Strategis
Vulnerability Branch, is dinonetratod by the isTreaunuse Islands paper.
It ie evident that the situation has hitherto been unsatisfaetory.
If snob requirements had, however, been submitted to CIA end the
desired fors indieatedit it is possible that the oritieism isplied
in pars 2b and a of the brief would sot be valid.
b. The study attempts to find a relation which 101) ovoids the
setting-op of one Andependat sup. ting agency; 2) whines a
meximon of **operation from sedating agensias 3) provides facilities
for the sarryinvent of mwoh extresting sonless as are necessary if
a somplato average of open scum materials is to be ashieved0
e. It seemess the function of interagency coordinatien and
postulates a preliminary survey of Boum" and sours* materials ',blob
suet be made before a satisfactory plan for division of labor between
participants can be evolved. It states 'Silk a prelladmary job mast
seeds be done by the Lilting of Congress whieh would have to be given
a contrast in order to enable thee to eceplete their index of Slavic
materials and to as fell use of the *lion Catalogue*.
d. It confuses the results to be produced by this prelimimary
sump' group in the Library of Camgrese with the body of extracted
basis air intelligens* information required by the Strategis Valuers.
laility Breaseh, end with the solution of the problem as indieated in
Para Lle above..
e. In view of the backlog figures and workl.oad ealoulations
outlined above, it is believed that the proposed Table of Organisation
of 76 people for the Library of Ccmgress Unit is unrealistic.
GG0ALTIVIAD:13C/H13D
nrt: vns
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12711-70. B CAM
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 r
TREASURE ISLAND
THE PROBLEM
1. To organize an extracting and digesting service to exploit for
Air intelligence purposes open sources, including Slavic publications of
all kinds.
HYPOTHESIS
2. The need for intelligence materials and open source information
will become increasingly acute.
DISCUSSION
3. A very large portion of information pertinent to the mission
of the Air Intelligence Division is available in open source materials.
The intelligence mission cannot be accomplished in a satisfactory manner
without a systematic and thorough exploitation of unclassified publi-
cations, such as books, periodicals, newspapers, foreign government
handbooks, broadcasts, atlases, etc. At present, little exploitation
is being carried out although the source materials are available in
the United States. Consequently, a great deal of pertinent information
is unavailable for purposes of air intelligence analyses. (See
Appendix A).
4. The extracting service would have to be financed, yet cost re-
quirements cannot be estimated at this juncture, because it is not known
which of the existing facilities can be brought into the scheme. It is
clear, however, that the investment required to finance Treasure Island
will be small, at least in relation to its usefulness. It Is believed
that, within a few years, it will be possible to say: 'Never before was
so much intelligence gained from so small a cost.'
CONCLUSIONS
6. At the present time the Air Intelligence Division does not
receive basic information from open sources either in sufficient
quantity or in a quality suited to its needs.
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 r IP
itit4?1
6. The satisfactory accomplishment of the air Intelligence
mission requires a coordinated effort by the Directorate of Intelligence
and other agencies for the exploitation of open source materials.
7. The organisation of such an effort requires the setting-up
In the Directorate of Intelligence of a special unit, tentatively called
Basic Information Section. The extracting service can best be started
through a contract with the Library of Congress.
RECOMMBNDATIONS
S. That a Basic Information Section be set up in the Directorate
of Intelligence.
9. That the Basic Information Section be instructed to set up and
supervise a service for the extraction of pertinent information from
Slavic open source materials.
10. That the Basic Information Section be directed to negotiate
? contract with the Library of Congress in order to have the Library
do preliminary indexing and searching, and in order to start the unit
processing current books and the backlog.
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
APPENDIX
INTELLISENCE FROM OPEN SOURCE MATERIALS
INDEX
DISCUSSION.
The Value of Open Source Materials
Current Exploitation of Open Source Materials
Remedies
Results of Discussions with the Library of Congress
Open t4uestions
Basic Information Section
Academic SOUTOOS of Intelligence
ANNEXES
Annex I - Chart, Open Source Procurement
Organization
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @_50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
APPENDIX PIA"
INTELLIGENCE FROM OPEN SOURCE MATERIALS
SMEARY
1. Open source materials are of great value to intelligence.
A great deal of valuable air information can be culled froa publics.
tions, such as books, periodicals, newspapers, broadcasts, and gov-
ernment reports.
2. At present open source materials are inadequately exploited.
The Air Intelligence Division does not obtain the information con-
tained in such materials nor Is there an organisation which is
extracting air intelligence data that are available in such materials.
S. There is a great need for reorganising methods and procedures
for the procurement of open source intelligence. Such a reorganisation
requires the setting-up of a Basic Information Section in the Direct*
orate of Iotelligenoe; the setting-up of an Administrative, Piling
and Publishing Section in the Library of Congress; the establislhment
of procurement unite in the Library of Congress; the creation of an
extracting unit in the Library of Congress; and a coordination with
extracting and abstracting units in the army, the CIA, and other
government agencies.
7fritsipur
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
)eclassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
IA-RDP81-00706R000100230035-8
?
Now
APPENDIX "A*
INTELLIGENCE FROM OPEN SOURCE MATERIALS
DISCUSSION
1. The Value. of Open Source Materials
a. Intelligence work is based on two different types of
materials: open and classified. Classified materials include those
which are originated or processed by United States governmental
agencies and which are kept under strict security restrictions. Some
these materials are obtained by secret means. In most instances, they
report on facts and developments which foreign nations want to keep
secret. Among the open sources are those which are originated by forel
governmental or non-governmental agencies, to which the originator does
not attach security restrictions. These materials can usually be bough
In the open market or obtained without too many difficulties. They in-
clude magazines, newspapers, books, government reports and documents,
broadcasts and news picture..
b. In customary intelligence routine, great stress is laid
on working with classified materials. The importance of the classified
materials cannot, of course, be mlnimized in any manner; a large per-
centage of significant facts cannot be gathered except through secret
sources. Yet, the two types of source materials complement and supple-
ment each other; taken singly none of them gives the complete picture.
Despite the fact that classified intelligence documents will be most
profitable if they are correlated with open source materials, the value
of the open sources is often underrated. Only small efforts are
made to procure and exploit the unclassified type of intelligence sourci
materials.
Declassified in Part- Sanitized Copy Approved for Release @50-Yr 2013/12/11 :
r?IA ID nosz I_nn7fARM)100230035-8
Declassified in Part- Sanitized Copy Approved for Release @50-Yr2013/12/11:
CIA-RDP81-00706R000100230035-8 st(RET
C. It is sometime
felt that open sources do not cnntain
eny eateries that are worth gathrring. At least, this is supposed
to be true with respect to the open anurces rubliehed by dictatorirl
countries, the cenror allegedly cutting out anything that may be of
use to foreign intellieence services. However, experience with the
Carman censorship during the war showed that even very important
military information can be collected from newspapers. /or examP141,
it was believed that German PIT boats were armed with 20nm guns.
Tnterpretation of a. photograph published in a Carman newspaear stowed.
that these boats actually carried 40mm guns. On the authority of
General ronovan, it appeare that mort of the inforrrtion about the
Carron oil industry err Fathered from newspapers. It may be added
that strategic and tactical doctrines, too, were freely discuesed in
Oman technical publications. For example* the joint employment of
aircraft and-tankr was described as frrly as 1934 by a Omen General
in a book which was easily obtainable all over the world for 02.50;
the tactics which he had outlined were applied by the Germaun through-
out tha aerly caspairns of the second world War.
d. Rowever severe, censorehip in never fool-proff. Censor-
ship 7ernonnel is rarely too intellirert,, ancialmont sever w,11
in-
forred. Very often items are published of wh!eh the sienificance
eecapes the censor. Dercriptions of cities and plants %many give
away some good diner. Obituaries often contain inadvertent references
to person's place of work; advertisementa or propaganda indicate the
output of a elven plant; technical diacuseions of production processes
ecestimes permit deductinns no- to locationa, 'witty and output. The
Russian rrens offers, moreover, the specific advantage that (1) the
labor crews of factortee frenuently send telegrams to Stalin; (7) praise
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Al\
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
COS
is given to specificelle? nnmed rlants whieh exceeded their output
assignment; end (3) criticism is often voiced of production ecbieve-
ments in named fectories. Altb-ugh many of theme itens ere camouflaged,
and incomPletely reproduced, additional informetion from claseified
well tee open ores ueually peri i the cameletion of the etory.
C. eenrorship recuiremeets are thangeeble. Items that are?
eecret now were freely revealed e few years Apo. From ties ts tire,
facts, yuch ts locetions rd typ-e of facto tee, remain more or less
conetentt present-day censorship is not necessarily ea obstecle to
collecting pertinent information. For sweep's, the Rneriane do not
now nublirh infOrnation 'b'ut uranium deposits. Tat the litereture
contnine Trey reference? to uranium depoeito in the raviet Union. Time
an sgain, it was poosible to evaluete claesified reeorts on the dis-
oovs-T of uranium on the beets of previously -published peoloeicel re-
ports; in some instances, it vas forecast where the Ruestnns would soon
start digging for the uranium in Czectollovekie. For that natter,
cnrrent Ruesian eutlicettons occerionelly contein references to 'rare
minerAlse which, nometbeel turn out to be uranium.
f. /Is the specifie field of eV intelligence, there are
severel terg-t cetegorice rhich must needs be worked up on the basis
of open materiele. It to not implied that now useful information on
these categories is being attained from classified sources, but the
fact remains thnt the over-ell picture of these cateeories hes been
gained thraueh open eaurcep, includine tease eerman-captured documents
which hed been veTked up from Emden open publications.
fr. Ile the railroad category, rail trackeee, stations,
bridges, =meth/aline. verde, over-ell tornAgee crried? tyrer of com-
moeittee cnrried, tynee of rolling stock need, caeacity- of locomotives
end freight ears were obtained from open sources. There iv also avail.
- 3
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706 R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
SECRET
able a great deal of informatiot ,bout railroad operations. There
is no information on a few secret rail lines, nor an freight train
time tables, but open information is adequate to list mort of the
importent rail targets and, if necesoary, to pormit the SV !ranch,
without benefit of classified inforattion, to set up rail targets
the destruction of which would greatly impair $ov!et rail capacity.
h. An estimated 75 per cent of the electric power stations
listed in SIT files were idertified on the basis of open materials.
At the present time, the Soviets do not oven to censor news about
power stottone, with tha eoceotion of info ,.ition on grid systems.
The Soviete? usually, announce 'hen o power atation starts operations;
In Fon, instances they go as far as revealing details about generators,
including the places of production, capacitso, plant layout, etc. Neg.
"Alva clues can be obtained about ares which are not mentioned ?Or
example, the Chnsovoy hydro?electric program which figured orominently
in the news un to ebout two years apo, aaparently is no longer commented
%roe. Since . there is information 1-out variouu important ataeric develop?
ments in that area, Soviet ollonce providew sone kind of a confirratior.
I. It is most eurprislno that a great amount of open source
infor-a*.lon is obtained on highly claasified industrial ctogories.
The diecovery of new oil fields is usually reported in the Soviet press.
The British, by oetient research in paperv and periodicals, were able
to ieentlfy about 40 nircraft plants, their locations and
numbers.
3. Soviet papers contain frequent mention of new cities. It
'Will be recalled that, acoordIng to Marshal Rundetedt? the Wean army
ear ereetly handicapped because their maps failed to show newly erected
cities. If the Germans had ruffictently exploited the open sources or
information, most of the gaps in their knowledge of Pussian towns would
have been closed.
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706 R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
Slab
CIA-RDP81-00706R000100230035-8
k. A good illustration of the value of open nource mateeials
is provided by the work done by Jan Scott, the Aaerican engineer who
spent many years in Rusaia. Early during the war the Board of Economic
Urfare put him on the job of collecting open source inforration on
Russia. lith only four female asslatantel Scott produced an 8l5-page
volume itRussia.test of the Volga*. Practically every industrial cate-
gory And all minerals were covered in the document, which also listed
dosene of new cities, raft today, the Scott Report is often used to
great advantage. It contains information ab-ut many plants and places
concerning which no other data are available in SV files.
1. Open sources are indispenseble for over-ell economic and
induetriel analyser. laisleadina and incomalete th:veh Ruseian statis-
tics are they are nevertheless the only available basis for statintical
evaluations of the soviet war potential, tha productivity of individual
industri-s, and the general organisation of the rtviet economy. nth..
out the periodic reports on the progrets of the rive Tear Plans, no
over-all pirtuee of Pordet capabilities and vulnerabilities cool.: be
obtained, despite the fact that no Ansa= statement can be accepted
at face value, but must be thoroughly analysed and checked with other
data.
m. Open materials are equally molded for the analysis of
atrateeicelly vital categories. ?Or example, without unclaseified
basic geographic data such as climate, freesin conditions of rivers,
water depths chemical content of eater, elevations, roads, geology,
etc., it would be vary dirficult to crack the secrets of the
atonic program
r. Russian open sources cantain a great number of photoerap s
and other pictorial materials, ineudina plant layouts. There are
quite a few industrial pictures which could be used for targ.t folders.
There are Also pictUre nroduots which would give clues as
e of Pussien p
5
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 Mir
to output of specific plants and nuality of Russian tochnolog7. There
are numerous pictures of outstanding architectural structures which
would be very veluil3le 8 9 id 911 ..i.flabl* landmarks.
0. It is core'uded that the exploitt,tion of open eources is
not only a very velu'Ille but actually en indisnenneble nart of air ir-
tellirence operv tiers.
2, current rxoloitntinn of Or -uree,iaterials
a. Preliminary surveys have shown that a very large percent-
age Of total Iberian open-rource :',7ate,r-tals are availe:ble in the United
Stetes. In the Teehineton area alone, the Library .,41 Congress plus
veriour othPr !?overurPilt A arenci such as the CIA, Army Library, and
State Depart:I-et have been receiving, during the 13t five to ten
years, at least ?-ne-half? or more, of the Ruesian output in publica-
tions. Large university libraries, such as Harvard, Columbia, Berkeley,
and the New York Public Library also posses conaidernble collections
of 'Russian materials. There are innumerable small but nevertheless
valuable Slavic libraries in the hands of minor universities, special
research organisations, industrial fires and nrivate individuels.
The Library of Congress is now trying to obtain all current Soviet
publications on a regular bAsis.
b. Several g3gencies have been set up to produce bibliogra-
phies, ebstractr and digests fror, these materials. The Strategic
Vulnerability Pranch receives about a closet of such publicati-ns, not
including technological abstracte oroduced by private agencien. some
inforeation ito extracted by FV analysts from English-language publi-
cations issued by the rcrriet government. Prom time to time, additional
infore4tor is Mtn er, fro' th dtgeste published by the 13ritieh Joint
Intelligence Posrd. Recently, the CIA startad the Sovi.et Press Ilbr-
tracts which hold out some ororliee, but, notwithstanding this seeminvly
?6.
Declassified in Part-Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 r ' 4-VIA.Ktri 11.
, . .
. '
large quantity of open source materials there is no flow of information;
there is at best, a trickle.
o. The reasons for this bielly unsatisfectory state of afters
are the following,
(1) The extracts and digests are nosey made for purposes
which are totally different from the mission of the
Air Intelligence Tivirion.
pest of the extracts are actually made by people
unfamiliar with air intelliaence resuirementa. Rally
digests, eopecially the tally Reports on Foreign
Radio Broadcasts, attempt to reproduce current news
and propaganda, tut coreictently omit intelligence
data
(3) The confOelon in the abstracting field haa had the
deplorable coasequence that while many items are re-
produced in most of the publications, there is not,
ba a long shot, a complete coverage of ell the materi-
als that are actually available. Neverthelens, the
sheer volume of these unorganised and uncoordinated
digests is so large that it is very idfficult for the
SV trench to handle them properly.
(4) !title every abstracting service tries to include supra-
sentatire Soviet publications, such as Pravda and
Isvestiva, little attention is given to books, rovern-
wet publications, (for example directories), pictures
armee, Pence a great many of the valuable enurces
are not exploited, thile other soneees are exploited
reverel times over, but each time in a manner not
suitable to the Air Intelligence Divieion
(2)
Remedies
a. A preliminary survey of the situation as well as dcuatons
.r
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 lor
?
With specialists in the abseractine ficle have shown that it would
not be pracLical to organize one big independent super-abstracting
service which could serve all the interests of all the agencies. even
if such a service were practical the setting-up of a epeciaI agency
would require a very 10 .etime. eover, there weule be no certainty
that air force intelligence requireente woule be saLiefied unless,
OX course, the air force woUld be able to exert control Over operations.
b. It would, therefozei be neceesary to make use of the ab-
stracteee units that aireade- exist. An arreleeaent with euch units
would be profitable not only for budgetary reasons but alee because
some oi the units have control over source meter/ele-
c. At the some time, since present extractine staffs are
smaU and overworked, and since a greet deal of tee' reeeired work le
eot being done, the establishment oe new extracting units cannot be
averted.
d. Hence, a solution must ee found leach (1) avoid the
setting-up of one independeat super-extractine aeency; (2) achieves a
maximum of cooperation from ox tin. aeenciee) and (3) provide
ties for the carrying-out of such extractine eervecos as are eeceeeary
if a complete corae of open eource materLais le to ba achieved.
0. Before a satisfactory plan for the division of lanor amoag
the various wouldebe participants in the prot7ae can be evolved, IL is
neceseary as a erellaenary, to determine -viten eources oueet to be pro-
cessed ane to locate the eource materials not now in eacenington but
available elacweere in Lila United States. euch a preliminary job inlet
nee as be done by the Library of Congress *Lich woule; have to be given
a contract in order to enable teem tie coeplete their index of Slavic
atriale and to make full use of th Union Catalogue.
4. Hesitate of Discussions with the Library of Cengress
a In informal discusaions with representatives of the Library
8
Atz4
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 Y 11.
of Coit was determined that an eetractine service could not
function satisfactorily without a aearching unit permanently operating
in the Library, or withoue a routLee channel to the Acquieitions aivi?
sion.
b. It wee thouht adyinable that the Library of Congress
participate in ay extracting scheme that aieht be evolved. The Lie
brary is the government's purchaeing eeeat for foreign puelicationa
and it poesesseaeuhat is probable' the country's largest Ljavic collec?
tion. The Library is the organizatioa moat suited for locating and
loaning operations and it is the beet medium for the camouflage of tbe
entire undertaeing.
0. There was no argumene about the need for a new unit if
the backlog or books and other publications an well a the current
Eleet3810115 of beoke are to he handled. The backloe is estimated to
compriee 20,000 booke, more than 30,000 periodicals arle more than 100,W0
newspapers, not to mentioa the backlog of ot at waterials, such as broad.
caete, for example. It hae peen. tentatively eetimated that euch aunit
would requira aoout 50 extractors and indeetre an 10 CAFte. A unit
of that else could process the backloe in 5 to 6 years, and also handle
current acquieLtions of Cooke and covernment reporte. euch a new unit
voule work most efeicieetiy in the Library of Gongreza. (see Annex 1).
d. . With respect to the actual proceeaing of the materials, it
'would be moat effective if extracts were done on check sheets liettng
a. limited member of i:wrtieent queetions, aeon as those an the terget
inforeationsheets. At the end of each cheek sheet a akort dleeet of
the proceeSed materiel would be appended. The extxact enacts would then
be oalleetoOd and consolidated and pub into a publication, to es issued
at regular, intervals, preferably weekly. The laforeetion 'ovule also be
9
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
Declassified in Part - Sanitized Copy Approved for Release 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
SECRET
44iit .3 'Amami ilk.
so. The discussions suggested the advisability of limiting
the scope of the extracting effort. If, for example, political Jo--
formation were processed, the =tire project meld have toll's very
large in sise, while the expenditure would not be worth the result,
certainly not in so fir 46 the Air Intelligence Division is concereed.
The extracting service could be profitably limited to the fields of
economic and industrial information related to strategic vulnerability,
technical air Information, air are and civil air information, bio..
erashical air information, and air geography.
f, It woe recognised that even within this ilimitaticoe
economy of effort amid be practiced. For exanple, a great deal of
information .may be available on the paper industry, but there might
be no current need for this information; hence, it weued be wasteful
to process and reproduce it. However, since intelligence needs can.
not be anticipated, and since it is conceivable that, for one reason
or another, even the paper industry mey assume inportance, a central
file would have to be maintained in such amanner that, at a monentle
notice, any inactive category can be worked up. It might even be ad-
visable to maintain the file for subjects which hardly ever will become
of interest to the Air Intelligence Division, simply because another
over:upset agency mmy want to participate in the program at a later
date. At would be a good selling point to have all the information
indexed and cromeoindexed so that extracts of +Lay kind ean be made.
g. For various technical reasons, it is believed that the
Library or Congress would be the logical agency to put in charge
of both the actual publishing and the central file. In order to get
the ex:a-acting effort going it would simply be necessary for tne eir
10
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 A
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 r glr
. ?
force to make a contract with the Library of Congress ehich then woad
set up the various activities and units tlined above. It is believed
that once the extracting service has been started, cooperation from
other agencies will be obtained more easily.
5. Open Geeetions
a. Up to this pcee-,t, there is not much roon for eisagreee
meet about the organisation of the extracting servleee. Di ficelties
arise, however, it rasp ct te the eays and rxans by which other
government agencis an private abstracting firms .could, or should*
be bleught into the echeme. It is relatively easy to conceive o.. a
set-up ey which the labor would be efficiently and equitable -Avided.
F,r example, if the Library of Congress would handle current hooka,
government periodical*, and the backlog of periodicals and neespapers*
the Army Library, mhich operates a periodicals abstracting service,
could handle current periodicals. The CIA, which already has made a
start in the field of newspaper abstracting, coeld take over current
newspapers. The CIA also has facilities for radio monitoring and for
the procerement of industrial doc,ments. Contracts coeld e made with
private firms for the erocersing of tec%noleeical and sc1-ritific mere
t rials. Specialized oieanieatioes, such as the Photo Library and the
Aero Chart Service, cold profitable participate in the processing.
The extraeAlne services would have te ??e coordinate with the Air Re-
search Unit at the Library of Coneress. /t mead also be advisable to
arrange for a division of labor with the British JID,
b. Although such an overeall or anization can be cencetved
in theory (See Annex I), it must be anticipated that various adminis-
trative and "political" obstacles will arias. It is obvious, at any
rate, that the setting-up of a coordinated effort on such a?scale will
require a great deal of wore. Lenethy negotiations will be required.
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8
IDeclassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11:
CIA-RDP81-00706R000100230035-8 r
_ IIP
?
Wen after contracts will have been ooncluded, adjustments will Al nicer
gory quite frequently.
6. In sum ups in order to get ? fully satisfactory service
speoialising in the extraction of intelligence from open source materials
and, at the same time, to derive benefits from the research done at
military and eivilian schools* it is necessary to set up a Basis In-
formation Section in the Directorate of Intelligence. This &motion would
maintain liaison with military an civillossehools and control the
administration of the =treating services. This edlirdstratior., to be
legated in the Library of Congress, would control procurement of
%oriels, maistaiaIisison with the Acquisitions Division in the Library,
keep a central Moo and publish the extracts. The administration would
eontrol the various extracting units, located in the library of Congress
and in other government ageneies. The wqrk would most advantageously
be divided up in mush anions? that each participating agency mould handle
one major category of open scums materials
7e She total manpower and money requirements of the scheme Gannet
be estimated at this jamstum bosses* it is net knotnatsbleh =tett%
facilities can be brought into the *shams. An exact budgetary estimate
must wait till the time Then nagotiations with various government agencies
trill haws bees engaged. It is clear, however, that the Investment required
to undertake the Treasure Island scheme will be rolutivaly mail and that
the mousgorial dittielati?? and costa will be minor. The gain in term of
information obtained will, by contract, be very largo. It is more than
probable, indeed certain, that within a few years it will be said that
never before in the history of American intelligence was so staple and in..
expensive an effort needed to produce a, :peat and so valuable a return.
Declassified in Part - Sanitized Copy Approved for Release @ 50-Yr 2013/12/11 :
CIA-RDP81-00706R000100230035-8