COMMITTEE ON DOCUMENTATION TASK TEAM 1 -- CONTENT CONTROL FINAL REPORT

Document Type: 
Collection: 
Document Number (FOIA) /ESDN (CREST): 
CIA-RDP80B01139A000400060004-0
Release Decision: 
RIPPUB
Original Classification: 
S
Document Page Count: 
25
Document Creation Date: 
December 16, 2016
Document Release Date: 
May 6, 2005
Sequence Number: 
4
Case Number: 
Publication Date: 
January 15, 1967
Content Type: 
REPORT
File: 
AttachmentSize
PDF icon CIA-RDP80B01139A000400060004-0.pdf706.18 KB
Body: 
Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 CODIB-D-111/1.1/4 15 January 1967 U N I T E D S T A T E S I N T E L L I G E N C E B 0 A. R D COMMITTEE ON DOCUMENTATION TASK TEAM I -- CONTENT CONTROL FINAL REPORT Group 1 S-E-C-R-E-T. Excluded from automatic downgrading and declassification. Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 CODIB-D-111/1.1/4 15 January 1967 U N I T E D S T A T E S I N T E L L I G E N C E B 0 A R D COMMITTEE ON DOCUMENTATION TASK TEAM I - CONTENT CONTROL MEMORANDUM FOR: Chairman, Committee on Documentation SUBJECT: Transmittal of Task Team I Final Report REFERENCE: CODIB-D-111/1.1/2, 30 October 1964 1. CODIB Task Team I - Content Control submits herewith its final report and a proposed USIB Content Control Code for CODIB consideration and approval. The substance of the Task Team's Interim Report (T,/l/R-1, 3 January 1966) is incorporated into this final report. 2. The Task Team performed all of its tasks and designed a scheme which it believes satisfies all of the parameters as stated in its Terms of Reference. Incremental implementation should now proceed as recommended in this report. 3. The Chairman wishes to commend highly the members of the Task Team for more than two years of dedicated endeavor in developing this product. The members were: NSA; F L;lA;l IDIA; Mr. Robert Whi and Mrs. Mary Veilleux, Department of State, and CODIB Support Chairman Task Team I - Content Control Group 1 Excluded from automatic downgrading and declassification. Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 U N I T E D S T A T E S I N T E L L I G E N C E B 0 A R D COMMITTEE ON DOCUMENTATION TASK TEAM I - CONTENT CONTROL Final Report Table of Contents Chapter Page I. Introduction .............................................. 1 II. Major Publishers and Item Flow ............................ 1 DIA ..................................................... 2 CIA..... ................................................. . 2 NSA..... ..................... ........................... 3 Department of State ..................................... 3 III. Characteristics of Present Dissemination Systems ........... 3 IV. Review of Existing Codes ................................... 5 V. Design and Development of a Content Control Scheme ......... 10 VI. Developmental Testing of the Content Control Scheme ........ 16 VII. The Proposed Content Control Code (CCC) [Discussion] ....... 19 VIII. Uses of the Proposed Content Control Code (CCC) ............ 21 IX. Effectiveness, Efficiency, and Economy ..................... 23 X. Implementation of the Content Control Code ................. 25 XI. Task Team Recommendations .................................. 27 1. Terms of Reference (CODIB-D-111/1.1/2) 2. Major Publishers and Distribution Points 3. Document Flow 4. Characteristics of Existing Area Codes 5. Characteristics of Existing Subject Codes 6. Area Content Control Design Characteristics Proposed USIB Content Control Code Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 S-E-C-R-E-T - 1 - I. Introduction In accordance with its Terms of Rreference, Appendix 1, the Content Control Team has completed-its assignment. It has: 1. identified the major publishers of intelligence items and the primary distribution points through which these items flow; 2. reviewed existing subject codes with special emphasis on those used by analysts to express their intelligence interests; 3. developed a tentative content control scheme, conducted a series of design tests, and received comments thereon from persons responsible for the production and distribution of intelligence items; 4. completed the-design and development of the proposed Content Control Code whos three. schedules for coding by geographic-political area, by subject matter, and by specifics of an identifying nature; 5. determined potential values and advantages of implementing and maintaining the proposed Code; 6. estimated the type and amount of training necessary for an individual to apply the Code to intelligence items; 7. estimated the performance of the proposed system in terms of_effectiveness, efficiency and economy; 8. recommended procedures for implementing and monitoring content control code applications. The proposed Content Control Code is attached to this report. II. Major Publishers and Item Flow. The Team first addressed itself to identifying the major publishers of intelligence items and the primary distribution points through which these items flow. Listings of the major publishers and primary and secondary distribution points for intelligence and information reports were compiled by the team members for their respective agencies (see Appendix 2). Following team review of these compilations, arrangements were made with DIA, Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 25X1 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Next 3 Page(s) In Document Exempt Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 h. National Intelligence Survey - NIS Areas i. Names of Selected Major Political Areas of the World (Board on Geographic Names) 2. Early in the deliberations it was noted that there appear to exist two conceptuaL poles to which most of these area structures gravitate. These poles represent, on one hand, primary geographic orientation and on the other, primary political orientation. However, none of the systems examined is exclusively oriented one, way or the other. The systems achieve a middle ground; between geographic and political orientation usually on a case-by-case basis. It is interesting to note that where geographic and political boundaries coincide the structures of the systems are markedly compatible. There is an apparent degree of compatibility approaching 50% among the systems analyzed. However, problems of compatibility in structure appear to arise in connection with the treatment of non-contiguous political subdivisions, off-shore islands,-and island and island group dependencies. Variations in nomenclature apparent in existing systems seem to reflect the use of different authorita- tive sources and different dates of information. Factors giving rise to the decision to give an entity its own coding or to treat it as a cross reference included under another coding appear closely related to the purposes for which the particular structure was initially designed. It is also indicative of a need for subdivision of political entities below the country/ dependency level, at least in certain areas. 3. In summation, the area content control problem is not one of simply agreeing upon a certain notation scheme, but of agreeing upon the definition of each entry in the structure itself. For example, should or should not the coding for Italy include Sardinia, Sicily and Pantelleria? Should the coded entry be the Mascarene Islands, or should this geographic entity be divided along political lines and separate codes be assigned to the French overseas territory, La Reunion and the British Colony of Mauritius? Should Ecuador include the Galapagos Islands or should the Galapagos Islands be made a separate coded entry? In essence, should problems such as these be dealt with on a case-by-case basis, or should some general rule be developed and be followed in all cases? It is apparent that the case-by-case basis is the most popular solution and that on such a basis different decisions are made by designers at different times. These differences are frequently based on particular, current needs of the using organization. Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 4. The foregoing considerations demonstrated the need for further study to determine whether geography or political affiliation should be the primary consideration in dealing with an area. For this purpose the Task Team acquired and studied a number of authoritative sources as follows: a. Encyclopaedia Britannica, 1963 Edition with Yearbooks for 1964 and 1965. b. National Geographic Atlas of the World, 1963. c. Profiles of Newly Independent States. Department of State Geographic Bulletin #1, Revisions dated July 1964 and May 1965. d. Status of the World's Nations, Department of State Geographic Bulletin #20. Revisions dated March, 1964 and May 1965. e. Survey of the French Republic, Department of State Geographic Bulletin #4 dated April, 1965. f. United States and Outlying Areas, Department of State Geographic Bulletin #5 dated April, 1965 and Geographic Report #4 same title,dated February 7, 1963. g. Portugal and Overseas Provinces, Department of State Geographic Report #5 dated August 11, 1961. h. Kingdom of the Netherlands, Department of State Geographic Report #6, dated November 30, 1961. i. Kingdom of Denmark, Department of State Geographic Report #7 dated April 6, 1962. j. The Spanish State, Department of State Geographic Report #8 dated June 7, 1962. k. Geographic Regions of Asia: South and East. Reprinted from the Department of State Bulletin February 1, 1960 (Revised). 1. The Middle East, an Indefinable Region. Reprinted from the Department of State Bulletin. Released June, 1964. Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 M. Names and Places in Latin America. Reprinted from the Department of State Bulletin. Released October, 1961. Y:. Geographic Terminology of Europe. Reprinted from Department of State Bulletin. Undated. o. Africa: Names and Concepts. Reprinted from the Department'of State Bulletin. Undated. Also, during these deliberations comments and guidance were obtained from the Office of the Geographer, Department of State and the Board on Geographic Names (BGN). 5. The Team considered many possibilities and studied a number of existing subject codes, finally selecting three established community codes for detailed study and comparison: the ISC which is the USIB-sponsored classification scheme; the Department of State's Classification Handbook which has a "content control" type application; and. the Intelligence Publications Index (IPI), a contrasting broad subject scheme. A draft content control code prepared by the SCIPS Staff was also included in the detailed comparison in order to'benefit from the earlier effort. DIA's Statement of Intelligence Interest was studied with interest from a functional viewpoint but was considered parallel to the ISC in structure. The comparison showed that the four codes had a surprising degree of similarity. The differences, however, provided grounds for considerable discussion and ultimately led to the decision to design a new code. 6. Attached as Appendix 5 is a reproduction of 6 charts originally prepared as working aids for the Team. Chart #1 compares the four subject codes at the chapter or primary heading level. The other five charts compare the four codes at the secondary level; that is, at the next level within each of five principal subject headings. 7. The ISC is a scheme for indexing in some depth, having about 5000 subject entries which may be combined with many modifiers. The scheme is divided into seven principal chapters, including the five common to the other schemes: POLITICS, SOCIAL and CULTURAL, ECONOMICS, SCIENCE, and ARMED FORCES: and two unique Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 categories: COMMODITIES/WEAPONS and TRANSPORTATION/COMMUNICATIONS. The ISC is subdivided at the secondary level by some 50 broad headings used only for organization: of the scheme and not for indexing. B. The Department of State's Records Classification Handbook scheme, as mentioned previously, provides the basis for an official file system. The Handbook is subdivided into seven principal groupings which, like the secondary headings of the ISC, are used only for organization of the book itself. It is distinguished from the other schemes principally by the combination of POLITICS and DEFENSE and the separation of CULTURE and INFORMATION from SOCIAL. Other parochial interests result in the two headings ADMIN and CONSULAR. The scheme has 55 subject headings within the seven groupings mentioned above. 9. The IPI is designed for the indexing of finished intelligence and for this purpose has found it appropriate to have INTELLIGENCE, COMMUNICATIONS EQUIPMENT, MILITARY WEAPONS, and GEOGRAPHY in addition to five others.for a total of nine primary headings. There are 57 secondary headings. 10. The SCIPS preliminary content control scheme shows a relationship to the IPI but has separated as primary headings TRANSPORTATION and ATOMIC ENERGY, in addition to COMMUNICATIONS, WEAPONS and GEOGRAPHY. 11. The four schemes reflect a consensus on the division of information into the principal categories of POLITICS, SOCIAL and CULTURAL, ECONOMICS, SCIENCE and ARMED FORCES, although each has its own unique headings. However, the categories of TRANSPORTATION and COMMUNICATION receive diverse treatment in the four schemes. They are combined into one chapter of the ISC, are both subsumed under ECONOMICS in the State scheme, are split into separate main categories of the SCIPS scheme, while in the Intelli- gency Publications Index, COMMUNICATIONS is a separate category and TRANSPORTATION is subsumed under ECONOMICS. 12. The question of how to handle commodities was even more difficult. COMMODITIES form a chapter of the ISC, but fall under ECONOMICS in the State, SCIPS, and IPI schemes. However, military weapons are separate main categories in the SCIPS and IPI schemes, fall under POLITICAL and DEFENSE in the State Code, and are grouped with the other commodities in the ISC. Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 V. Design and Development of a Content Control Scheme. The Terms of Reference, Appendix 1, contain a list of parameters or characteristics which should be reflected in a content control code. In this Section, each of these parameters is described in terms of operating characteristics encountered in the community. The method selected by the Team to satisfy each of these parameters is discussed in detail below. With this background information in mind, it is possible to evaluate the extent to which these parameters have been met by the proposed Content Control Code.in its final form. .1. The first parameter stated that the proposed Code should encompass all subject areas germane to U. S. intelligence. In an effort to ensure the satisfaction of this criterion the Team reviewed the major existing area and subject codes used within the intelligence community and made sure that the major elements of each could be properly subsumed under a section of the Code. The Team also recognized that analysts of the intelligence community use several different approaches in organizing intel- ligence information. For example, information may be organized by geographic-political entities, by subject categories, and by the names of persons, organizations and things. However, these elements are treated differently by different analysts. Some analysts may use area as a major category with subject headings and names as minor subdivisions, others consider special subjects such as Economics and Communications as major categories with geographic areas and names of specifics being treated as minor subdivisions. Therefore, it was decided that the Code should be responsive to each of these three approaches. In this way the contents of intelligence items can be represented in a manner generally reflecting the needs of the greatest number of users. 2. The second parameter stated that the proposed Code should be applicable to material of all sources and classifi- cations. The Task Team did riot restrict itself to any source or to a,n y classification. However, no effort has been made to ferret out all of those areas of the intelligence community which have a need for content control- Instead, the Task Team has concen- trated its effort on its third parameter which was to design a scheme applicable to the bulk quantity of intelligence items. 3. Although the proposed Code as designed is considered applicable to a wide range of intelligence items, the Team noted that studies and intelligence summaries which usually have des-- Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 25X1 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 S-E-C-R-E-T - 12 - volving place names (which quite often appear in reporting), and location (by geographic coordinates or other grid system). 6. However, many dissemination and retrieval requirements are indicated in terms of geographic regions rather than by specific countries and dependencies. There are also numerous reports issued which may treat selectively on an entire region. Instances were noted in existing systems where geographic regions are defined differently in terms of countries and dependencies involved. For example, Turkey and Cyprus might be placed in Europe or in the Near East, the United Arab Republic in Africa or in the Near East, the Soviet Union-in Europq,in Asia, in both or in neither. 7. For the purposes of content control, it was considered absolutely essential that aggregations such as these be defined in an unambiguous manner. A trigraph coding was developed which indicates the assigned World Region as its first character. The second and third characters make up a unique digraph to indicate specific countries or dependencies. Thus each World Region is automatically definable in terms of the countries and dependencies which comprise it. The countries and dependencies themselves are defined in scope notes. 8. When political subdivisions of countries or dependencies fall in World Regions different from the World Region in which the bulk of their parent state falls, they are given the first character coding of the World Region in which they fall. Thus, the trigraph coding for the Azores, which is a first order political subdivision of Portugal, is NPO since it lies 900- 1200 miles west of Lisbon in the Atlantic Ocean. The rest of Portugal is trigraph coded, LPO indicating that it falls geographically in Western Europe, Note that the second and third characters are PO in both cases. Consequently when all of Portugal is required, the first character can be ignored and selection can be based on the second and third characters. 9. In identifying and defining subjects for content control purposes, a hierarchical scheme was used for study and comparison purposes and as a check on completeness of coverage. The subject categories utlimately selected, although grouped into the following 7 sections, stand independent of any subordination. Section 1 - Government and Politics Section 2 - Social Structure and Cultural Affairs Section 3 - Science and Technology Section 4 - Economics Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 S-E-C-R-E-T Section 5 - Transportation Section 6 - Communications Section 7 - Armed Forces Much time and effort was spent in preparing scope notes and appropriate cross references for each subject category. These were considered of utmost importance in minimizing ambiguity of interpretation and ensuring uniform application, of the codings. 10... Fourteen subject modifiers are provided in the proposed Code. These modifiers allow additional specificity when used in conjunction with the subject categories and keep redundancy in subject categories to a minimum. One set of modifiers is provided to indicate the status (research and development, production, or use) of natural resources, materials, commodities, equipment, and related installations;and an additional modifier is included for import and export data. A second set of eight modifiers is provided to indicate military services. A single modifier is provided to indicate the presence of order-of-battle data and a second single modifier to indicate communist or communist-inspired activities in non- communist countries. 11. Eight identifiers are included in the proposed Code to flag the fact that proper names, addresses, equipment designations, etc. appear in the text. These specific classes of information can be of significant intelligence value and often form the basis for organizing reference files and registers. 12. The fifth parameter in the Teamts Terms of Reference specified that application of the proposed Code should require little index training. In addition to the relatively small number of elements in each part of the code, each subject element is represented by a mnemonic tetragraph and each modifier and identifier with a single letter. Serious consideration was also given to recommending a mnemonic tetragraph for geographic areas but this suggestion was reluctantly discarded because of the desire for compatibility with government-wide standardization efforts and because of the reluctance to discard the usefulness of the two-level hierarchy which is a feature of the recommended trigraphic geographic-political coding. 13. The proposed Code contains general and specific instructions for applying the codings together with examples Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 S-E-C-R-E-T - :L4 - thereof. The scope notes appearing in the various schedules are very specific in directing the coder to the appropriate geographic- political entity or subject category. An alphabetical index of subjects, modifiers, and identifiers is provided to bridge the language barrier that frequently exists between specialized subject matter and the generalized statements of a coding system. A conscientious effort was made to identify all potentially ambiguous entries and provide sufficient clarification to achieve consistent application. 14. The proposed Code is adaptable to machine processing (parameter 6). It does not mix alphabetic and numeric characters. It uses standard characters to separate the various parts and elements of the notations and is therefore suitable for a variety of orderings. 15. The Task Team believes that the proposed Code is practicable to maintain (parameter 7). a. Each geographic-political entity is based on one of five criteria which are relatively easy to apply. Separate codes have been established for: 1. Sovereign states, quasi-independent states, neutral zones between states. 2. Political subdivisions of states which fall in World Regions other than the region to which their capital is assigned. (The second and third characters of the notation are those of their sovereign state). 3. Dependencies of states including islands and is-Land groups. (Where an island or island group is divided politically, this division is respected and multiple notations assigned accordingly). 4. Water areas and international waterways. 5,. Extraterrestrial bodies. Careful adherence to these criteria prevents the code from degenerating into an unbalanced and overlapping set of entities chosen. in an ad hoc manner to meet transient demands. Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 S-E-C-R-E-T b. In defining the subject categories, the Team sought to establish the elements on a uniformly generic level which would give equal treatment to the specialties of the several agencies involved. It is anticipated that future changes will be largely improvements in scope notes, cross references and index entries but not in the elements themselves. Efforts to make the code more specific: by' increasing the number of entries should be resisted. 16. The last parameter in the Terms of Reference stated that provision be made for maintenance and control of the Code. This requirement is covered in Section XI, Recommendation 6. Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 25X1 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Next 19 Page(s) In Document Exempt Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 C-O-N-F-I-D-E-N-T-I-A-L APPENDIX 3 DOCUMENT FLOW (Information as of January 1965) Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 25X1 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Next 2 Page(s) In Document Exempt Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 APPENDIX 4 CHARACTERISTICS OF EXISTING AREA CODES (Information as of January 1965) Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 25X1 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Next 4 Page(s) In Document Exempt Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 APPENDIX 5 CHARACTERISTICS OF EXISTING SUBJECT CODES (Information as of January 1965) Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 C-O-N-F-I-D-E-N-T-I-A-L This appendix is a reproduction of briefing charts originally prepared for the internal use of the Task Team. The purpose of these charts was to reflect the similarities of the schemes studied as well as to suggest the subjects which would require special consideration. The first chart compares the four schemes at the "chapter" level. The other five charts compare the schemes at principal subject headings within the five most common chapters: Politics, Social and Cultural, Science, Economics, Armed Forces. The primary subject headings for each scheme appear in capital letters. Lower case entries indicate that the subject is subsumed in that scheme under the heading which is indicated by a line number in parentheses. C-O-N-F-I-D-E-N-T-I-A-L Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 25X1 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Next 9 Page(s) In Document Exempt Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 AREA CONTENT CONTROL SCHEME DESIGN CHARACTERISTICS Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 25X1 Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0 Next 5 Page(s) In Document Exempt Approved For Release 2005/05/24: CIA-RDP80B01139A000400060004-0