A VALUE FUNCTION BASIS FOR THE COMPARATIVE ANALYSIS OF HIGH-ALTITUDE PHOTOGRAPHIC RECONNAISSANCE SYSTEMS

Document Type: 
Collection: 
Document Number (FOIA) /ESDN (CREST): 
CIA-RDP78B05167A001800170003-5
Release Decision: 
RIFPUB
Original Classification: 
S
Document Page Count: 
13
Document Creation Date: 
December 27, 2016
Document Release Date: 
June 4, 2014
Sequence Number: 
3
Case Number: 
Publication Date: 
November 7, 1967
Content Type: 
MEMO
File: 
AttachmentSize
PDF icon CIA-RDP78B05167A001800170003-5.pdf1012.98 KB
Body: 
ecnurr Declassified and Approved For Release 2014/06/09 : CIA-RDP78B05167A001800170003-5 IP OSP-0892-67 7 November 1967 TECHNICAL MEMORANDUM NO. 17 SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems PREPARED BY: Leslie C. Dirks, Chief, Design and Analysis Division ? I. Introduction A problem of frequent occurrence is the comparative evaluation of silver halide camera systems from the point of view of strategic intelligence image utility. The primary difficulty which is inevitably encountered in an attempt to undertake such an analysis is in relating a measure of camera system performance which is meaningful in terms of camera design parameters to a quantitative measure of the utility of the resulting imagery as it is used for the broad range or strategic ? intelligence applications. This paper outlines a technique for dealing with this particular problem which has evolved over a long period of time and has been successfully applied in a major camera system source- selection. It should be emphasized that this technique has been developed in the context of silver halide film imaging systems operated at high altitudes against strategic reconnaissance objectives. In addition to a description of this technique for comparative analysis, this paper also includes summary discussions of the rationale leading to the selection of the technique, along with comments on the application of the technique to specific problems. It should be noted at the outset that the problem of relating image utility to camera perfor- mance in the real, operational world is an extremely difficult task. The specific technique discussed below resulted from the review of large quantities of data together with actual operational experience. The tech- nique was subject to extensive review within the Government in the context of a camera source selection proceedings and received a general con- currence from several Government departments and agencies. CROUP 1 Exclud3d fira automatl?.1 Cownrading and Q37.11777 Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 I. SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems II. Definition of the Area Value Function The Area Value Function (VA) provides a means for estimating the total worth of photographic coverage by a given camera system under specified operational conditions over a specified ground area. The Area Value Function is analytically defined as follows . ? . VA = .A U(R) dA ? . . . where the integration is to be carried out over the defined ground area. The function U(R) is the Utility Function. The Utility Function serves to associate a quantitative measure of worth with each incre- ? mental element of ground area. The Utility Function depends only upon the "minimum ground resolvable length" realized by the camera system for each incremental ground area. The definition of "minimum ground resolvable length" will be-treated in a subsequent section of this paper. Of critical importance in applying the Area Value Function is the selection of an appropriate utility function. In general, it is not sufficient to construct the utility function based only on the level of ground detail that can be extracted from a given image. It is essential in constructing the utility function to take account of the relevance of perceivable detail in the context of the intelligence problems to which the photography is to be applied. In particular, assuming that the utility function is proportional to the total number of resolvable elements in an image is a very poor approximation in the case of strategic intelligence problems. This assumption would lead to a utility function increasing inversely as the square of the minimum resolvable ground length, and as will be seen below, is a very much stronger function than is actually the case. There are three distinct steps involved in generating a meaningful utility function. First, the specific photointerpretive tasks to be per- formed with the imagery must be listed. Second, the ability of the OSP-0892-67 Page Two STPUT Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 Declassified and Approved For Release 2014/06/09 : CIA-RDP78B05167A001800170003-5 ? SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems photointerpreter to perform these tasks must be related in a quantitative fashion to image quality as described by minimum ground resolvable length. It is, of course, critical that the definition of minimum ground resolvable length used in characterizing image quality be relateable to camera system performance. Third, the relative importance of the various tasks must then be established so that the collection of PI performance curves can be weighted and combined to give a single overall relationship between image utility and minimum ground resolvable length. ?Considerable community-wide effort has been expended on these three tasks. Numerous controlled psycho- physical experiments have been performed with the objective of measur- ing photointerpreter performance as a function of image quality for. various tasks. Based on these experiments and the photointerpreter experience integrated over a long period of time, NPIC has cataloged the level of ground resolved detail (essential elements of information) required to perform the manifold of tasks assigned to the Center. In addition to the various concerned USIB committees, I have attempted to evaluate the .relative importance of the various photointerpreter tasks in the context of the national strategic intelligence posture. The dis- cussion which follows draws heavily on these activities. In general, the functional relationship between photointerpreter performance on a specific task and minimum ground resolvable length is of the form depicted in Figure I. There will always be a region of minimum ground resolvable length poor image quality (characterized by large Minimum ground resolvable length) within which the PI's ability to perform a particular task is unacceptably low or unreliable. In general, there will also be a region where the image quality is sufficiently good so that a particular task can almost always be performed with high dependability. In both of these regions the rate of change in PI per- formance with minimum ground resolvable length tends to be low. Between these two regions of image quality lies a transition region. This region is characterized by a more rapid rate of change of PI performance with minimum ground resolvable length. It should be emphasized that almost never does this curve of minimum ground resolvable length approximate OSP-0892-67 Page Three tnni7iri" Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 ? SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems a step function. There are many reasons for this, but probably the most important ones are variability in individual photointerpreter per- formance and the fact that any simple engineering definition of minimum ground resolvable length cannot be a complete measure of image quality in the subjective sense of the term. If, for example, the task in question is the identification of wheeled vehicles, the ability of a PI to perform this task will be influenced by the ground scene in which the vehicles are imbedded, the direction in which the vehicle shadow falls, the particular mix of vehicles that must be sorted out, and numerous other parameters which are entirely independent of camera system performance, atmospheric viewing conditions, and scene illumination. Nevertheless, although the slope of the transition region and where it falls on the absolute minimum ground resolvable length scale may vary over broad ranges for the total spectrum of strategic intelligence photointerpretive tasks, the general shape of the PI performance vs. minimum ground resolvable length curve is almost always found to be as depicted in Figure I. As the image quality increases (the minimuin ground resolvable length decreases), the number of photointerpretive tasks that can be performed with the imagery increases. However, in examining the relative importance of the various tasks, itis found that in general the criticality of each individual task tends to decrease as the image quality increases. The utility function is computed at a given image quality by tabulating all the tasks that can be performed at this image quality level as defined by NPIC, weighted by the relative importance of each of these tasks. This computation can be performed for various image qualities as measured by minimum ground resolvable length to generate the curve of utility vs. ground resolvable length given in Figure II. It should be emphasized again that this curve results from the summation over a broad range of strategic intelligence problems. The utility function computed as described above can be approximated by two analytical functions. For resolvable length less than 10 feet, the dependence of utility on resolvable length is nearly linear of the form U(R) = 113.3 R < 10 ft., OSP-0892-67 Page Four SFPRFT Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 Declassified and Approved For Release 2014/06/09 : CIA-RDP78B05167A001800170003-5 ? SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems For resolvable length greater than 10 feet, a hyperbolic relationship of the following form should be used . . . U(R) - 2.5 R> 10 ft. The data curve in, Figure II is a piece-wise approximation to the linear portion of the utility function which has proven to be an adequate repre- sentation of the utility function for some application. OSP-0892-67 Page Five Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 ' ? SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems III. Definition of the Target Value Function Based on the same line of reasoning discussed above, it is possible to define a quantity known as the Target Value Function as follows: V = U(R) I = 1, N A target is understood in this sense to designate a specific facility which is sufficiently small in geographic extent so that image quality can be considered as constant over the entire target. The Target Value Function is then simply the summation of the utility function over a defined set of discrete targets. The target value function idea is particularly useful in comparing photographic systems where the primary mission objective is not area coverage but rather the coverage of discrete, small individual targets whose geographic position is known and can be utilized in the execution of the photographic mission.' The discussion of the utility function as applied to the area value function applies equally well to the utility function fiQr the target value function. OSP-0892-67 Page Six Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 ? 6LIAL I Declassified and Approved For Release 2014/06/09 : CIA-RDP78B05167A001800170003-5 SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems IV. Definition of Minimum Ground Resolvable Length The key to relating photointerpreter performance and camera system performance is in the selection of an appropriate quantitative performance parameter. The selected performance parameter must be one that is meaningful in camera system engineering terms and also meaningful in context of subjective photographic image quality. The measure which best satisfies both of these conditions is Air Force tri- bar target resolving power as defined in Mil. Spec. 150A. Therefore, the definition of "minimum resolvable length" will be taken as the length of one cycle (the width of a white bar plus the width of a black bar) on the highest frequency Air Force tri-bar target for which the' bars can be clearly distinguished. The next question which must be addressed is how to relate camera system resolution to minimum ground resolvable length (ground resolution). Traditionally, this relationship has been established by constructing an artificial model of the target scene consisting of uniformly distributed tri-bar targets randomly oriented with respect to the ground track of the camera. If such a ground scene were photographed by a given camera system, the tri-bar target resolving power of the system would depend upon the obliquity angle from which a given target scene were viewed, and the orientation of the target bars with respect to. the camera system. In general, when viewed at an oblique angle, the bars in the target will tend to appear from the camera aspect to be more closely spaced than they actually are. For the worst case of tri-bar target orientation, a geometric argument leads to the conclusion that camera system resolution and ground resolution are related by the secant, squared of the viewing obliquity angle. However, if the bars are oriented perpendicular to this worst case direction, similar arguments lead to a secant to the first power dependence. It has been customary to take the geometric mean of these two extreme cases which leads to the following relationship between camera system resolving power and ground resolving power in the tri-bar target sense. 3/2 R = ? R (Sec 0 ) g F OSP-0892-67 Page Seven c.7 7,rir _ Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 I, Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems In this experssion, H is the altitude of the camera system above the target scene, F is the focal length of the camera system, and ( 0 ) is the obliquity angle at which a given element of the target scene is viewed (this angle is defined as the angle between the vertical at the target element and the line of sight from the target to the camera). The above relationship between camera resolving power and minimum ground resolvable length is based on an idealized model of the target scene. For a target scene with three-dimensional develop- ment, such as is always the case with cultural scenes, the image quality never falls off as rapidly as secant squared and most often is closer to secant to the first power. However, the impact on image quality of atmospheric haze is generally higher at high obliquity angles than at lower obliquity angles which tends to argue in favor of a stronger dependency than secant to the first power. In the final analysis, it has been concluded that the secant to the three-halves power law represents an acceptable approximation to the physical world in the case of this application. When the value function approach is to be employed in the com- parative evaluation of camera systems, it is necessary to define the manner in which camera resolving power (RC) is to be computed. It is important that the camera resolving power be a sufficiently detailed measure of camera performance to reveal the differences between?different camera system designs. The definition of camera system resolving power to be used in computing either the area value function or the target value function takes into account the following factors: a. Optical system performance b. Image motion compensation c. Camera focus d. Target scene illumination and contrast as a function of solar elevation angle e. Film sensitivity and resolution characteristics. As the first step in computing camera system resolving power, the modulation transfer function (MTF) for the optical system design as OSP-0892-67 Page Eight trPNT Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 PErmr-7 Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 11, ? ? _ _ SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems degraded by manufacturing and alignment tolerances is computed. This MTF is then combined with the MTF's for the predicted image smear and the focus error. It is important to treat all of the above degrading factors in a statistically correct manner in that some of the degrading errors vary rapidly in time (throughout a given mission) and others will vary only from one production item to another, while still other errors are inherent in a given camera system design. It is usually best to take a worst set of conditions for comparative evaluation purposes. The image smear will be a function of the scene brightness (which must be specified) and the film sensitivity (which also must be specified). All of the above system MTF's will be a function of the location in the total image format of a particular point being evaluated. The system MTF resulting from the above computations must then be lowered to be representative of the scene contrast of the real world as viewed from high-altitude platforms. The above scene contrast will depend not only on meteorlogical conditions but also on the sun eleva- tion angle. Based on a large sample of scene characteristics, an average scene model has been compiled, as presented in Table I. This table gives both scene contrast and scene illumination as a function of solar elevation angle. The next step in the process is to intersect the total system MTF as degraded to the appropriate scene contrast with the curve giving the. Aerial Image Modulation required for a human observer to resolve a given Air Force tri-bar target. The intersection between the AIM curve and the system MTF will yield the limiting resolving power for the camera system. The AIM curve must be empirically determined for a given film type and film processing conditions. The computation outlined above can be repeated for all points in the photograph format and converted to minimum ground resolvable length using the expression defined above. On this basis, an area value function can be evaluated over any defined ground area. Similarly, a target value function can be evaluated for any defined target description. Both of these quantities will, of course, depend upon selection of a particular sun angle or variation in sun angle over the defined target or area model. OSP-0892-67 Page Nine Declassified and and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 SUBJECT: A Value Function Basis for the Comparative Analysis of High-Altitude Photographic Reconnaissance Systems The above scheme for defining camera system resolving power has proven to be adequate when utilized in comparative evaluations of camera systems which have generally similar optical system MTF,1s. However, it should be noted that serious anomalies can occur in cases where the similarity constraint is not adequately satisfied. These anomalies are not usually of concern, however, in comparing practical, high-performance photograph reconnaissance camera systems. OSP-0892-67 Page Ten SFPETP .,. 1 Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 ? =Ts"- amonwaimaimmoirmaigissmusaisis_- 1-rti. legNia iffifiedfip. rumaltem ii111111111g11. In swan- Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 11101101116 mn a NIU MEM= 0011222 NISOOMMOOMMIOM RIVEMOORMO " VERUOMMOUILIMMMOSOUIMSOUOMOMO " - ' "" "-?- 1-L7 miuni&l:m's:mis ? mmmmmmmm -??? !.... .Ian. I nu IBMIRMII 111111111 :H MMMMMM E.4,.=.1 gems 44; , 1.. aai. ? iitOrsagginjunill....4.912.3141151:1LalerngE4-111.inm . :::::::: WIMP' EafflillEffiE 'ii unuium?-? :::: sin OE% L... I :mime MU US L.: a.. ......0# 111111 .11221.M. 22222212210 :: U124 P MMMMMMMMM --a .1111 IHR am....13:31112:13 111M11131111"1 111111111111111 1101111811111110 111111111111:111111 flu 311 a. owl33 , I:: 111111111111111111111111111111111111111111111111111111111111111111111111 MU ? umaiummi my ullmehu mil M ..? 1111112111111111111 ir111111:111111111111111111 a "11141:7111LVVI11VI enuituu IIM11111110111111111111111111111Willlillia 1111111111111111111111111111111111111111111111111 :1 KNEE 1.111112 111111111112 22222121212212222222222211 JM211241211 tint001.q01 1.1_11 116111 IN MIA ITAA 4E 3 11111111111111111111111 M MM a. 1111111111 11111111111111111111111111111111111111111111111111 1:!:11::::::111113:Nuelueleue:16111111111111111111111111111111111111111111111111iiiiiliim ummin !!!!ipm run: 111111111111111111111111111111111111111111111111 11111111111M111111111111111111111111111111MIMMIM11111111110113 lutimuustimusuciumulmin ur '11::11:1: "11::" IIMMIIIIIIIIIM1111111111111111111111111111111111111111111111ffilliiill:::111:::111111111111111111111111mumummimuiiimunnimmuinin numminnuniiimuummumummemmummummummunun ? ITii!!!!!!!!i!!!!!!!!!TEITIE!!!!!!!!!!IIMln!!!IUIH M T!IED 41.1ZHI Irina ? 111111111111111111 I I m e Declassified and Approved For Release 2014/66/09: CIA-RDP78B05167A001800170003-5 :MN smiammofflumsommmemom smnumsaws==11 mummunuma walapi was uss= ..rainw????=mmo T^ rAl 111:1 MMUS ONION ?8 UI Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 s. ummaLtses mums:risme M-- a 1211?Esim mull Isupouum mum MUMS WINWIIIIIMEN MINI In magsmararmursa sommummilamom: OOOOO immummassimammi IuPuIUI?IIII!UII mummommimaismum OMMEIONSIR numumninimara MMMMMMM imml::::175114MMOMOMMeme 11111:21i: dm mom winnows mum mho U samomumusaums Min= MMM :::::::::::. T ITzwis 4111 mig.11111dgmt '? amass imams mum ? ON . ? t4.-tt - 1-1-4 le UM MI OUOMMEIFINFAU MRS MMUS IMMO KO NAM NNEMANUNMANIIIINKOWINOMONEIROUEMOSNENNEWIMENONEUNNO OM MMMMMMM MO MMMMMMMM OM MMMMMMMMMMMM simooduMMUlmOMMamoimMum ImM000samOMMAMOMMI MUMMOINWWiraMMIMMOMINWISSUUMMISI Ir1111911111 Olin81111B1111111111jr"111211manad?????? row EMOUNIM2110:22WWISLIFIR OUR 00 Monona X ? tTtL t 11111111 111111:11.41 71- ! UMUMIMMIMAMO ommIMMOOMOMMIMMUMMOMMEMIMMMOUEOMMOOMMUMUMMUMMMUMIMMWMUMW MMMMMMMMMM IMMOSMOUwoMmom000 WOMMUMMUKOMOMMSOMOOMUOM UMMUMMIIIMOMOROumMMX masmum 1111 MMMUMMIUMMUM MMMMMMMMMMMMMMMMM ICAO ....111:111MMOMMI Ono MM M Emmons U. mammon grairlINUENNOM=1;1101:::". MMMMM age."::::::::::::: MONO MISKUMBONNOMENIRINSUXIIMENNUUENIREEMNI: ? I .?1 r-t7. 7717 ' 7' 7 t11-1 L -71 74 '17 -44 mom ? iminsm maisign 11s11111111 AUSUMOSoomam E MMUUMMMMMMMMMMMMMM..MM.M.M..MMmmMMM uMmOMm ummes4r1..u1.p?. OXM 17 . ? OUMAMMMMMMMM lbSOOMMU -7,17 ? tido OONOWNIUMAIWOWANMENUI 1111110111 R^ N ORREOMOMO OW MMMMMMM ISOMONENNUA I 11:11:1 MMMMM enautienge 1 Mims: MOM MMMMMMMMMMM MOSI: a ME NEMIROW' Oft.mOIRmem ? ml ? I, '?1 I ? I ? %MOMS NOMA Frfierfiropm f 111 1111111111 1.1111/111 t17-":7 - ? f UMFAMMA 011111 161 M IMS ?u9. i; NOM VONIOININ mama. __ ma 111:111101:1:1111:11111 111111:1111111 a ram I si 1 1:111211116"."."1. :mamma MMMMMMMMM 1 musi?matilissimait I iinigemsammes I : i allossmmumel zummamtumom am Sr^UNRIEWINII.:1111 ROOM ? .g. 1 mummumme ma mommammmommom I 11:111:111 mu s 1 i :MIMI :MI :1111 :RCM Hall 1 am .11:11 mamas sammom ane:1". UM= Isms mis M mnSO nX? 111111:1M amalgam non MMMMM arr ;:. mmaglimmemmemim mummommilmimms 111111:11111 t ; mom MOE110:1 OSP ..MMOM 4111. Wm MMMMM MIXEMb, MOWN HUM MMMMM 1111"2"III:111111 lik, MIIIIIIII 1111111111: 1"."'"'"""""111111:112Fq11111111111118 ONMEOUMEMOUNNAIMAIM M e 1..:. ll -I.. . . Tir tir:tHt 1--,1111 111111 elm U. MMMMMMMMM mommomma11111111111BE memo FP moon k MMMMM M IMIM.M...111111 1.1111112L11 MOM Oa immix ? .77,t am OM -177:1:1 ONOGA .111W. as :OMEN :SOON a. WM: [f. 3.. el^ ts: e:11:::1: "" 1.11. ? ? 11. , t III, 1 : NI I I .. ;1=11111 M mu 2 232.22 ?...." Awl - ' M ! ..4111...._ lii...moNEMMEN : TB I I ? ? I PIM Mill 1188 111. ? 111L1' 111 ? 11 a II 1 ImmInnummicra ??^???aLa LISA= IIIIIIWINNOSIMI IWO MUM 1111111SE SHOO IIMMIWINISMAN moms mm tt 1 ? imam_ noMMIMMUM WOUmmimMoX Sc a. .aasmomms wimmimmummommi irealm 'mom UMW amoiMMUMMUMM ammo 1wm11 MUM MO 11 WNW ?????3 L. NUN IMO WROUONNONE: ^ MOONS 1:1111416 IIMMUNIEUMENMUMEENOMMENOUNEESOLIMAMOMAEOWIWEIMUNNSMSSESOMMOU:11:11.1,1,10ONOWN WEROMINMIALIZZIER".:WISP841IE1111:11111 0.010?000OOMOOOONIWISWIOIMIIMMOO:1 WIENUEIREWINII?TUM MMMMM Mr. IS ; 1,1104 ILE1suIUUaIUU es 4_, 4-4 e RION ? NO OUNINEIROUNONSN -cm,,sn-rwmmaix.cIrmr.cx. ..xx.mmrsm,..s.agzillascsair,uriiM,Mc..w.socAsiLxy:2.ir431104111t1 imm OEN m mulloPMR? 111:121 SOS NEMMORMWIIII: :WM : A111m a. 1111:1:11111: 1m :NOIMIN: WONIMENESS : ? ? f:. .1 ? -1 ? . ' Declassified and Approved' For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 4-4,4 . t +,t 14 I/ Declassified and Approved For Release 2014/06/09: CIA-RDP78B05167A001800170003-5 W Sun Angle TABLE I SCENE BRIGHTNESS AND TARGET CONTRAST Min Scene Brightness Target Contrast in Foot Lanberts ? at Entraftce Pupil 0 ZOO 1.1 50 240 1.3 100 300 1.5 200 450 1.8 30?f 600 / 2.0 400 650 2.1 50o 700 2.2 600 720 2.1 700 750 2.0 80? 750 1.9 900 750 1.8 z Declassified and Approved For Release 2014/06/09 : CIA-RDP78B05167A001800170003-5