Академический Документы
Профессиональный Документы
Культура Документы
AIR NAVIGATION
EUROCONTROL
RADAR SENSOR
PERFORMANCE
ANALYSIS
SUR.ET1.ST03.1000-STD-01-01
Edition : 0.1
Edition Date : June 1997
Status : Working Draft
Class : EATMP
DOCUMENT DESCRIPTION
Radar Sensor
Performance Analysis
WARNING
The present version of the document is working draft. It will be
validated through the Radar Sensors Appraisal Programme. The
results of this programme are expected end of 2001. Then the
document will migrate to a released status. Until then it should be
used as a support document for the EUROCONTROL Standard
document for Radar Surveillance in En-Route Airspace and
Major Terminal Areas.
Keywords
ELECTRONIC BACKUP
DOCUMENT APPROVAL
The following table identifies all management authorities who have successively approved the
present issue of this document.
SURT M. Rees
Chairman
EATMP
The following table records the complete history of the successive editions of the present
document.
SECTIONS
EDITION DATE REASON FOR CHANGE PAGES
AFFECTED
(Edition) (Edition date)
TABLE OF CONTENTS
TABLE OF CONTENTS.........................................................................................................v
FOREWORD............................................................................................................................ 1
1. INTRODUCTION ................................................................................................................ 3
2. REFERENCES .................................................................................................................... 5
ANNEXES
ANNEX A (RECOMMENDED)
RADAR SENSOR TECHNICAL PERFORMANCE ANALYSIS
ANNEX B (INFORMATIVE)
RADAR SENSOR DETAILED TECHNICAL PERFORMANCE ANALYSIS
ANNEX C (RECOMMENDED)
FLIGHT TESTING METHODS
ANNEX D (RECOMMENDED)
METHOD TO ASSES THE RESOLUTION CAPABILITIES OF RADAR SENSORS
FOREWORD
1. Responsible Body
3.1 This Standard is adopted in accordance with the procedures outlined in the
Directives for EUROCONTROL Standardisation Ref OO2 - 2 - 93.
This Standard is kept under review by the responsible body who, when
changes or corrections are necessary, will prepare the required amendments
or technical corrigenda. The procedure for the maintenance of this Standard is
laid down in the Directives for the Uniform Drafting and Presentation of
EUROCONTROL Standard Documents Ref OO 1 - 1 - 92.
5. Editorial Conventions
5.1 The format of this Standard complies with the Directives for the Uniform
Drafting and Presentation of EUROCONTROL Standard Documents.
5.2 The following practice has been adhered to in order to indicate at a glance the
status of each statement.
Recommended Elements have been printed in light face italics, the status
being indicated by the prefix Recommendation.
5.3 The following editorial practice has been followed in the writing of
specifications:
for Normative Elements the operative verb “shall” is used; for Recommended
Elements the operative verb “should” is used
There are four Annexes to this Part of the Standard Document, the status of
each being defined as follows:
• Annex A Recommended;
• Annex B Informative;
• Annex C Recommended;
• Annex D Recommended.
8. Language Used
1. INTRODUCTION
1.1 Purpose
1.1.2 The comprehensive and continuous radar coverage of high quality and
reliability is essential for the uninterrupted provision of radar services and the
application of specific radar separation standards.
1.1.3 As an integral part of Air Traffic Management, radar positional data constitute
the principal means of Surveillance of Aircraft for the efficient execution of Air
Traffic Control.
1.1.5 In accordance with ECAC Strategy and its related documents (EWPD and
CIPD), a common radar separation standard of 3 NM is to be implemented in
major terminal areas.
1.2 Scope
1.2.1 This EUROCONTROL Standard specifies the methods and procedures for the
performance analysis of the Radar Sensors used for Air Traffic Management.
1.2.2 The illustration at Figure 1.1 gives an overview of the operational requirements
for radar data in relation to the services to be provided within the different types
of Airspace and the corresponding technical requirements of the radar system.
1.2.3 The illustration at Figure 1.2 gives a functional overview of the radar chain.
These functions can be performed using different system layouts (e.g.
integration of the monoradar tracking function in the Plot Filter Combiner).
1.2.4 The methods and procedures for the performance analysis specified within
this standard are limited to the Radar Sensor. The elements involved in the
Radar Sensor are Primary (PSR) and Secondary (SSR) Radar Sensors.
1.2.5 The methods and procedures specified in this standard are not intended to
verify exhaustively the performance of the Radar Sensor. Only those
performance parameters which are specified in the EUROCONTROL Radar
Surveillance Standard are included (ERSS).
2. REFERENCES
2.1 The following documents and standards contain provisions which, through
reference in this text, constitute provisions of this EUROCONTROL
Standard.
Any revision of the referenced ICAO Document shall be immediately taken into
account to revise this EUROCONTROL Standard.
Revisions of the other referenced documents shall not form part of the
provisions of this EUROCONTROL Standard until they are formally reviewed
and incorporated into this EUROCONTROL Standard Document.
2.2 At the time of publication , the documents listed below are those that are
referenced from within this Eurocontrol Standard :
3.1 Definitions
Analogue: In radar terms, a signal which has not been converted into
digitally encoded values, usually quantised into discrete time periods. Analogue
signals are to be found at antenna and receiver level in radar systems.
received signals, enabling an Off Boresigth Angle for the signal source to be
obtained.
• cumulative outage time due to all failures over a period of one year;
Azimuth: The angle between North (normally true North) and a radar
target, measured from the sensor site.
Azimuth Count (or change) Pulses (ACPs): The output pulses of the
incremental azimuth measuring device fitted to the radar antenna turning
platform (turning gear). The encoding device may give its output in serial or
parallel form, but typically provides 4096 pulses (12 bit encoding), 16
384 pulses (14 bit encoding) or 65 536 pulses (16 bit encoding) in serial form
per 360° of azimuth rotation.
Beam Width: The angle subtended (either in azimuth or elevation) at the half-
power points (3 dB below maximum) of the main beam of an antenna.
• sea clutter;
Combined target report: A target report detected by both PSR and SSR
and such that both detections were sufficiently adjacent to be combined into
one target report.
Control Pulse: A pulse (P2 for Modes A and C, P5 for Mode S),
transmitted in accordance with ICAO Annex 10 recommendations, by the
ground equipment (SSR Interrogator) in order to ensure sidelobe suppression
at transponder level.
Correlated Tracks: Tracks which have been correlated with a flight plan
(sometimes this term applies only to tracks for which the Mode A code has
been correlated with a Call Sign in the Code/Call-Sign list i.e. Flight Plan
Association).
Dead Time: The period of time during which a SSR transponder is inhibited
from receiving signals after a valid interrogation is received and a reply
transmitted. The term is also used to describe the time after the normal range
for returns and before the next transmission of a an interrogator or from a
primary radar system.
Doppler Speed: The radial (to the radar sensor) velocity of a target
(aircraft) or of a clutter source (false alarm) measured from its Doppler
frequency shift in a received primary radar return.
Error: Error is the difference between the measured value (observed) and the
reference value (actual)of a physical quantity. The radar errors in position are
divided to:
• θ azimuth bias.
For the general case the important parameters for a Sensor are the RMS
errors and not the st. dev. . This is since the std. dev. is the RMS error with a
mean of zero, i.e. the systematic errors are removed.
False Plot: A radar plot report (PSR, SSR or combined plot) which does
not correspond to the actual position of a real aircraft (target), within certain
limits.
Flight Level: The vertical distance above mean sea level when referenced to
standard pressure setting of 1 013.25 hectopascals.
Framing Pulses: The pulses which "frame" the data pulses (code) of
SSR Mode A and C replies (described as F1 and F2 respectively). Also known
as "bracket pulses".
Gain (of Antenna): A measure for the antenna of the increased radiation
intensity radiated in a particular direction as compared with the radiation
intensity that would have been radiated from an isotropic antenna with the
same power input (expressed in dB).
Transversal modes:
• uniform motion;
• uniform motion;
Figures 3.1. and 3.2. represent the MOF classification in the horizontal and
vertical plane -respectively. The duration of a mode of flight segment (i.e. a part
of the flight where one particular MOF prevails) depends on the particular MOF.
This aspect is not covered in both figures.
Mode of flight (Applicable): For the evaluation of a tracker the following more
simplified subdivision shall be used:
i. Transversal:
a. Constant Course;
ii. Longitudinal:
iii. Vertical:
g. Level Flight;
h. Climb;
i. Descent;
Nautical Mile (NM): A measure used in navigation. The unit is equal to 1852
m.
Noise Factor : A figure defined for a receiver as the ratio of the noise at
the output of the practical receiver and the noise output of an ideal receiver at
standard temperature T0 (290° K). The noise factor is in practice defined as
the Signal-to-Noise ratio at the input divided by the Signal-to-Noise ratio at the
output of a receiver.
Overall (ERSS): When used means that the measurement method shall
be applied without geographical restrictions to the whole sample of the
recorded data obtained from opportunity traffic. This sample shall be
representative of the whole population of aircraft to which air traffic services
are provided irrespective of radar cross sections and clutter environments for
PSR sensors, and irrespective of transponder deficiencies for SSR sensors .
• code detection .
• positional accuracy;
• resolution .
Plot: A target report resulting from digital integration of the received echoes
(PSR) or replies (SSR) inside the antenna beamwidth. The PSR report
contains range and bearing information whereas the SSR report contains in
addition Mode 3/A identity code and the Mode C decoded altimeter height value.
plot extractors also include Mode 3/A identity code and the Mode C decoded
altimeter height value.
Plot Filter: A signal processing device which has the function to filter out
radar plot data which can be positively identified as non aircraft returns by a
scan-to-scan correlation process.
Plot Run Length: The number of ACPs between the first and last
detection of a plot presence in a sliding window plot extractor.
Probability of False Alarm (Pfa): For a long observation period, the actual
number of detected false alarms divided by the theoretical maximum number
of detections..
Pulse Train: The sequence of framing and code pulses in the coded SSR
reply.
Radar Cross Section (RCS) : The area intercepting that amount of power
which, when scattered equally in all directions, produces an echo at the radar
equal to that from the target.
Screening: When the shape of the terrain or certain objects prevent the
detection of targets in certain parts of the airspace, one speaks about
screening of the parts of the airspace concerned.
amplitude greater than the antenna sidelobe signals in space, which will enable
the transponder to prevent itself from replying to the sidelobe interrogation
signals.
Sum Pattern: Normal radiation pattern for the main directional beam of
an antenna. Contrasts with the "difference-pattern", where a part of the
radiating elements of the antenna are switched in anti-phase to produce
signals proportional to the amount by which the source is off the boresight of
the sum pattern.
Time stamp: The addition of the time information -in the relevant field-
in the target report (plot or track). In the ASTERIX the time information is coded
in two octets with Least Significant Bit (LSB) equal to 1/128 seconds.
Time stamp error: Time stamp error is the constant time difference
between the time system used for plot detection time stamping and a common
reference time.
4.1 General
This analysis is to assess the quality of the information, provided by the radar
sensor, by measuring the overall performance of the sensor against the
performance parameter reference values specified in the EUROCONTROL
Surveillance Standard and this is the objective of this document.
This analysis is the in depth evaluation of the radar sensor performance which
shall result either in the definition of the coverage (commissioning) or in the
identification of the reasons of possible performance degradation (ANNEX A).
4.1.4 The first level of testing shall be applied initially upon the completion of the
second level of testing during system / sensor commissioning leading to
definition of the OCV, and then at regular intervals to ensure that the system
/ sensor continues to meet the requirements of the EUROCONTROL Radar
Surveillance Standard (Quality Control).
The third level of testing shall be applied in order to supplement the first
and second levels of testing when the system / sensor has been found to be
failing to meet the stated performance requirements.
All three levels of testing shall also be applied, as appropriate, and to a suitable
level , in the following cases:
4.3 Procedure
For the overall performance analysis the CMV shall be the Operational
Coverage Volume OCV(defined during site commissioning see ANNEX A ).
P.R.F Hz = 1/ sec.
Pulse repetition Frequency
Staggering ratio/pattern dimensionless/Hz.
Instrumented range NM .
M.T.I range NM (if applicable).
Beam switching azimuth-range pattern.
Power KWs-The reading from the power meter of
the radar sensor.
Noise figure dB-the reading from the noise figure
indication meter.
Receiver sensitivity The relative indication from the equipment's
B.I.T.E., or recent measurement.
M.T.D / M.T.I The indication from the B.I.T.E (internal
tests.), or recent measurement.
Plot extractor parameters / The reading from the B.I.T.E ., or recent
status measurement.
Plot filter / combiner parameters The reading from the B.I.T.E ., or recent
/ status measurement.
NOTES
1. Special messages are PSR and SSR RTQC messages, overload
indications, North crossing, etc. Special messages are present on the
normal operational output and therefore recorded together with the target
reports. The analysis of such messages is recommended since it can yield
useful information about the changes in status of the Sensor(s).
2. Multilevel recordings at different I/O interfaces of the radar sensor.
The target reports used for analysis shall comprise:
Overall Performance • Opportunity Traffic
Technical Performance • Opportunity Traffic,
• Special Test Flights
Detailed Technical • Opportunity Traffic,
Performance • Special Test Flights,
• Simulated Data
The following characteristics shall be used for judging acceptability of a
recording for use in an evaluation of the overall performance. It may be
necessary to adjust the recording parameter values to obtain sufficient quantity
of data for reliable analysis results..
4.3.2.1 Recording.
Minimum Duration • High Density Traffic Areas (en-route or major TMA) 1
hour,
• Medium Density Traffic Areas - 2 hours,
• Low Density Traffic Areas - 4 hours
Minimum Quantity of Data • Probability of Detection - 200 chains >5 minutes per
chain
• Accuracy Analyses - 150 chains
• Systematic Error Estimation -200 chains >5 minutes
duration in cover of > 2 radars.
System Configuration • Normal Operational configuration for prevailing traffic
and environment.
Environment, Weather • No Anoprop conditions. or heavy Angel Activity or
abnormal conditions (e.g. jamming, interference)
should be used to verify PSR / SSR overall
performance.
• For the site commissioning, of the Primary Radar
Sensor, data should be collected, under all seasonal
conditions and if applicable ,also under anomalous-
propagation periods (ANAPROP ).
Recommendations
1) General. The reliability of the evaluation results is directly linked to the
quantity and quality of the recorded data. The quantity of data necessary for
the evaluation is dependant on the purpose of the evaluation - For the purpose
of this standard the evaluation objective is the “Overall Performance Analysis”
of the sensor for the parameters defined in the EUROCONTROL Surveillance
Standard.
The analysis methods described in this standard are based on the concept of
chains (chained target reports) which may be non-air traffic information -
clultter, fruit, etc. To obtain consistent and reliable evaluation results over a
period of time it is important that the chains used for analyses are chosen
carefully and consistently. The types of chain chosen must be representative
of the air traffic in the airspace covered by the sensor. For example;
Probability of Detection results based on chains of which 60% were correlated
clutter would not be considered reliable.
2) Data Collection Duration. The target report sample size is determined by
the parameters to be measured. The standard recommends that one data
collection should serve for all the parameter measurements in a campaign.
Therefore the data collection duration should be adapted to provide sufficient
data for the analyses to be carried out. The general rule is - the more (longer)
the better within the limitations of the analysis system and time available. Since
analysis system resources and time are often limited and traffic patterns
irregular, the following recommendations should allow a reliable set of results to
be obtained for most sensors.
To estimate the duration one of the principle parameters may be considered;
Probability of Detection, Systematic Errors (multi-radar systems) or accuracy.
The following example should clarify the principle:
Probability of Detection: For a sensor with 160NM maximum range, a 6
second scan rate and an average plots/scan rate of 50 SSR plots. Assume
that 95% of the SSR plots are from real targets (47 plots per scan).
To obtain the sample size for the overall Detection Calculation the required
number of chains (200 of at least 5 minutes) requires (200 / 47) * 5 minutes =
25 minutes of recording.
If the coverage space is divided into Range/Azimuth/Height cells of say 20NM
x 22.5 degrees x 50 FL then it is more useful to try to record at least two
chains per cell. In this case the required duration can be linked to the sample
size required for each cell - say 20 target reports per cell.
Thus we get the required sample size:
MaxRange
SampleSize = × NAzimuthCells × NHeightCells × NPlotsPerCell
RangeCellSize
For our radar - assuming 75% of cells have data the sample size is:
160 360 700
⇒ × × × 20 × 75% = 30240 plots
20 20 50
Thus for 47 plots per scan the duration is:
30240 60
⇒ × ≈ 150minutes
47 6
Therefore a 2 1/2 hour recording should yield sufficient data for the Pd
calculations
The analysis of the Radar Sensor performance PSR or SSR shall result in the
estimation of the performance parameters specified in the EUROCONTROL
Radar Surveillance Standard. The analysis methods are described in the
following sections. The performance parameters are divided into :
i) Chaining.
The 5 minute rule is intended to promote the concept that the performance of
the sensor can only be reliably measured when both the sensor and the
measurement tool are in stable condition.
ii)Position Reconstruction.
Recommendation. In the event that the results are not conformant further
investigation should be undertaken, as described in ANNEX A or /and ANNEX
B.
5.1 General
For the estimation, of the probability of the target position detection the
recorded primary and combined target reports (at the output of the radar
sensor) shall first be chained. The chaining function shall associate each
target report to one and only one trajectory, identified by an aircraft number.
With this association the number of the expected target reports inside the CMV
can be calculated. The recorded target reports shall come from opportunity
traffic except the case of heavy ground clutter environment in which the target
reports shall come from test flights.
The overall probability of target position detection inside the CMV shall be
calculated using the formula 5.1. Extrapolated and false target reports shall be
excluded from the calculation.
(5.1)
NOTE The number of detected target reports is defined as one target report
per scan per radar per target (chain ). In case of multiple plots and /or
non-combination the target report which best fits the true path of the
target shall be used for the Pd calculation.
The interpretation of the results shall be to assess the quality of the target
position detection compared to that specified in the EUROCONTROL
Surveillance Standard.
The analysis of the false target reports shall be based on the characteristics
and behaviour they exhibit which differentiates them from real aircraft reports.
A chaining algorithm shall be applied to the recorded primary and combined
target reports at the output of the radar sensor. As a result chained data shall
be derived with the history and the characteristics of each target forming a
chain. Then the false target reports shall be identified by their particular
characteristics which will include several of the following:
• they are pure primary reports except the case of ships carrying
transponders;
• they form tracks with short life and relative low speed;
• they appear, in high density in ground, sea, weather and angel clutter
areas;
• they appear in pairs with azimuth separation less than the antenna
beamwidth (splits).
For the overall performance the average number of false target reports per
antenna scan shall be estimated.
The interpretation of the results shall be to assess the quality of the average
number of false target reports compared to the specified value in the
EUROCONTROL Surveillance Standard.
6.1 General
• Positional accuracy;
• Resolution.
6.2.1 General
θ m = measured azimuth;
δ θ = azimuth bias;
The above error model is used in the MURATREC algorithm for the estimation
of the systematic and random errors.
The time stamping error is only applicable when sensors fusion techniques are
used in the RDPS system.The error model is based in addition on the
assumption that there is a range clock bias error which is represented by the
parameter κ.The bias errors are considered as fixed values corresponding (for
range and azimuth bias) to the mean random error.
• random errors;
• jumps.
• azimuth bias;
NOTE - Jumps are target reports with errors in position three times
higher or more than the standard deviation for range and
azimuth
For the estimation of the overall positional accuracy the recorded primary (at
the output of the radar sensor) shall first be chained. Then a reference
trajectory shall be reconstructed for each target inside the CMV and compared
against the measured positions without any classification of the targets or
geographical limitations.
The reconstruction of the reference trajectory (for each target inside the CMV)
shall be based:
a.1) at least part of the CMV is covered from another two radars ;
b)on multilevel recordings (e.g. recordings at the video level and at the plot
level) when the a.1 and a.2 are not applicable.
c) on DGPS data (coming from test flights) time synchronised with the
recorded target reports or any other reference positioning system. The DGPS
position of the target together with the corrected DGPS time should be taken
as the reference . The DGPS position must be projected onto a common plane
for comparison with the target report data. A stereographic projection using the
same earth model as the sensor under test is best.
From the comparison of the measured position and the reference position for
each target inside the CMV and assuming the model 6.1 the following errors
shall be estimated:
• azimuth bias;
• azimuth error.
c) DGPS.
The interpretation of the results shall be to assess the quality of the overall
positional accuracy compared to that specified in the EUROCONTROL Radar
Surveillance Standard.
6.3 Resolution.
6.3.1 General
These areas are shown in Figure 6.1. This diagram indicates the relative
separation - as it is seen by the Radar Sensor - between the two aircraft. The
origin O of the axes coincides with the position of the first aircraft. The areas
are:
± 1.5 τ
(1)
τ (NM) =τ (µsec) ∗ c / 2;
θb = nominal 3 dB beamwidth;
For the evaluation of the overall resolution of the radar sensor the probability
of position detection for each individual target being in close proximity shall be
estimated. For this the recorded primary and combined target reports at the
output of the radar sensor shall first be chained, then a reference trajectory
shall be reconstructed for each target inside the CMV. The reconstruction of
the reference trajectory shall be done as it is described in par. 6.2.2 above.
Using this reference trajectory information an algorithm shall sort out all the
trajectory pairs with relative separation falling inside the shaded zone 3a which
is defined by 6.2.
From this information the algorithm shall calculate the number of expected
target reports with relative separation fulfilling the above (6.2). Then using
chaining information the detected target reports associated to the above pairs
shall be sorted out.
All target reports used in the resolution analysis shall have a reference position.
(6.3)
The interpretation of the results shall be to assess the quality of the resolution
capability compared to that specified in the EUROCONTROL Radar
Surveillance Standard.
7.1 General.
For the estimation of the probability of the target position detection the recorded
secondary and combined target reports at the output of the radar sensor shall
first be chained. The chaining function shall associate each target report to one
and only one trajectory identified by an aircraft number (aircraft identification ).
With this association the number of the expected target reports can be
calculated. The Pd measurement shall be Sensor performance based but
shall use multi-radar information, where available to determine whether a target
is present in the CMV of the Radar sensor to be analysed. In a monoradar
evaluation the “expected number of target reports“ is taken to be the number of
antenna scans between the first and the last detection of the target.
The overall probability of target position detection, inside the CMV, shall be
calculated using the formula 7.1. Extrapolated and false target reports shall be
excluded from the calculation.
⊗ ⊗ ⊗ ⊗ ⊗ ⊗ ⊗ ⊗ ∅ ∅ ⊗ ⊗ ⊗ ⊕
∅
⊗ ⊗ ⊗ ⊗ ⊗ ⊗
Figure 7.1
The interpretation of the results shall be to assess the quality of the probability
of target position detection compared to that specified in the EUROCONTROL
Surveillance Standard.
For the estimation of the overall probability of code detection, only the
secondary or combined target reports used for the calculation of the target
position detection shall be taken into account . So only the target reports that
the chaining process shall associate to an aircraft trajectory shall be
considered.
The Pcd measurement shall be sensor performance based but shall use
multi-radar information where available to detect whether a code change is due
to a pilot action or to system malfunction.
(7.2)
Pcd = The number of target reports with validated and correct Mode A
Mode A The number of detected target reports chained to trajectories
Pcd = The number of target reports with validated and correct Mode C
The number of detected target reports chained to trajectories
Mode C
(7.3)
NOTES
2. Correct means the Mode A/C code value corresponds to the current
"correct" value for the associated trajectory. The correct value is
determined and maintained by the analysis system.
3. The Correct Mode C value is calculated from the chained data using
interpolation to estimate the likely Mode C value for a chain at instant
during the life of the chain. In the case where the Flight Level is known
(GPS or Test Flight) then the reference Mode C may be fixed to the
known value.
The interpretation of the results shall be to assess the quality of the probability
of code detection compared to that specified in the EUROCONTROL
Surveillance standard.
For the estimation of the False / Multiple SSR target reports ratio the
secondary and combined target reports recorded at the output of the radar
sensor shall at first be chained. As a result chain data shall be derived with the
history and the characteristics of each target report forming a track. Then the
False /Multiple target reports shall be sorted out based on the particular
characteristics they possess which are generally the following:
• they are not synchronised ( asynchronous fruit which normally shall not
appear at the output of the plot filter);
• they form track with relative short life. (synchronous fruit and second time
around replies ).
• they may have the same A/C code as the real aircraft target reports but
they form tracks with relative short life and they appear in certain sectors
bounded, by the orientation and the size of reflecting surfaces (reflections);
• they appear in pairs with small azimuth separation less than the antenna
beamwidth (splits );
It is useful also to correlate the recorded and processed data with the HPD’s of
the antenna of the radar sensor for the identification of the multiple SSR target
reports coming from sidelobes.
The False / Multiple SSR target reports rate shall be calculated using the
following formula :
(7.4)
NOTE The denominator includes all detected targets i.e. a/c and false.
For the overall performance analysis the following ratios shall be calculated:
(7.6)
b) The number of multiple SSR target reports
R =
Multi The number of detected secondary & combined target reports
(7.7)
b.1) The number of multiple SSR target reports from splits
R = The number of detected secondary & combined target reports
Splits
(7.8)
b.2) The number of multiple SSR target reports from reflections
R = The number of detected secondary & combined target reports
Refl.
(7.9)
b.3) The number of multiple SSR target reports from sidelobes
R = The number of detected secondary & combined target reports
Sidel.
Recommendations
1) False plots The false plots are coming either from second time returns or
from fruit (synchronous or un synchronous).
• the mode A and mode C may be swapped in the plot message depending
on the mode interlace;
The reference plot is the real plot and represents the real position of the target
see figure 7.3.
1.2) Criteria for False plots coming from second time around replies.
• the mode A and mode C may be swapped in the plot message for 2nd
trace targets, depending on the mode interlace;
The reference plot is the real plot and represents the real position of the target
see figure 7.4.
Parameter Symbol Value
fruit minimum range difference ∆ρ min 0.5 NM
second time around maximum range difference ∆ρ max 10 NM
fruit/sec. time around maximum azimuth difference ∆θmax 1°
2) Multiple plots. Multiple plots are coming from reflections , splits, sidelobes.
2.1) Criteria for multiple coming from reflections. The criteria to detect
reflections are different for the reflections received from the main beam
(multipaths) and from sidelobes.
• The false plot has the same mode A code as the reference plot;
• the false plot has the same mode C code as the reference plot (if both of
them are present);
• The false plot has the same mode A code as the reference plot (validated);
• the false plot has the same mode C code as the reference plot (if both of
them are present);
∆ρ min= minimum range difference <ρ r-ρ f ≤maximum range difference = ∆ρ max
Split replies are generated by the same aircraft producing more than one target
separated by a small range and/or azimuth difference. The split plots are
divided into three subclasses:
• Range Split;
• Azimuth Split;
• Range/Azimuth Split.
• the false plot has the same mode A code as the reference plot (either
validated or non-validated);
• the false plot has the same mode C code as the reference plot (if both of
them are present);
False targets ,which appear due to the sidelobes, are generally caused by the
nearest (i.e., highest) lobes and the backlobe (180 deg). The ringaround is a
special type of sidelobes effect since the phenomena causing the ringaround
and sidelobes are same. However, a certain number of sidelobes should
occur to have a ringaround phenomenon. The ringaround false plots are
generated by sidelobe interrogations are outside the main beam approximately
10 degrees from the centroid of the true target. So the multiples are divided in
three subclasses:
• sidelobes;
• backlobes;
• ringaround.
• the false plot has the same mode A code as the reference plot (validated);
• the false plot has the same mode C code as the reference plot (if both of
them are present);
i) for sidelobe:
Assuming N plots in time order with ti, ρi, the time stamp and the range of the
ith plot.
Parameter Symbol Value
Sidelobe minimum azimuth difference ∆θmin 3o
Sidelobe maximum azimuth difference ∆θmax 10o
Side/backlobe minimum range difference ∆ρ min 0.50NM
Side/backlobe maximum range difference ∆ρ max 1.00NM
Backlobe minimum azimuth difference ∆θmin 177o
Backlobe maximum azimuth difference ∆θmax 180o
Ringaround range tolerance ∆ρ 1NM
Ringaround minimum plot confirmation N 10
Reflections
SP Max Rng
Back
Refl Min Rng Range Range/Az Lobe
SP Min Rng Split Split
ONM
The interpretation of the results shall be to assess the quality of the False /
Multiple target reports ratios compared to the ones specified in the
EUROCONTROL Surveillance Standard.
8.1 General
• Positional accuracy;
• Resolution.
8.2.1 General
θ m = measured azimuth
δ θ = azimuth bias
The above error model is used in the MURATREC algorithm for the estimation
of the systematic and random errors. The error model is also based on the
assumption that there is a range gain κ - the range bias varies as a function of
range. The gain may be due to an error in the range clock or some systematic
pulse deformation /attenuation problem.
The time stamping error is only applicable when sensors fusion techniques are
used in the RDPS system.
The bias errors are considered as fixed values corresponding for range and
azimuth bias to the mean random error.
• random errors:
• jumps.
• azimuth bias;
NOTE- Jumps are target reports with errors in position three times
higher or more than the standard deviation for range and
azimuth. Jumps are single scan events.
For the estimation of the overall positional accuracy the recorded data shall
at first be chained. Then a reference trajectory shall be reconstructed for each
target inside the CMV and compared against the measured positions without
any classification of the targets or geographical limitations.
The reconstruction of the reference trajectory (for each target inside the CMV)
shall be based:
a.1) at least part of the CMV is covered from another two radars;
NOTE Position reconstruction can only be reliable when the target is seen by
two or more sensors . If more than 30% of the chained data are seen
by only one sensor then the quality analysis results may be unreliable.
b) on multilevel recordings (e.g. recordings at the video level and at the plot
level) when the a.1 and a.2 are not applicable.
c) on DGPS data (coming from test flights) time synchronized with the
recorded target reports or any other reference positioning system. The DGPS
position of the target together with the corrected DGPS time should be taken
as the reference. The DGPS information will normally be in Latitude/Longitude
and height above Mean Sea Level with coordinates in WGS84. The sensor
data will normally be either Range/Azimuth/FL, X/Y local/FL or X/Y System/ FL.
The coordinates for the sensors and system origin must be stated in
WGS84.To chain the two sources of data and to use the DGPS position as a
reference both data sources must be projected onto a common coordinate
system. Either a Stereographic system (height independent) or a x/y/FL
system may be used. In the case of a mono-radar evaluation the system origin
should be the sensor site coordinates, i.e. x/y local = x/y system. The GPS
altitude values or sensor FL values must also be normalised if errors are to be
minimised - correction of Mode C or GPS Altitude values for the regional QNH
at the sensor location and time of recording would be adequate.
From the comparison of the measured position and the reference position for
each target inside the CMV and assuming the model 8.1 the following errors
shall be estimated:
• azimuth bias;
• azimuth error
The interpretation of the results shall be to assess the quality of the overall
positional accuracy compared to that specified in the EUROCONTROL Radar
Surveillance Standard.
8.3.1 General
NOTES
2. Correct means the Mode A/C code value corresponds to the current
"correct" value for the associated trajectory. The correct value is
determined and maintained by the analysis system.
For the estimation of the false code information only the secondary or
combined target reports used for the calculation of the probability of target
position detection shall be taken into account . So only the target reports that
the chaining process shall associate to an aircraft trajectory shall be
considered.
The measurement shall be sensor performance based but shall use multi-
radar information where available to detect whether a code change is due to a
pilot action or to system malfunction. The false code information shall be
estimated using the following formulas:
The number of reports with incorrect Mode A or/and Mode C (valid or not)
R = The number of detected secondary/combined reports chained to trajectories
Over/f
(8.3)
If we apply the above formulas for the figure 7.1 we have the following:
The interpretation of the results shall be to assess the quality of the false code
information compared to that specified in the EUROCONTROL Radar
Surveillance Standard.
8.4 Resolution.
8.4.1 General
∆ρ (NM)
±∆ρ 2
(2) (1)
±∆ρ 1
(3)
Figure 8.1
∆θ 1 = 2∗ n∗360 f ∗ t
For:
• ∆ρ 1 = 0.05 NM
• ∆ρ 2 = 2 NM
For the evaluation of the overall resolution capability of the radar sensor the
probability of position and correct code detection for each individual target shall
be estimated. For this the recorded data shall at first to be chained then a
reference trajectory shall be reconstructed for each target inside the CMV. The
reconstruction of the reference trajectory shall be done as it is described in
par. 8.2.2 above. Using this reference trajectory information an algorithm shall
first sort out all pairs of trajectories having parts falling inside the close
proximity area (Figure 8.1 thick line) and then define the parts falling inside
areas 1, 2 and 3. Then the algorithm shall calculate the number of expected
target reports for each part of the trajectory and the total number of expected
target reports for each close proximity area. At last using the chaining
information the number of detected target reports associated to trajectories
inside the areas 1, 2, and 3 shall be calculated.
The interpretation of the results shall be to assess the quality of the resolution
capability compared to that specified in the EUROCONTROL Radar
Surveillance Standard.
9.1 General
9.1.1 The PSR and SSR sensors are collocated and they have the same OCV
(Operational Coverage Volume);
9.1.2 Only aircraft flying inside the above mentioned OCV who have active SSR
transponders will be detected as combined targets.
For the evaluation of the data combining capability of the radar sensor the
overall probability of association Pas and the overall false association rate
Rfas shall be estimated for the targets flying inside the OCV of the sensor.
For the estimation of the overall probability of association and the overall false
association rate the following formulas shall be used:
(9.1)
NOTE Correct / false combined target report is a target report coming from a
correct / false association of a primary and a secondary target report.
NOTE Special analysis techniques outside the scope of this document are
required for Non co-located Combined radars.
The interpretation of the results shall be to assess the quality of the data
combining capability of the sensor compared to that specified in the
EUROCONTROL Surveillance Standard taking into account the assumptions
9.1.1 and 9.1.2.
10.1 General
To estimate the overall on site processing delay the time of detection for each
target and the time of transmission shall be recorded and their average
difference shall be calculated. The recording shall be done at the level of:
NOTES
2. The time of detection is the time at which the centre of the antenna
beam illuminated the target, i.e. the time at which the antenna was at
the target measured azimuth.
The above data shall be time stamped using a reference clock preferably GPS.
The recordings shall be done in normal conditions i.e. overload periods shall be
excluded.
The interpretation of the results shall be to assess the quality of the on site
delay compared to that specified in the EUROCONTROL Surveillance
Standard.
11.1 General
Availability is the probability that a system will be available for use at a given
random time or time interval. The term “available for use “ means that the
system provides services within the specified limits. The availability can be
categorised as follows:
• instantaneous availability A(t) which is the probability that the system will
be available at any random time t;
• mission availability Am(t) which is the probability that the system will be
available at a time interval ∆t = t2-t1 and it is expressed by the following
formula;
t2
1
t2 − t1 ∫t 1
Am = A(t)dt (11.1)
• steady-state availability As(t) which is the probability that the system will
be available for a very large period of time and it is expressed by the
following formula:
t
1
t →∞ ∫0
As(∞) = lim A(t )dt (11.2)
µ
- A= (11.3)
µ+λ
µ 2 + 2λµ
Α= (11.4)
µ 2 + 2λµ + 2λ2
A (λ, µ)
B (λ, µ)
Figure 11.1
These theoretical models are used during the design phase of a system for the
prediction of the availability of the final product and during the operational life of
the system to improve the availability of the system (e.g. by increasing the
repair rate or decreasing the failure rate or both).
• cumulative outage time due to all failures over a period of one year ftot;
a1 a2 a3 a4 a5 a6 a7
Operating
Non-operating s f1 f2 f3 f4 f5
(one year)
Figure 11.2
N
f tot = ∑ fi (11.5)
i =1
NOTE The term “failure” means failure of the sensor to provide data inside
the specified limits in the EUROCONTROL Surveillance Standard and
may be caused by a malfunction of the sensor’s hardware, firmware
or software.
This can be done either by the sensor’s monitoring and control system or by
an external equipment . We can define “the failure” of the sensor in many
different ways depending on the level of sophistication of the monitoring and
control system. One simple way is to define a failure as the non provision of
target reports including field monitors for more than 2 antenna scans as it is
defined in the EUROCONTROL Surveillance Standard. This definition is
based on the assumption that the monitoring and control system of the sensor
will switch off the sensor or give an alarm to the user if the quality of the
provided data is below the specified level. This is not always the case because
the existing monitoring and control systems are checking a very limited
number of performance parameters usually in an indirect way.
a) the Pd by checking the station parameters which are related to the detection
performance such as:
• power;
• noise figure;
a) the Pd by checking:
• power;
So for the existing systems we shall use the above described definition of
failure assuming in addition that the monitoring system of the sensor is
sensitive to changes of the station parameters which have an impact to the
detection and quality performance of the sensor.
ANNEX A (RECOMMENDED)
TECHNICAL PERFORMANCE ANALYSIS.
A.1.1 General
The aim of the technical performance analysis is the in-depth and thorough
evaluation of the radar performance parameters so as they;
The technical performance analysis should be carried out using the same data
collected for an overall performance assessment. In this way the overall
results provide a link between the technical performance results and those of
other evaluations. The analysis technique is that of computer aided evaluation
using recorded data at the output of the sensor / input of the central radar data
processing system supported (if needed) by multilevel recordings at various
I/O interfaces, map data, digital terrain elevation data and visual observations.
Chaining and trajectory reconstitution algorithms shall be applied to the data in
order to evaluate the performance parameters of the radar sensor under test.
A.1.3 Procedure
For the technical performance analysis of the Radar Sensor, the conditions of
the data collection shall be known but also the whole set up of the radar
sensor. In this way the technical staff can find the reasons of possible
deviations of the sensors performance from the previous one.
The integration of a radar sensor in the ATC system follows a series of tests,
which are the following:
The CMV shall be set to the OCV for all evaluation campaigns whose objective
is to allow results comparison between different sensors and for submission to
EATCHIP CIP. Subsequent modification to the system Functionality and/or
operational use may require the recalculation of the OCV. For this the CMV
shall be included in the evaluation report (annex) so the correlation of results
between evaluations will be more efficient.
For the technical performance analysis of the Primary radar sensor the
following parameters shall be measured (if applicable):
For the technical performance analysis of the secondary radar sensor the
following parameters shall be measured (if applicable):
PARAMETERS UNITS / REMARKS
Antenna tilt Deg
Antenna polar diagrams Horizontal and vertical polar
uplink and downlink diagrams
R.P.M rotations / minute
P.R.F Hz = 1/ sec
Staggering ratio / pattern dimensionless / Hz
Instrumented range NM
Power / power sectorization KWs / P = F(ϑ)
Mode interlace pattern
ISLS / IISLS sectorization
RSLS Yes / No
Pulse shape / pulse spacing A = f(t) / µsec
Power spectrum P = f(f)
Receiver sensitivity dBm
Receiver dynamic range dB
Receiver bandwidth A = f(f)
Plot extractor parameters
Plot extractor performance a) Pd, Pfa, Pcv; b) Defruiting;
c)Degarbling;
Plot filter combiner
parameters
Plot filter combiner perfor- a)Pd, Pfa Pcv;b)Reflection rejection;
mance / Overload reaction
The measurement methods for the above are described in Annex B.
The term environment in this document defines not only the external to the
data sample factors (i.e. weather, jamming, lobing etc.), but also the specific
characteristics / MOF (Mode Of Flight), of the data sample, that may affect the
radar performance (i.e. transponder performance, traffic density, etc.). The
above factors shall be identified, in order to evaluate their effect to the results of
the analysis. In this sense the environmental factors that affect the technical
performance of the primary sensor are the following:
• lobing;
• air-route structure;
• mode of flight(MOF);
For the secondary radar sensor the environmental factors are the following:
• lobing;
• transponder performance;
• air-route structure;
• reflectors/multipath effects.
These factors can either be identified by the analysis tool or by the use of
special test set-ups. The level of testing depends on the measurement
campaign (i.e. acceptance tests, commissioning, post modification ).
For acceptance tests /commissioning all the interfering / jamming sources and
their characteristics in the frequency and in the time domain shall be defined.
This shall be done either by analysing the spectrum at the output of the
receiver by using special tools (before data collection) or using the recorded
data at the output of the radar sensor with the transmitter switched to the
dummy load.
A.1.3.1.2.1.2 Lobing.
The areas of ground and sea clutter shall be identified using map data . When
it is needed the clutter density shall be measured, either by recording the video
at the output of the receiver, or by using special tools.
The structure of the air-routes creates certain flight patterns (i.e. tangential
flights) that affect the radar detection performance. So this effect shall be id-
entified and used for the classification of the data according to the aspect angle
to the sensor.
The performance of the MTI/MTD depends on the radial (to the radar sensor)
speed of the target. In the case that the plot filter combiner uses tracking, the
MOF of the target may degrade the radar sensor detection performance. For
this the MOF of each target shall be identified. This shall be done using the
reconstituted trajectory information.
The radar sensor performance is degraded, when the targets are in close
proximity (resolution limitations).These cases shall to be identified and the data
sample shall be classified accordingly.
The primary radar sensor detection performance depends on the radar cross
section of the target. An estimation of the radar cross section distribution of the
data sample can be done using video recordings at the output of the receiver.
For acceptance tests /commissioning all the interfering / jamming sources and
their characteristics in the frequency and in the time domain shall be defined.
This shall be done either by analysing the spectrum at the output of the
receiver by using special tools (before data collection) or using the recorded
data at the output of the radar sensor with the transmitter switched to the
dummy load.
A.1.3.1.2.2.2 Lobing.
The theoretical lobing diagram / s of the sensor antenna, for uplink and down-
link, shall be calculated. The calculation shall use digital terrain elevation data
and the antenna vertical polar diagram.
The interrogation rate, the sidelobe suppression rate and the impact from the
TCAS operation inside the CMV shall be measured and taken into account in
the analysis of the performance of the radar sensor.
The structure of the air-routes creates certain flight patterns (i.e. tangential
flights) that affect the radar detection performance (i.e. shielding of the
transponder antenna). So this effect shall be identified and the data sample
shall be classified according to the aspect angle to the sensor.
In the case, that the plot filter combiner uses tracking, the MOF of the target
may degrade the radar sensor performance. For this the MOF of each target
shall be identified .This shall be done using the reconstituted trajectory
information.
The reflectors (reflecting surfaces) shall be identified and classified using map
data in two classes permanent and temporary. The recorded data shall also be
checked regularly for false targets coming from multipath effects and the
period and area shall be identified.
For the site acceptance and the site commissioning the CMV shall clearly be
defined, before the collection of data, using the contractual / operational
require-ments, digital terrain elevation data and theoretical calculations of the
coverage. In all other cases the CMV shall be the OCV.
Two groups of static Input Classes at the evaluation level are foreseen:
• radar type;
• HPD, VPD;
• resolution characteristics;
• MTI/MTD characteristics ;
• terrain properties;
• screening angles ;
• Airspace volumes
The table below gives an extensive, but not exhaustive, list of dynamic input
classes for use at the Analysis level. Many classes are linked to a particular
analysis whilst others may be employed in any analysis
Time The time would be split into discrete intervals
Plot Type Type of the plot PR/SSR/COMB
A Invalidated If the mode A code of the plot is Invalidated
A Incorrect If the mode A code of the plot is assessed to be incorrect
The data analysis shall result in a detailed evaluation the Radar Sensor (PSR
/SSR) performance parameters specified in the EUROCONTROL Radar
Surveillance Standard. The methods for the analysis, are described in the follo-
wing paragraphs. The performance parameters are divided into:
• Availability.
The results of the technical performance analysis of the radar sensor during
acceptance / commissioning testing shall define the Coverage. During the
operational life of the system it shall be possible to identify degradation of the
performance using results from baseline measurement campaign(i.e.
commissioning).
A.2.1 General
For the technical performance analysis of the radar sensor the data shall be
classified manually or automatically, as a function of :
• radar cross section taking into account the aspect angle (if possible);
Any extrapolated target reports shall be identified and removed from the
analysis.
near to the target (the adjacent a/c can be considered as a very strong
interference) and in case of the use of tracking for plot filtering by the Mode Of
Flight of the target.
For the estimation, of the probability of the target position detection the
primary and combined target reports recorded at the output of the radar sensor
shall first be chained. The chaining function shall associate each target report
to one and only one trajectory identified by an aircraft number. With this
association the number of the expected target reports inside the CMV can be
calculated and the gaps due to detection misses identified. The recorded target
reports shall come from opportunity traffic except the case of heavy ground
clutter environment in which the target reports shall come from test flights.
The probability of target position detection of a cell shall be calculated using the
formula :
The calculation shall not take into account any extrapolated target
report or false target report. For the test flights or individual flights, the
probability of detection of each point of the trajectory and the average
probability shall be calculated. The calculation of the Pd of a point of a
trajectory shall be based on the above formula (A.2), using a sliding window
whose centre is the point of the trajectory under test see figure A1. This shall
be called elementary or local Pdi.
i=k
i=j
Pdj
Pdk
Figure A-1
When opportunity traffic is used the Pd for the following class and its
subclasses of targets shall be estimated :
Subclasses of A:
The estimation of the Pd for the targets inside the close proximity area
(areas 1a, 1, and 2 figure A-2 ) Class B it is related to the resolution
capabilities of the radar sensor and it is treated in the relevant paragraph A.3.3.
• Horizontal polar(for selected flight levels) and Vertical polar (for selected
azimuthal sectors) diagrams graduated in discrete detection bands such as
e.g. 50%, 50-80%, 80-90%, 90-95%, 95-98%, 98-100%;
• Overall Figures (for all the subclasses of targets) derived from the
mean detection values, for each detection cell in the calculation;
• Vertical diagrams in the case of special test flights, or when the majority of
the target reports are combined (there is height information from the SSR
target report). These shall be in a form of iso-Pd lines drawn for selected
azimuths;
• Distribution in space and time and the size of the detection gaps .
• radar cross sections(taking into account the aspect angle of the targets);
For this, in the case of site acceptance tests special test flights are
considered mandatory especially if there is heavy ground clutter and no
multiradar coverage.
Recommendation The user must be aware that the Pd results for cells with
only one chain may not normally be used for judging the sensor Pd
performance . However data in such cells may be used for further analysis
and problem investigation. In the situation where only one chain is present and
the Pd is poor the benefit of the doubt should be given to the sensor unless it is
certain that the target was well visible.
• sidelobes;
• splits;
• positional jumps.
• ground clutter;
• sea clutter;
• weather clutter;
• ships, cars.
The analysis of the false target reports shall be based on the different
characteristics and behaviour that appear from the true aircraft targets. A
chaining algorithm shall be applied to the recorded data. As a result chained
data shall be derived with the history and the characteristics of each target
forming a chain. Then the false target reports shall be sorted out based on the
particular characteristics they possess which are the following :
• they are pure primary reports except the case of ships or remote passive /
active reflectors;
• they form tracks with short life and relative low speed;
• they appear in pairs with azimuth separation less than the antenna
beamwidth.(splits).
In order that the results of the false targets reports analysis may
interpreted correctly and be compared against specified figures (acceptance
tests) or measured figures (previous campaigns) the data sample shall be
supported by visual observations (i.e. to sort out data that appear to be false
targets but that are real targets forming sort life tracks due to detection misses
caused by screening or lobing effects.) and controlled regarding the source of
the false target report to:
A.3.1 General
• Positional accuracy ;
• Resolution.
A.3.2.1 General
θ m = measured azimuth;
δ θ = azimuth bias;
• random errors :
• jumps.
• azimuth bias ;
For the technical performance analysis of the radar sensor the data
shall first to be classified in accordance to the distance to neighbouring
aircrafts and then in accordance to:
• σθ ≡0.53*θ/√ (S/N)
θ ≡half-power beamwidth .
The signal power at the detector input depends on the cross section of
the target. If the target flies over a clutter area (ground or sea clutter) or in
weather clutter the standard deviations depends on the signal to clutter ratio
(S/C). At the signal processor output -after the MTI/ MTD processing- the
signal to clutter ratio depends on the targets Doppler speed. More generally the
errors depend on the signal to interference ratio (S/I), if we define as
interference every signal that interferes the useful signal. In that sense the
neighbouring aircrafts shall be considered as a very strong interfering source if
there are in the close proximity (see A.3.1). rf interferences).
The reconstruction of the reference trajectory (for each target inside the
CMV) shall be based :
a.1) at least part of the CMV is covered from another two radars ;
b)on multilevel recordings (e.g. recordings at the video level and at the
plot level) when the a.1 and a.2 are not applicable.
c) on DGPS data (coming from test flights) time synchronised with the
recorded target reports or any other reference positioning system. The DGPS
position of the target together with the corrected DGPS time should be taken
as the reference . The DGPS position must be projected onto a common plane
for comparison with the target report data. A stereographic projection using the
same earth model as the sensor’s under test is best. In the case of mono-
radar evaluation the earth model of the host RDPS shall be chosen.
• azimuth bias;
• azimuth error
Class B : targets inside the close proximity areas ( areas 1a, 1 and 2
figure A-2). Subclasses of A and B :
In the case of site acceptance tests the close proximity area shall be
checked thoroughly. If the opportunity traffic does not provide suitable data
sample , special test flights shall be used ( the same data sample shall be
used for the resolution analysis.)
A.3.3 Resolution.
A.3.3.1 General
∆ρ (NM) (3)
±2τ
± 1.5 τ (2)
±τ (1)
(1a)
Figure A-2
τ (NM) =τ (µsec) ∗ c /2 ;
θb = nominal 3 dB beamwidth.
For the technical performance analysis of the radar sensor the data
shall be classified in accordance to :
• the difference between the radar cross sections of the targets (if possible);
(A.3.3)
The Pd inside the close proximity area shall be estimated for the
classes defined in par. A.3.3.2 above.
For this in site acceptance testing special test flights (see ANNEX D)
are considered as mandatory in order to produce a suitable data sample which
can also be used for accuracy analysis.
A.4.1 General.
N
Pd = ∑ C κN pκ (1 − p) N − κ (A.4.1)
κ =η
N ≡ number of interrogations ;
• the number of interrogators operating near the station (because they may
block the transponder);
• the flight pattern (if the flight is tangential to the radar the fuselage may
shield the transponder’s antenna);
• the number of Fruit (if there are too many fruits we have to increase the
threshold n).
The above are applicable in the case that the a/c is outside the close
proximity area.
For the estimation of the probability of the target position detection the
target reports shall at first to be chained. The chaining function shall associate
each target report to and only one trajectory identified by an aircraft number
(aircraft identification ) .With this association the number of the expected
target reports can be calculated and the gaps due to detection misses
identified .
The calculation shall not take into account any extrapolated target
report, false target report or multiple target report.
i=k
i=j
Pdj
Pdk
Figure A-3
The Pd for the class of data coming from targets lying outside the
close proximity area (area 4 figure A-7) shall at first to be estimated and then
for the subclasses defined in par A.4.2.1 above
The estimation of the Pd for the targets inside the close proximity
area (areas 1, 2, and 3 figure A-7 ) it is related to the resolution capabilities of
the radar sensor and it is treated in the relevant paragraph A.5.3.
• Horizontal polar (for selected Flight levels) and Vertical polar(for selected
azimuthal sectors) diagrams graduated in discrete detection bands such as
e.g. 50%, 50-80%, 80-90%, 90-95%, 95-98%, 98-100%;
• Overall Figures (for all the subclasses defined above) derived from the
mean detection values for each detection cell in the calculation;
For the estimation of the probability of code detection only the target
reports used for the calculation of the target position detection shall be taken
into account . So only the target reports that the chaining process associate to
an aircraft trajectory shall be considered.
Pcd = The number of target reports with validated and correct Mode A
Mode A The number of detected target reports chained to the trajectory
Pcd = The number of target reports with validated and correct Mode C
The number of detected target reports chained to the trajectory
Mode C
(A.4.3)
NOTES
2. Correct means the Mode A/C code value corresponds to the current
"correct" value for the associated trajectory. The correct value is
determined and maintained by the analysis system.
When the analysis is based on the opportunity traffic the CMV shall be
divided in elementary three dimensional cells and the Pcd and Pcv inside each
cell shall be calculated. The size of the cell depends on the required accuracy
of the measurement and actually from the number of the expected trajectories
inside the cell.
The Pcd and Pcv shall be estimated for all the classes defined in par.
A.4.3.1 (data coming from targets lying outside the close proximity area figure
A-7).
The estimation of the Pcd, Pcv for targets inside the close proximity
area (areas 1, 2, and 3 figure A-7 ) it is related to the resolution capabilities of
the radar sensor and it is treated in the relevant paragraph A.5.3.
For the technical performance the Pcd and Pcv shall be presented in :
• Overall Figures derived from the mean detection values for each detection
cell in the calculation;
In order that the results of the Pcd and Pcv analysis may be interpreted
correctly and be compared against specified figures (acceptance tests) or
measured figures (previous campaigns)the data sample shall be controlled
regarding mainly the distance to the neighbouring a/c and additionally the :
For the technical performance analysis of the radar sensor the data
shall be classified in accordance to :
• transponder performance;
• Mode of Flight;
The extrapolated target reports shall not be used for the analysis .
For the estimation of the False / Multiple SSR target reports ratio the
target reports shall at first be chained. As a result chain data shall be derived
with the history and the characteristics of each target report forming a chain.
Then the False /Multiple target reports shall be sorted out based on the
particular characteristics they possess which are generally the following :
• they are not synchronised ( asynchronous fruits which normally shall not
appear at the output of the plot filter);
• they form track with relative short life. (synchronous fruits and second time
around replies );
• they may have the same A/C code as the real aircraft target reports but they
form track with relative sort life and they appear in certain sectors bounded,
by the orientation and the size of reflecting surface. (reflections );
• they appear in pairs with small azimuth separation less than the antenna
beamwidth (splits );
The algorithm shall also correlate the recorded and processed data,
with HPD of the antenna of the radar sensor, for the identification of the
multiple SSR target reports coming from sidelobes.
The classification of Multiple target reports is made on the basis of range and
azimuth separation from a reference target. The diagram below illustrates how
the range and azimuth separation classes associate with each other. Where
the classes overlap other criteria are used to decide to which class a multiple
target will be assigned, e.g reflections can only be greater in range than the
reference target.
Although the classes are defined with individual minimum and maximum
range/azimuth limits, in practice several of the boundaries are defined by the
range precision and 3dB beamwidth of the system under test.
Reflections
SP Max Rng
Back
Refl Min Rng Range Range/Az Lobe
SP Min Rng Split Split
ONM
The False / Multiple SSR target reports ratio shall be calculated using
the following formula :
(A.4.5)
(A.4.6)
(A.4.7)
The number of multiple SSR target reports
b) RMulti =
The number of detected secondary & combined target
reports
(A.4.8)
The number of multiple SSR target reports from splits
b.1) RSplits =
The number of detected secondary & combined target
reports
(A.4.9)
The number of multiple SSR target reports from
reflections
b.2) RRefl.=
The number of detected secondary & combined target
reports
(A.4.10)
The number of multiple SSR target reports from
sidelobes
b.3) RSibel.=
The number of detected secondary & combined target
reports
In addition to the above an algorithm shall correlate the processed data
with map data and if possible with digital terrain elevation data for the
identification of the reflecting surfaces.
Recommendations.
In order that the results of the False/multiple false targets analysis may
be interpreted correctly and be compared against specified figures
(acceptance tests) or measured figures (previous campaigns) the data sample
shall be controlled regarding mainly the distance to neighbouring a/c and
additionally the :
• transponder performance;
A.5.1 General
• Positional accuracy ;
• Resolution .
A.5.2.1 General
θ m = measured azimuth
δ θ = azimuth bias
The bias errors are considered as fixed values corresponding for range
and azimuth bias to the mean random error.
• random errors :
• jumps.
• azimuth bias ;
NOTE- Jumps are target reports with errors in position three times higher or
more than the standard deviation for range and azimuth .
• data coming from targets in the “isolated targets” area (area 4 figure A-
10);
• data coming from targets in close proximity area (areas 1, 2, and 3 Figure
A-10).
• transponder performance;
For the estimation of the positional accuracy the recorded data shall
at first to be chained. Then a reference trajectory shall be reconstructed for
each target inside the CMV and compared against the measured positions.
The reconstruction of the reference trajectory (for each target inside the
CMV) shall be based :
a.1) at least part of the CMV is covered from another two radars ;
NOTE Position reconstruction can only be reliable when the target is seen by
two or more sensors . If more than 30% of the chained data are seen
by only one sensor then the quality analysis results may be unreliable.
b)on multilevel recordings (e.g. recordings at the video level and at the
plot level) when the a.1 and a.2 are not applicable.
c) on DGPS data (coming from test flights) time synchronised with the
recorded target reports or any other reference positioning system. The DGPS
position of the target together with the corrected DGPS time should be taken
as the reference. The DGPS information will normally be in Latitude/Longitude
and height above Mean Sea Level with coordinates in WGS84. The sensor
data will normally be either Range/Azimuth/FL, X/Y local/FL or X/Y System/ FL.
The coordinates for the sensors and system origin must be stated in WGS84.
To chain the two sources of data and to use the DGPS position as a reference
both data sources must be projected onto a common coordinate system.
Either a Stereographic system (height independent) or a x/y/FL system may be
used. In the case of a mono-radar evaluation the system origin should be the
sensor site coordinates, i.e. x/y local = x/y system. The GPS altitude values or
sensor FL values must also be normalised if errors are to be minimised -
correction of Mode C or GPS Altitude values for the regional QNH at the sensor
location and time of recording would be adequate.
• azimuth bias;
• azimuth error
The positional accuracy shall be estimated for all the classes and
subclasses defined in par A.5.2.2 above.
A.5.3.1 General
NOTE
2.- Correct means the Mode A/C code value corresponds to the current
"correct" value for the associated trajectory. The correct value is
determined and maintained by the analysis system.
For the estimation of the false code information only the secondary or
combined target reports used for the calculation of the probability of target
position detection shall be taken into account . So only the target reports that
the chaining process shall associate to an aircraft trajectory shall be
considered.
The number of reports with incorrect Mode A or/and Mode C (valid or not)
R = The number of detected secondary/combined reports chained to trajectories
Over/f
(A.5.3)
(A.5.4)
(A.5.6)
The false code information shall be estimated for all the classes and
subclasses defined in A.5.3.2 above.
In order that the results of the false code information analysis may be
interpreted correctly and be compared against specified figures (acceptance
tests) or measured figures (previous campaigns) he data sample shall be
strictly controlled regarding first the distance to the neighbouring a/c’s and then
in accordance to :
A.5.4 Resolution.
A.5.4.1 General
∆ρ (NM)
(4)
±∆ρ 2
(2) (1)
±∆ρ 1
(3)
Figure A-10
∆θ 1 = 2∗ n∗360 f ∗ t (A.5.7)
For :
• ∆θ 1= 0.6 Deg;
• ∆ρ 1 = 0.05 NM;
• ∆ρ 2 = 2 NM.
For the analysis of the resolution capabilities of the radar sensor the
data shall be classified in accordance to :
• transponder performance;
For the evaluation of the resolution capability of the radar sensor the
probability of position and correct code detection for each individual target shall
be estimated. For this the recorded data shall at first to be chained then a
reference trajectory shall be reconstructed for each target inside the CMV. The
reconstruction of the reference trajectory shall be done as it is described in
par. A.5.2.3 above. The resolution analysis is based on sections of chains
which are in ‘close approach state’ - the targets are within a certain mutual
separation from each another.
Before the resolution analysis can take place the test cases must be isolated
from the rest of the chained data set. In a multi-radar environment a simple
proximity filter in x/y/time can be used to identify when two targets enter a
‘close approach’ state. In a mono-radar case then Range/Azimuth/Time may
be used. The object of the classification is to isolate potentially interesting test
cases. Once a number of such cases have been identified then each one
should be examined to determine if it is suitable for detailed analysis. All of the
identified cases should normally be used for the global analysis of Position and
Code information. The detection of close approach cases may use the
reference trajectory or any algorithm which has the continuous state of each
trajectory. Raw sensor data are not suitable for determining mutual separation
of targets due to detection failures.
Using this reference trajectory information an algorithm shall first sort out all
pairs of trajectories having parts falling inside the close proximity area (Figure
A-10 thick line) and then define the parts falling inside areas 1, 2 and 3. The
algorithm shall calculate the number of expected target reports for each part of
the trajectory and the total number of expected target reports for each close
proximity area. At last using the chaining information the number of detected
target reports inside the areas 1, 2, and 3 shall be calculated.
(A.5.8)
The number of detected reports chained in close proximity
Pd=
The number of expected reports in close proximity
(A.5.9)
The number of reports with correct and valid Mode A
Pcd=
ModeA The number of detected reports chained in close proximity
(A.5.10)
The number of reports with correct and valid Mode C
Pcd=
ModeC The number of detected reports chained in close proximity
In the case of site acceptance tests the close proximity areas shall be
checked thoroughly. If the opportunity traffic does not provide suitable data
sample, data coming from special test flights shall be used ( the same data
sample shall be used for the accuracy analysis.)
A.6.1 General
For the evaluation of the data combining capability of the radar sensor
the probability of association Pas and the false association rate Rfas shall be
estimated for the classes of targets defined above.
(A.6.1)
NOTE Correct / false combined target report is a target report coming from
correct / false association of a primary and a secondary target report.
A.7.1 General
The processing delay mainly depends on the load of the system so the
data shall be classified in accordance to the load conditions.
To estimate the on site processing delay the time of detection for each
target and the time of transmission shall be recorded and their difference shall
be calculated. The recording shall be done at the level of:
A.8.1 General
• instantaneous availability A(t) which is the probability that the system will
be available at any random time t ;
• mission availability Am (t) which is the probability that the system will be
available at a time interval ∆t = t2-t1 and it is expressed by the following
formula;
t2
1
t 2 − t 1 ∫t1
Am = A(t ) dt (A.8.1)
• steady-state availability As(t) which is the probability that the system will
be available for a very large period of time and it is expressed by the
following formula :
1 t
t → ∞ ∫0
As(∞ ) = lim A( t ) dt (A.8.2)
µ
A= (A.8.3)
µ+λ
µ 2 + 2λµ
Α= 2 (A.8.4)
µ + 2λµ + 2λ2
A (λ, µ)
B (λ, µ)
Figure A.11
• cumulative outage time due to all failures over a period of one year atot;
a1 a2 a3 a4 a5 a6 a7
Operating
Non-operating
s f1 f2 f3 f4 f5
Specified operating time
(e.g. one year)
Figure A.12
N
f tot = ∑ fi (A.8.5)
i =1
For the estimation of the availability of a radar sensor we shall use the
following formula ;
∑ a x100
i= 1
ii
Α= 6 5
(A.8.8)
∑a + s+ ∑ f
i =1
i
i =1
i
NOTE The term “failure” means failure of the sensor to provide data inside
the specified limits and may be caused by a malfunction of the
sensor’s hardware, firmware or software.
∑a i
i =1
MTBF = (A.8.10)
5
MTBF=1/λ (A.8.11)
−t −t
R=e λ
=e MTBF (A.8.12)
The reliability is called also probability of survival Ps. From the formula
A.8.12 the probability of surviving a period of time equal to MTBF is 0.37 or 37
per cent which means that the MTBF should not be considered as a failure
free period.
The site acceptance tests last normally for a couple of weeks a period
which is not sufficient for the measurement of the MTBF of the modern
electronic equipment which have a minimum of around 1000 hours. During this
period we can check only for design problems if any under extreme conditions
(e.g. maximum/ minimum temperature, supply voltage variances, overload
conditions etc.). This kind of test is called endurance test and depends on the
equipment and the time available but it should not last less than 36 hours. The
failure rate or the equivalent MTBF of an equipment varies during the life time
of the equipment as it is shown in figure A.13 below.
0 tb tw t
Figure A.13
Period III is called wearout period where the failure rate is growing
rapidly . The equipment starts to age.
The MTBF of the system can be checked during the warrantee period
of the system which is considered as stable period and normally lasts at least
for a year. This check shall be repeated regularly during the life time of the
equipment. The estimation of the availability of a sensor shall be based on the
recorded outage time due to any given failure of the system over a period of
one year.
This can be done either by the sensor’s monitoring and control system
or by an external equipment . We can define “the failure” of the sensor in many
different ways depending on the level of sophistication of the monitoring and
control system. One simple way is to define a failure as the non provision of
target reports including field monitors for more than 2 antenna scans as it is
defined in the EUROCONTROL Surveillance Standard. This definition is
based on the assumption that the monitoring and control system of the sensor
will switch off the sensor if the quality of the provided data is below the
specified level. This is not always the case because the existing monitoring
and control systems are checking a very limited number of performance
parameters usually in indirect way.
• power;
• noise figure.
a) the Pd by checking :
• power.
b)the alignment error by checking the position of the remote field monitor.
The monitoring of the quality of the radar information is done at the existing
systems by the controller.
So for the existing systems we shall use the above described definition of
failure assuming in addition that the monitoring system of the sensor is
sensitive to changes of the station parameters which have an impact to the
detection and quality performance of the sensor. During the acceptance testing
of the sensor the above measurements shall be supported by 24 hours visual
observations of the quality of the radar information by experience controllers.
• and the indications of the monitoring and control (if it is used) are related to
the detection and quality performance of the provided radar data .
ANNEX B (INFORMATIVE)
B.1 General
The output interfaces are points in the radar system where data can be
output, either in analogue or digital form for:
and c) recording.
The input interfaces are points in the radar system where data can be
injected either in analogue or digital form in order to test the system particularly
for special cases including performance anomalies. The injected signal/data
may be either analogue or digitally synthesized (simulated) or in the form of a
recorded message.
This is the radiated RF input to the PSR system and a test input will typically
be from an active reflector. This is an input-only interface.
At this point RF tests signals can be injected into the input port(s) of the PSR
receiver(s). This is also an input-only interface.
This point represents the output of the PSR receiver(s) where detected video
can be output for recording purposes. Similarly, this point acts as an input
interface for the injection of synthetic (simulated or recorded) video. According
to PSR system philosophy, the video at this level may be either analogue or
digital (quantized).
This I/O interface represents the output of the PSR intermediate video
processing of the primary radar system. The video at this point will have been
subjected to processes such as MTI, MTD, CFAR, LogFTC in order to obtain
usable data (analogue or digitized) for input to the primary plot extractor. At this
point data can be either injected (tests, simulations, etc.) or extracted
(recordings etc.).
This I/O interface represents the output of the primary plot extractor and the
data is entirely in digitized form. As in the other cases, data can either be
injected or extracted according to the task to be carried out.
At this point, the extracted PSR plots have been subjected to a further rotation
scan to scan processing in order to eliminate false plots, and possibly to form
monoradar tracks. As in the other cases data can either be injected or
extracted at this point according to the task to be carried out.
This is the radiated RF input to the SSR system and a test input will typically
be from a remote field (or site) monitor. This is an input-only interface.
At this point, RF test signals can be injected into the input port(s) of the
receiver(s). This is also an input-only interface.
This point represents the output of the SSR receiver(s) where detected video
can be output for recording purposes. Similarly, the point acts as an input
interface for the injection of synthetic (simulated or recorded) video. According
to SSR system philosophy, the video at this level may be either analogue or
digital (quantized).
This I/O interface represents the output of the SSR intermediate video
processing of the secondary radar system. At this level the video(s) may have
been subjected to such processes as:
• RSLS processing;
• Video reconstitution.
The data at this point may be either in analogue or digital form and provides the
necessary input to the secondary plot extractor. It should be noted however
that in modern SSR equipment (particularly for monopulse SSR applications),
the receiver, intermediate video processing and plot extractor may be one
common unit, making it more difficult for accessing data (video/plots) at this
level. At this point, data can be either injected (tests, simulations etc.) or
extracted (recordings etc.).
This I/O interface represents the output of the secondary plot extractor and the
data is entirely in digitized form. As in the other cases, data can either be
injected or extracted according to the task to be carried out.
At this point, the extracted SSR plots have been subjected to a further
processing in order to eliminate false plots, and in some instances form
monoradar tracks. As in the other cases, data can either be injected or
extracted at this point according to the task to be carried out.
In many cases this unit may have an additional input for external (e.g. primary
radar) synchronization.
At this point, the extracted PSR and SSR data have been subjected to certain
combination criteria and the output at CIO1 will consist of:
• combined plots/tracks;
• SSR-only plots/tracks;
• PSR-only plots/tracks.
In the case that the radar station is PSR or SSR-only, no plot combiner will be
required.
This is a special case of the PIO6 and SIO6 I/O Interfaces and corresponds to
a system where no separate PSR and/or SSR surveillance processing is
carried out before plot combination. As in the other cases, data can either be
injected or extracted at this point according to the task to be carried out.
At this point, however, the modulated data from the transmitter containing
possible errors due to additional noise from the transmission line and other
distortions, can be analysed.
• commissioning ;
• post modifications.
The characteristics of the equipments forming the radar chain(e.g.
antenna, transmitter, receiver) that can be measured depend on the available
infrastructure and test equipments. So some of the parameters can be
measured only in the factory during the factory acceptance tests. The following
paragraphs give a very limited information for the measurements in the factory
and some guidelines for the on site measurements.
B.3 Antenna performance analysis
B.3.1 General
a) antenna gain ;
a)Gain.
The azimuth squint and skew is the variation in azimuth and elevation
of the peak of the beam with respect to the mechanical elevation of the
antenna. This characteristic can be measured only during factory acceptance
tests using test sites and special test equipments.
Ellipticity ratio and integrated cancellation ratio are equivalent terms and can be
interchanged. These characteristics can be measured only in the factory
during factory acceptance tests.
B.4.1 General
a) output power;
b) power spectrum;
c) pulse characteristics/spacing.
For the measurement of the above characteristics the PIO7 and SIO7
interfaces shall be used.
a) output power
• spectrum analyser;
b) power spectrum
• carrier frequency;
• duty cycle;
• peak power;
• average power.
c) pulse characteristics/spacing
• rise time;
• fall time;
• duration;
For the SSR the pulse space /spacing shall be checked for compliance
with the specified figures in Annex 10.
Not applicable.
B.5.1 General
• losses;
• STC/GTC;
• noise figure;
• bandwidth;
• dynamic range;
a) losses
b) STC/GTC
In the primary sensors the gain control is applied at the RF and /or IF
level and is derived usually from ground clutter maps. In the secondary
sensors the STC is applied at the video level. For the PSR STC/GTC
measurement a rf test pulse shall be injected (a signal generator shall be
connected at the PIO2 interface) when the system is in operation and the
signal strength shall be recorded at the PIO4 interface. For the SSR STC/GTC
measurement a video test pulse shall be injected (a signal generator shall be
connected at the SIO3 interface) and the signal level shall be recorded at the
SIO4 interface.
c) noise figure
d) bandwidth
The error pattern is measured as the ratio of the log Sum pattern to the
Difference pattern.
f) Dynamic range
The MDS is defined either for 0db Signal to Noise at the output of the
receiver and then it is called tangential sensitivity or for 3db S/N. The set up is
as for the dynamic range and the MDS is the power for which S/N at the output
is either 0db or 3db.
( S / C) o
I=
( S / C)i
B.6.1 General
• extraction criteria;
• correlation interpolation;
• defruiting function;
• code detection/validation;
• resolution.
b)extraction criteria
With the same test set up as above the leading and trailing edge
criteria can be tested.
c) correlation interpolation
With the same test set up the performance of the plot extractor to
interpolate the position of the target in the presence of noise /clutter can be
checked. At the output the recorded position of the test target is checked
against the expected one.
d) defruiting
f) resolution
The resolution can be check either using test targets or live data as
described in Annex A above.
Not applicable.
B.7.1 General
The aim of the plot filter is to reduce the number of false plots without
affecting the probability of detection . The majority of the plot filters are using
tracking. For the PSR sources of the false plots are the following:
• interference.
For the SSR the sources of false plots are the following:
• reflections;
• sidelobes;
• splits.
The performance of the plot filter can be checked using live traffic data
and making recordings at the input PIO5/SIO5 and at the output PIO6/SIO6 or
CIO1 as described in Annex A above. The overload reaction can be checked
using a plot simulator .
Not applicable.
ANNEX C ( RECOMMENDED)
C.1 General .
• during the site commissioning of the radar sensor ,if there is no adequate
opportunity traffic .
Flight testing shall use small aircraft, equipped with an approved transponder,
for all radar flight tests. Small aircraft are considered to be the Beechcraft
Bonanza, Cessna 182, and other aircraft of similar size which represent nearly
the same reflecting surface. The Sabreliner, Jet Commander, Jetstar and other
jets of similar size are also regarded as small aircraft for the purpose of radar
flight checks. Aircraft selection should consider possible limitations due to
aircraft range, terrain, weather conditions, etc. The flight testing aircraft shall
carry a calibrated transponder for SSR power optimization and GTC curve
establishment. Flight test aircraft shall provide the pilot selection of any one of
the following three combinations of power output and sensitivity :
C.2.1 Introduction
C.2.2 Commissioning .
• equipment Optimisation;
• site Integration;
• presentation of results;
Special tests are conducted to fulfil a particular need and may be very limited in
scope. The following is an example of testing events:
• review performance;
The checklist, Table D1, indicates the requirements for installation of a new
antenna, a new generation multiple beam antenna, or an antenna with a
different radiation pattern. A flight test is not required following an antenna
pedestal or rotary joint replacement if the ground measurements of the
reflector position, feedhorn alignment, and antenna tilt of the replacement
pedestal are satisfactory.
C.3 Checklist
The tests required to complete a full commissioning flight test are contained in
table C-1. The procedures presented here are also those to be used singly
when the requirements for a special test may be satisfied with one or more of
the individual tests. Those items identified with an "x" are mandatory.
Engineering personnel shall evaluate the data obtained using targets of
opportunity to determine if further evaluation by a special flight test aircraft is
needed. The column labelled "transponder mode" denotes the proper aircraft
transponder configuration for the specific test.
Commis PSR/SSR Antenna
sioning Change
PSR SSR
Check same differ. same differ. transponder
Orientation x x x x x norm./norm.
Tilt x x x x x norm./norm.
PSR optimization x x x norm./norm.
• STC / GTC x x >>
• Beam crossover x x >>
>>
• false target optimization x x
SSR optimization x x x low/low
• power x x x norm./low
• SLS/ISLS x x x norm./low
low/low
• Modes/Codes x x x
low/low
• GTC/STC Establishment x x
PSR/SSR Integrity x x x norm./norm.
Vertical Coverage x x x low/low
Horizontal screening o x x norm./norm.
Airways/Route coverage x x x low/ low
standby equipment x >>
standby power x norm./norm.
C.4.1 Background
The purpose of this test is to determine and document the primary and
secondary radar sensor vertical coverage. The primary and secondary radar
coverage within the fringe envelope shall be evaluated using Radar analysis
tools, opportunity traffic, cooperating aircraft, or flight test aircraft. Radar data
recordings and analysis of the vertical coverage test are used as a continuing
database for a permanent record, and as a legal document certifying sensors
performance.
The test shall be conducted on reference bearings from the radar site. The
commissioning and all subsequent tests concerning sensors performance
shall be conducted on the same bearings for valid comparison.. One radial
shall be free of clutter, dense traffic and populated areas, and influences
created by line-of-site. If the CMV includes ground/sea clutter areas at least
one radial shall be flown over these areas.
The outer fringe shall be determined by evaluating tail-on targets and the inner
fringe by nose-on targets. Aircraft reflective surface and transponder antenna
characteristics vary between inbound and outbound flight;consequently, some
difference in coverage can be expected. Map checkpoints, a navigation system
radial, or radar vectors shall be used to remain on vertical coverage radial. All
pattern altitudes described herein shall be flown as height above the radar
antenna.
NOTE -In order to produce a meaningful database, the flight test a/c must fly
true altitudes (corrected for pressure and temperature).
C.4.3.1.1 Fringe Envelope Check. The flight test a/c shall fly outbound from the site at
1,000 ft above the antenna to the outer fringe, up to the outer fringe to the
required altitude, across the top inbound to the inner fringe, then down the inner
fringe to the 1,000 ft inner fringe. Probe and score the primary and secondary
fringes at 1, 2, 3, 5, 7, 10, 15, 20, 25, and 30 (as required) thousand ft.
Establish the ascending (outer) fringes by turning inbound and climbing to the
next higher level, flying inbound at the higher level until solid primary and
secondary reports are received, then turning outbound to establish the primary
and secondary at that level. Evaluate the inner fringes in the same manner,
with the directions reversed. Conduct the over-all-quality and auxiliary functions
test at 5,000 ft or 30,000 ft per the previous procedures.
C.4.3.1.2 Coverage Within the Fringe Envelope. Engineering personnel shall use
radar analysis tools and targets of opportunity to determine the coverage inside
the fringe envelope, and identify the location and extent of holes and other
lobing related anomalies. Coverage can be determined with analysis plots on
series of recording. Limit the target reports to a 20° wedge, centred on the
vertical coverage azimuth and filtered for the altitudes of concern. The SSR
delay should be active during the recordings, to provide a better separation of
primary and secondary target reports for independent analysis. Lobing will be
evident as primary and secondary target reports, exhibiting decreasing run
lengths as they enter a "hole", disappear in the null, then reappear with
progressively higher run lengths as they clear the ringe on the opposite side.
Include the printout plots in the facility permanent database.
NOTE- "SSR delay" refers to the technique of delaying the SSR signal beyond
the association window of the plot filter combiner.
When the PSR antenna is changed, fly the profile depicted in Figure C 2A .
For the same type of antenna, all requirements may be completed using
targets of opportunity. Comparison analysis is performed on the historic solar
data, SSR parameters, and performance measurements (targets of
opportunity) to ensure the same performance (commissioned) can be
expected with new antenna. When the antenna is replaced with different type,
or targets of opportunity are not available, checklist requirements shall be
completed using a flight testing aircraft.
a) Terminal SSR. Fly the profile for a primary antenna change as illustrated in
Figure C 2A.
b) En-route SSR. Fly the profile for a primary antenna change as illustrated in
Figure C 2B.
Using either flight test or rental aircraft, fly an orbit at an altitude and distance
which corresponds to the lowest screening angle at which coverage is
expected. Orbit radius of less than ten nautical miles shall not be used. DME or
headings provided by the controller may be used to maintain the orbit. Select
"Normal" on the aircraft transponder. MTI, if used, shall be gated to a range
inside the orbit radius, except those locations where ground clutter will obscure
the target unless MTI is used. If MTI must be gated outside of the orbit, the
radius of the orbit should be constantly changed to avoid target cancellation
due to tangential blind speed. For example, vary the pattern on a 12 NM orbit
between 10 and 14 NM so as to average a 12 NM orbit.
The airway coverage shall be checked using radar analysis programs and
targets of opportunity. Targets may consist of one cooperating aircraft or a
assortment of aircraft reports on a particular airway: Targets included in the
output data shall be Mode C or S equipped for essential altitude information.
Scoring may be accomplished either with radar analysis programs or
manually. Document fix positional coverage by filtering a data run with the
start/stop azimuth and high/low altitude that effectively "boxes" in the fix. Good
coverage within the box constitutes adequate coverage at the position fix.In the
case that there is no enough opportunity traffic the check shall be executed
with the following method:
C.9 Analysis
C.9.2 Evaluation
Continuous radar detection (one usable target report on every scan at every
azimuth and all altitudes) is a difficult requirement to meet due to antenna
lobing, physical limitations (line-of-sight), aircraft altitude, and antenna tilt.
Therefore, expect isolated or non-recurring misses. After three or more
consecutive misses in the radar pattern, investigate to determine whether a
hole exists and, if so, its size. Reference is made to Figure C4
C.9.3 Lobing
Fig.C.3 Lobing
C.9.4 Probing
Holes in radar detection are probed in similar manner to VOR or TACAN. The
following procedures may be used a guide, refer to Figure C4.
C.9.4.1 Horizontal. Fly through the area in question to determine the inner and outer
limits of the hole. Vary aircraft position by 10° of radar azimuth until the lateral
limits of the hole are determine.
C.9.4.2 Vertical. Fly through the centre of the pattern (established in the horizontal
probing procedure) at 1,000 ft increments to determine the upper and lower
limits of the pattern.
C.10 Documentation.
ANNEX D ( RECOMENDED)
D.1 General.
Resolution has an impact on the probability of position (PSR and SSR) and
code (SSR) detection when two aircraft are in close proximity:
Resolution has an impact on the quality of position data (PSR and SSR) and
false code detection when two aircraft are in close proximity:
Resolution can be tested during the different periods of the life cycle of a
sensor system. One of the following methods can be applied whereby the
circumstances of testing have been taken into consideration:
Purpose of Simu- Combination Live data from Live data Live data from
test lated of live and test from traffic test flights with
data simulated transponders of (optional)
data opportunity support of
DGPS data
FAT yes
SAT yes yes yes yes yes
Annual yes yes
performance
evaluation
RTQC yes
STCA yes yes
RSS yes yes
D.2.1 Simulated data.
The antenna shall be turning and the data are generated from a single test site
for range resolution testing and from a fixed test site in combination with a
mobile site for range and azimuth resolution. Attention shall be paid to the
elevation angle of the test sites.
Specific scenarios can be tested by making use of a fixed and a mobile test
transponder installed on a test site. Both transponders shall be programmable
in range but the mobile transponder shall be able to step through the range
window with fixed discrete steps. The Mode C shall be encoded as to reflect
the separation in range with the precision of discrete range steps. Care shall
be taken with the selection of the site in order the (M)SSR replies to appear as
typical.
Resolution cases from live data shall be analysed to study the impact of
resolution as one of the factors playing a role in the degradation of the reliability
and the quality of sensor data, e.g. statistics on the rate of occurrence etc. By
recording and replaying data at one level one might be in a position to test the
performance of a system at a lower level in the processing chain, e.g.
recordings at video level might allow for testing the monopulse post
processing, recordings at plot level might allow for testing the plot filter
functions or the local tracker for resolution. Use can be made of the field
monitor by programming its delay to coincide with a major airroute. This test
shall be made when the radar is not operational.
D.2.5 Live data from test flights with (optional) support of DGPS data
The problem with resolution tests is the dependency on data which might be
degraded because of limitation of the resolution capabilities of the sensor
system to be tested. Therefore a reference trajectory is required. GPS and in
The advantages and disadvantages of the different methods applied are listed
in the table below with regard to operational impact, capacity, duration of test,
precision and the reference trajectory.
A scenario has been conceived whereby two test aircraft are used. The
scenario comprises two parts, one for testing range resolution and one for
testing azimuth resolution. The use of DGPS data for the reference positions is
optional. Both aircraft shall have properly installed and properly functioning
transponders.
Two test aircraft are instructed to fly a radial trajectory. One aircraft keeps a
constant speed and heading. The other aircraft makes close approaches
following the other aircraft while keeping the same heading. The distance in
range between the two aircraft decreases gradually unto the moment where
range resolution does not exist anymore. The second aircraft increases again
the range separation until range resolution is reached again. This close
approaching is repeated several times at different ranges of the radar. The test
shall be performed in good visibility conditions under control of the ATC
controller who stays in contact with the two pilots. The pilot of the second
aircraft may report his close approach distance (as measured by instruments
available in the aircraft) to the ATC controller. The test shall be performed in a
sector which is cleared from traffic and at a flightlevel to guarantee good
coverage. The parameters for PSR and SSR range resolution are different.
Therefore both parameters have to be tested. In case of dual electronics, PSR
data only shall be connected to one plot filter channel with SSR data only
connected to the parallel plot filter channel. The ATC controller shall make
observations on the data of both channels.
Two test aircraft are instructed to fly a radial trajectory. One aircraft flies with a
constant speed and a constant heading. The other aircraft flies in parallel with
the other aircraft within a fixed range separation and a constant offset S in NM,
which however does change at regular range intervals. The offset S is selected
as to permit the assessment of azimuth resolution for a given azimuth
separation Dtheta, whereby measurement points become available before and
after lack of resolution.
All results shall be presented in resolution diagram (Drho, Dtheta). There shall
be as many resolution diagrams as there are parameters to be tested, i.e.
position detection, code detection, position accuracy in range, position
accuracy in range, correct code detection and validation etc. The precision of
the analysis depends on the method applied and the reference trajectory used.
Advantages Simulated Combination Live data Live data from Live data from test
and data of live and from test traffic of flights with (optional)
Disadvantages simulated transponder opportunity support of DGPS data
data s
Operational N/A. none if test is small if none none
impact done in careful
standby selection of
channel test range
window
Capacity Huge as limited small limited as only for test targets
meant to function of the available
test system density of
for traffic
maximum
capabilities
Duration of test Function of as for normal one step of each as long as test flights
the traffic resolution resolution will last
precision of diagram case may last
the tested per several
resolution scan minutes; very
test zone long for a
representative
sample
Precision limited by high if video medium as high if video high if video
simulator, recording is range recording is recording is possible,
e.g. 1/200 possible, separation is possible, otherwise limited by
NM in range otherwise stored as FL otherwise LSB of plot and track
and 1 ACP limited by LSB information limited by LSB messages
in azimuth of plot and in plot/track of plot and
are typical track data track
messages messages
Reference controlled partly controlled by to be derived DGPS data will serve
trajectory by simulator controlled by positioning from data but as reference data for
simulator of test could be positioning within
transponder derived from resolution diagram
s recorded video