RAMSynapse
Log inSign up

Testability Analysis · Chapter 5

Reading the Results

How to read the outputs and what they let you decide.

The analysis produces three numbers and two lists, and the lists are the useful part. A testability report that contains only percentages has thrown away everything a designer can act on.

The two numbers, and the one that must travel with them

FigureWhat it isBase
FDFault detection: the rate-weighted share of faults some test responds toAll faults
FI(1), FI(≤2)Fault isolation: the share resolved to one item, or to two or fewerDetected faults only
False alarm rateHow often the diagnosis names a fault that is not thereNot from this model

The base matters and is routinely mixed. Isolation quoted over all faults instead of over detected ones flatters a design with poor detection, because the faults nothing sees are quietly excluded from the denominator of one figure and included in the other. State both bases in the report.

The third figure does not come out of the dependency model at all, and the report is incomplete without it. A diagnostic system is believed or ignored on its false alarm rate, and detection and isolation figures describe a system nobody is using if the answer is wrong a quarter of the time.

The undetected list

Every all-zero column, with its rate. This list is read by three people for three reasons: the designer, who decides whether to add an observation; the safety engineer, who checks whether any of them is a dangerous undetected mode feeding a safety case; and the maintenance planner, who now knows which faults will be found by a scheduled check rather than by the equipment.

An undetected fault is not automatically a finding. A benign mode that nothing sees and nothing needs to see is fine, provided somebody has said so.

The ambiguity list

Every group larger than one, with its members, its combined rate and its cost in removals. Sorted by rate, not by group size: a five-way group of parts that never fail matters less than a two-way group carrying a fifth of the equipment's failures.

Each entry has one of four dispositions, and only the first two are analysis work:

DispositionWhat it means
A test that splits itThe measurement exists or can be added; the analysis says which members it separates
Partition the hardwareMake the members separately replaceable so the group costs one removal each
Accept itRecorded with its removal cost, and carried into the spares and turnaround estimates
A redrawn boundaryReplace the group as a single unit; the group vanishes because the items do

What the result feeds

ConsumerWhat it takes
Built-in test designWhich tests, in which order, and which ones can be deleted
MaintainabilityIsolation time and the removals per fault, which drive MTTR
Spares and supportThe removal rate, which is higher than the failure rate wherever a group survives
SafetyWhich dangerous modes are undetected, and therefore what the proof-test interval has to cover
The maintenance manualThe diagnostic strategy, derived rather than written

What the numbers do not support

  • A comparison across levels of repair. Isolation to one LRU and isolation to one card are different measurements. Two programmes quoting 90 per cent may not be within twenty points of each other.
  • A comparison across bases. See above: isolation over all faults against isolation over detected faults.
  • Anything about intermittents. The matrix is binary and the intermittent fault is the one that dominates real no-fault-found rates.
  • A prediction of what the technician will actually do. The strategy is optimal for the model. Whether it is followed depends on the manual, the training and whether the last three alarms were false.

Want to see this on a live system model? Request a walkthrough.