How to Perform an Out-of-Tolerance Impact Assessment
An out-of-tolerance impact assessment determines whether a measuring device that failed calibration may have affected previously accepted product. The assessment connects the calibration result to inspection records, product history, risk evaluation, disposition, and any required customer action.
What Is an Out-of-Tolerance Condition?
An out-of-tolerance (OOT) condition exists when a measuring or test device does not meet its required acceptance limits during calibration or verification. The calibration provider may report the device's incoming condition as condition as found, as received, or similar wording.
A failed result does not automatically mean that every product measured with the device is nonconforming. It means the validity of earlier measurement results must be evaluated. The essential question is:
Impact-assessment question
Could the identified measurement error have caused conforming product to be rejected or nonconforming product to be accepted?
The answer requires more than reviewing the calibration certificate. The investigator must connect the device to the characteristics measured, the applicable tolerances, affected lots or serial numbers, inspection results, shipment status, and product risk.
For additional background, read Condition as Found in Calibration and What Is Calibration Management?
Why an OOT Impact Assessment Matters
A calibration failure can call previous inspection results into question. A documented assessment demonstrates that the organization identified the potential exposure, evaluated product risk, took proportionate action, and retained evidence supporting its conclusion.
Protect Product
Identify suspect material before it moves to the next operation or reaches the customer.
Support Compliance
Document how the validity of previous measurement results was evaluated after an equipment failure.
Control Business Risk
Avoid unnecessary recalls while ensuring genuine product, safety, and customer risks receive the appropriate response.
Depending on the findings, the response may include containment, reinspection, nonconforming material records, corrective action, customer notification, or no further product action when the technical evidence supports that conclusion.
Quality-System Requirements
ISO 9001 and AS9100 quality-management systems require organizations to control resources used for monitoring and measurement and to address the validity of previous measurement results when equipment is found unfit for its intended purpose. Aerospace organizations must also apply appropriate risk, traceability, product-safety, and nonconformance controls.
ISO/IEC 17025 laboratories have related requirements for handling nonconforming work and evaluating the significance of invalid or questionable results. Regulated industries may have additional customer, contractual, or statutory requirements.
Your internal procedure should identify the standards and clauses that apply to your organization. This guide provides a practical workflow but does not replace your approved procedure, customer requirements, or professional compliance advice.
When Should an OOT Investigation Begin?
Begin the investigation as soon as the failed calibration or verification is identified. Place the device on hold so it cannot return to service unintentionally, preserve the original calibration information, and determine whether potentially affected product requires immediate containment.
Immediate Device Controls
- Identify and segregate the device
- Prevent further use
- Retain the as-found calibration data
- Record the failed measurement points
Immediate Product Controls
- Identify work currently in process
- Place readily identifiable suspect material on hold
- Determine whether shipments are pending
- Notify Quality and responsible engineering personnel
How to Perform an Out-of-Tolerance Impact Assessment
The following eight-step process creates a defensible connection between the failed device, the potential measurement error, affected product, and the final disposition.
1. Identify and Control the Device
Document enough information to distinguish the exact device and prevent unintended use:
- Internal equipment or asset ID
- Manufacturer, model, and serial number
- Location, department, owner, and status
- Calibration date, due date, and previous acceptable calibration date
- Calibration provider and certificate number
2. Define the Calibration Failure
Review the actual as-found results rather than relying only on a pass/fail label. Identify which range or measurement points failed, the allowed tolerance, the observed deviation, measurement uncertainty where applicable, and whether the error was positive, negative, linear, intermittent, or limited to a particular function.
| Calibration finding | Why it matters |
|---|---|
| Error direction | Helps determine whether the device could cause false acceptance, false rejection, or both. |
| Error magnitude | Allows comparison between the device error and the product's available tolerance or guard band. |
| Affected range or function | May limit the investigation to measurements that used the failed range, feature, or capability. |
| Evidence of damage or drift | Supports the determination of when the condition may have begun and how broadly to investigate. |
3. Establish the Investigation Period
A conservative starting point is the device's last known acceptable calibration or verification. Review all relevant use after that point unless objective evidence supports a shorter exposure period.
Consider:
- Historical calibration results and evidence of gradual drift
- Intermediate checks or verification records
- Known damage, overload, repair, or handling events
- Environmental conditions that could affect accuracy
- Frequency and type of use
- The technical basis for any shortened investigation window
4. Identify Potentially Affected Product
Search inspection, production, and equipment-use records to identify every relevant measurement performed during the investigation period. The review may include:
- Part numbers, revisions, work orders, and operations
- Lots, batches, heat numbers, and serial numbers
- Inspection plans and measured characteristics
- Recorded values and acceptance limits
- Inspectors, inspection dates, and device IDs
- Inventory status, subsequent processing, and shipment history
When records do not identify the device used, the organization may need to expand the investigation to all product that could reasonably have been measured by that device.
5. Evaluate the Measurement and Product Risk
Compare the maximum credible device error with each product requirement and recorded measurement. Determine whether the error could change the original acceptance decision.
Practical evaluation
If a measured value remained far enough inside the product limits that the identified device error could not change the result, the original acceptance may remain valid. When the error overlaps the acceptance boundary—or the available records cannot support a conclusion—the product should remain suspect until additional evaluation or reinspection is completed.
Risk evaluation should consider:
- Severity and criticality of the characteristic
- Potential for false acceptance or false rejection
- Fit, form, function, reliability, and product-safety effects
- Customer and regulatory requirements
- Whether later independent inspections would have detected the condition
- Current location and delivery status of affected product
6. Contain, Reinspect, or Reevaluate Product
Select actions based on the risk and available evidence. Options may include reviewing original data, reinspecting with a calibrated device, testing the finished assembly, quarantining inventory, opening a nonconforming material record, or obtaining an engineering evaluation.
Use your approved inspection and nonconforming material process to control suspect product and document its disposition.
7. Determine Customer and Corrective-Action Requirements
If affected product has shipped, evaluate customer notification, return, field containment, concession, or other contractual actions. Open a corrective action when the investigation identifies a systemic cause, repeated failure, inadequate controls, or significant product risk.
Learn how to manage the follow-up investigation with Corrective Action Software for ISO 9001 and AS9100.
8. Approve and Close the Assessment
Record the technical rationale, affected records, actions taken, results, final product disposition, customer decisions, device disposition, approvals, and completion dates. The conclusion should be understandable to someone who did not participate in the original investigation.
What Should the Assessment Record Include?
Device and Failure Evidence
- Device identification and status
- Calibration certificate
- As-found readings
- Required and observed tolerances
- Failure range and error direction
Product and Decision Evidence
- Investigation period and rationale
- Affected lots, serial numbers, and work orders
- Risk and technical evaluation
- Containment and reinspection results
- Disposition, approvals, and customer action
Common OOT Investigation Mistakes
No Device-to-Inspection Traceability
The inspection record shows a result but not the exact measuring device used, forcing the investigation to include a wider product population.
Reviewing Only the Pass/Fail Status
The investigator does not examine the actual as-found readings, error direction, or failed measurement range.
Assuming All Product Is Defective
An OOT device creates a question about prior results; it does not prove that every measured product is nonconforming.
Closing Without a Technical Rationale
Statements such as “no impact” are not sufficient unless the record explains how that conclusion was reached.
Why Measurement Traceability Reduces Investigation Time
Complete measurement traceability connects the device ID to the inspection record, operator, date, work order, lot or serial number, characteristic, specification limits, and actual result. When this information is available, Quality can identify the exposure quickly and narrow the assessment using objective evidence.
Without device-level traceability, teams may spend days reviewing paper records, interviewing inspectors, and reconstructing which gage could have been used. The uncertainty can force unnecessary containment or reinspection of a much larger product population.
How Calibration Management Software Supports the Process
Integrated calibration and inspection software can link equipment records, calibration history, inspection results, nonconforming material, and corrective action in one controlled workflow.
Useful capabilities include:
- Recording the exact measuring device used for each inspection
- Preserving calibration certificates and as-found results
- Searching inspections by device and date range
- Connecting suspect product to lots, serial numbers, and work orders
- Linking the assessment to NCMR and corrective-action records
- Maintaining approvals, attachments, history, and audit-ready reports
Database Providers offers customizable Calibration Management Software that can be purchased individually or integrated with inspection, NCMR, document control, training, auditing, and corrective action. It is available with a Microsoft Access backend or a Microsoft Access front end with SQL Server backend.
Additional Quality Management Resources
Organizations should always evaluate calibration failures against their approved procedures, customer requirements, and the standards applicable to their quality management system. The following official resources provide additional information:
Frequently Asked Questions
What is an out-of-tolerance impact assessment?
It is a documented evaluation of whether a measuring device that failed calibration could have changed previous product-acceptance decisions.
Does a failed calibration mean the product is nonconforming?
No. It means previous measurement results may need evaluation. The assessment determines whether the identified device error could have affected the product decision.
How far back should an OOT investigation go?
The last known acceptable calibration or verification is a common starting point. Objective evidence such as intermediate checks, historical trends, or a known damage event may support a different investigation period.
What records are needed?
Typical records include the calibration certificate, as-found results, equipment history, inspection results, work orders, lots, serial numbers, specifications, shipment records, reinspection results, risk evaluation, and approvals.
What if the inspection record does not identify the device used?
The organization may need to investigate all products that could reasonably have been measured with the device. This is why device-level measurement traceability is so valuable.
Can calibration software identify affected product automatically?
Software can identify candidate inspections and product records when each inspection records the specific device used. Quality and engineering personnel must still evaluate the technical and product risk.
Build a Traceable, Audit-Ready Calibration Process
An effective out-of-tolerance impact assessment does not stop with the failed device. It establishes the investigation period, identifies potentially affected product, evaluates whether the measurement error could change acceptance decisions, controls product, and documents a supported conclusion.
The strongest programs capture the device used at the time of inspection and connect calibration, inspection, NCMR, corrective action, and shipment history. That traceability reduces investigation time while helping manufacturers make better risk-based decisions.
Continue with our guide to selecting calibration management software or review our calibration, inspection, and NCMR integration guide.
Strengthen Calibration and Product Traceability
See how our open-source Calibration Management Software connects failed calibrations to inspections, affected product, NCMR, and corrective action.