Measurement System Analysis (MSA) is the structured approach to evaluating whether your measurement system is actually capable of making the distinctions your quality decisions require. Gauge Repeatability and Reproducibility, or Gauge R&R, is its most widely used tool. This guide covers what MSA involves, how Gauge R&R studies are conducted, how to interpret the results, and where FDA and ISO 13485 expect to see measurement system validation in a regulated quality system.

What is measurement system analysis?

Measurement system analysis is the process of quantifying the sources of variation in a measurement system and determining whether that variation is acceptable relative to the total variation in the process or characteristic being measured. A measurement system includes not just the gauge or instrument itself but also the operators who use it, the measurement method or procedure, the environment in which measurements are taken, and the part or sample being measured.

The Automotive Industry Action Group (AIAG) Measurement System Analysis reference manual, now in its fourth edition, defines the key properties a measurement system must demonstrate: bias, linearity, stability, repeatability, and reproducibility. Together, these properties determine whether a measurement system is capable. The Gauge R&R study specifically addresses repeatability and reproducibility — typically the two largest sources of measurement error in manufacturing environments.

Metrology — the science of measurement — underpins MSA. In regulated industries, the measurement system must be calibrated, validated or verified as appropriate to its application, and maintained in a defined state of control. MSA adds the statistical dimension: calibration confirms the instrument reads correctly at known reference points; MSA determines whether the system is precise enough to be useful for the decisions it is supporting.

Why MSA matters in regulated industries

In regulated manufacturing, measurement data drives decisions with regulatory and patient safety consequences. A pharmaceutical manufacturer releasing a batch based on analytical results, a medical device company using dimensional measurements to assess conformance to specifications, a laboratory assessing incoming raw material quality — all of these decisions rest on the assumption that the measurements are reliable.

FDA’s Process Validation Guidance describes the Measure phase of process understanding as requiring adequate measurement system capability before process data is used for decision making. The guidance on Stage 2 process performance qualification specifically references the need to confirm that measurement systems are capable of detecting the variation they are designed to monitor.

ISO 13485:2016 requires that organizations ensure test and measuring equipment is suitable for its intended use and is capable of achieving the accuracy required. This requirement is addressed through calibration for accuracy but requires MSA to address precision — how much of the observed variation in measurements comes from the measurement system rather than from the product or process being measured.

The practical consequence: if your Gauge R&R study shows that measurement error accounts for 40% of the total observed variation in your SPC data, your control charts are largely showing you the behavior of your measurement system, not your process. Decisions based on that data — adjustments to process parameters, batch release or rejection, CAPA actions — may be driven by measurement noise rather than real process signals.

Understanding Gauge R&R: repeatability and reproducibility

A Gauge R&R study decomposes total measurement variation into its components:

Repeatability is the variation observed when the same operator measures the same part multiple times with the same gauge under the same conditions. It reflects the inherent precision of the gauge itself — how consistently the instrument gives the same reading when the true value has not changed. High repeatability variation indicates that the gauge itself is the limiting factor, which may require equipment maintenance, recalibration, or replacement with a more precise instrument.

Reproducibility is the variation observed when different operators measure the same part with the same gauge. It reflects differences in how operators use the measurement system — differences in technique, interpretation of the measurement method, or fixture setup. High reproducibility variation indicates a training or procedure problem rather than an equipment problem.

Part-to-part variation is the real variation in the parts being measured — the signal that your measurement system is supposed to detect. For a measurement system to be useful, the gauge variation (repeatability plus reproducibility) must be small relative to the part-to-part variation you are trying to observe.

How to conduct a Gauge R&R study

The standard crossed Gauge R&R study follows a defined protocol:

Step 1: Select the study design

The most common study in regulated manufacturing is the crossed Gauge R&R, where multiple operators each measure multiple parts multiple times. A typical design involves 3 operators, 10 parts spanning the range of actual production variation, and 3 replications per operator per part — producing 90 total measurements. The parts selected for the study must represent the actual variation expected in production, not parts selected because they are easy to measure.

Step 2: Define the measurement procedure

Before conducting the study, the measurement method must be defined and controlled. Operators should be blinded to each other’s results during the study (though in practice they often are not — a limitation that tends to understate reproducibility variation). The measurement environment during the study should match the conditions under which measurements are actually taken in production.

Step 3: Collect measurements in randomized order

Each operator measures each part in a randomized order, then repeats the measurement sequence in a different random order for each replication. Randomization prevents systematic errors from order effects — for example, measurements that drift as the part or environment warms up. In regulated industries, all measurements must be recorded contemporaneously with attribution to the measuring operator, consistent with analytical report documentation requirements.

Step 4: Analyze the results

The ANOVA (analysis of variance) method is the preferred analysis approach for Gauge R&R studies because it provides more information than the traditional range method, including interaction effects between operators and parts. ANOVA Gauge R&R separates the total observed variation into part variation, operator variation, part-by-operator interaction, and repeatability, allowing targeted improvement actions.

The primary output metric is the percentage of total study variation (%GRR or %R&R) attributable to the measurement system:

• Under 10%: The measurement system is generally considered acceptable for production use.
• 10% to 30%: The measurement system may be acceptable depending on the application and the cost of improvement. Documentation should explain the decision and the basis for accepting the measurement system despite its limitations.
• Over 30%: The measurement system requires improvement before it should be used for critical quality decisions. Using a measurement system with greater than 30% R&R to support batch release decisions, SPC monitoring, or process capability assessment in a regulated environment is a quality system deficiency.

Secondary metrics include the number of distinct categories (ndc), which indicates how many distinct groups the measurement system can reliably distinguish within the part variation range. A value of 5 or more is generally required for process control applications; fewer than 2 means the measurement system cannot reliably distinguish between conforming and nonconforming product.

MSA in the context of method validation

In pharmaceutical and biotechnology manufacturing, the analytical procedure validation requirements under ICH Q2(R1) address accuracy, precision, specificity, linearity, range, and robustness. Precision — specifically intermediate precision and reproducibility — directly corresponds to the reproducibility component of MSA. A fully validated analytical method in a pharmaceutical context is conceptually equivalent to a measurement system that has passed MSA requirements, though the statistical frameworks and terminology differ between the ICH guidance and the AIAG MSA manual.

For medical device manufacturers, test method validation under ISO 13485 addresses whether the measurement method is fit for its intended use. MSA provides the quantitative framework for that determination. The SIFO Medical test method validation guidance explicitly references Gauge R&R as a recommended tool for assessing measurement precision in medical device manufacturing contexts.

Attribute MSA for pass/fail measurement systems

Not all measurement systems in regulated industries produce continuous numeric data. Visual inspection systems — where operators examine parts and classify them as acceptable or not — use attribute data. Attribute MSA evaluates whether different operators consistently agree on pass/fail classifications for the same parts.

The attribute agreement analysis compares each operator’s classifications to a reference standard (parts that have been previously classified by an expert or by a more precise measurement method) and to each other. Kappa statistics measure the degree of agreement beyond what would be expected by chance. A kappa value above 0.75 generally indicates acceptable agreement; below 0.40 indicates poor agreement requiring method improvement, clearer criteria, or additional operator training.

In regulated industries, attribute agreement analysis is relevant for incoming inspection, visual inspection of finished devices, and any pass/fail test result where the boundary between acceptable and nonconforming is not always clear-cut.

Calibration versus MSA: understanding the difference

Calibration and MSA address different aspects of measurement system performance and are frequently confused in regulated environments. Calibration ensures that the measurement system is accurate — that it reads correctly at known reference standards. It does not tell you how much variation the system introduces when measuring real production parts under real production conditions.

MSA goes further. A well-calibrated instrument can still fail a Gauge R&R study if operators use it differently, if the measurement procedure is not sufficiently defined, or if the environmental conditions during measurement are not controlled. Conversely, a measurement system can show acceptable Gauge R&R results while still showing calibration drift over time.

A complete measurement system qualification in a regulated environment requires both: regular calibration to maintain accuracy, and MSA conducted at appropriate intervals or whenever the measurement system is applied to a new product or critical parameter for the first time.

Documenting MSA in your QMS

In a regulated environment, MSA studies must be documented in a way that supports regulatory review. Minimum documentation requirements include:

• The study protocol specifying the design (number of operators, parts, replications), the parts selected and why, and the measurement procedure followed
• The raw measurement data with individual operator attribution and timestamps
• The statistical analysis results (ANOVA output, %GRR, ndc values)
• A conclusion statement accepting or rejecting the measurement system for its intended use
• If the system does not meet the acceptance criteria, a corrective action plan with defined completion dates

The MSA study report becomes part of the audit trail for the measurement system. If the measurement system is used in a process validation study, incoming inspection procedure, or SPC monitoring program, the MSA report is referenced as supporting evidence that the measurement system is capable. During an audit, investigators may request MSA documentation for any measurement system used to make critical quality decisions.

Managing MSA studies in an eQMS

MSA study data collected on paper or in standalone spreadsheets creates version control and access control risks that are inconsistent with 21 CFR Part 11 requirements for electronic records in regulated environments. Measurement data used to qualify a measurement system supporting regulated manufacturing should be stored in a validated electronic system with appropriate access controls, version history, and audit trail.

Cloudtheapp’s platform supports measurement system qualification as part of its broader validation and quality management infrastructure. With 60+ applications covering calibration and maintenance, lab testing, document control, and CAPA management, the platform connects MSA documentation to the calibration records and the process monitoring activities that depend on the qualified measurement systems. All records are maintained in a validated environment with a complete audit trail meeting 21 CFR Part 11 requirements.

To see how Cloudtheapp manages measurement system qualification and calibration in a regulated QMS, schedule a demo.

Conclusion

Measurement System Analysis is not a one-time validation checkbox. It is an ongoing quality assurance activity that verifies the foundation on which all other quality data rests. In regulated industries where batch release decisions, process capability assessments, and CAPA effectiveness verifications all depend on measurement data, an unqualified measurement system is a source of systemic risk. A Gauge R&R study that reveals 40% measurement error in an SPC program does not just identify a measurement problem — it calls into question every quality decision made using that data. Building MSA into your quality system as a defined requirement with documented acceptance criteria and a response plan for systems that do not meet them is one of the most consequential quality investments a regulated manufacturer can make.

This post created by and appeared first on Cloudtheapp