Training and consultancy for testing laboratories.

Posts tagged ‘Bias’

Uncertainty of measurement – “Bottom-up” vs “Top-down”

At the recently concluded Eurachem/PUC training workshop on “Accreditation of analytical, microbiological and medical laboratories – ISO/IEC 17025:2017 and ISO 15189:2012”, the following important pointers were noted during the presentation of Dr Steve Ellison of LGC UK on the to subject : Measurement Uncertainty – “Bottom-up” vs “Top-down”:

  1. Measurement uncertainty assessed in analytical chemistry is either through the use of the Law of Propagation of Uncertainty from uncertainty budgets (or inputs or contributors) as per GUM (bottom-up) method, or adopting the method performance (or validation) data (top-down);
  2. Using the GUM approach with a mathematical model, the laboratory is to assess and sufficiently quantify significant uncertainty contributors in the test procedures.  This can be done by (a) using descriptive statistical data through repeated experiments (Type A), or (b) any other means, such as certificates of analysis by a third party, theory or professional judgement (Type B);
  3. It has been stated that testing laboratories tend to underestimate measurement uncertainty using the GUM method in almost measurement fields, as one cannot comprehensively identify and quantify all important uncertainty inputs;
  4. Use of any one of the top-down approaches with the use of validation data is a better bet in the evaluation of measurement uncertainty because the actual dispersion of test results in extended experiments can be observed; the major uncertainty source data can come from (a) long term precision (intermediate reproducibility), (b) bias uncertainty based on reliable certified reference materials, and (c ) any other additional important effects which are not part of the method’s mathematical equation;
  5. By definition, uncertainty is a range which includes the true value.  Therefore, any significant bias should not be ignored.
  6. Empirical methods are operationally defined.  In the top-down approach, relevant  reference material should be used to estimate laboratory bias as an input of uncertainty.  In this case, only matrix bias is to be taken care of and method bias is not relevant.
  7. Eurachem opines that the bottom-up GUM method is appropriate for metrology laboratories, whilst the top-down approaches are best for testing laboratories.

A linear regression approach to check bias between methods – Part II

 

Plot of reference and trial methods

A Worked Example

Suppose that we determined the amount of uranium contents in 14 stream water samples by a well-established laboratory method and a newly-developed hand-held rapid field method…..

A linear regression approach to bias between methods – Part II

A linear regression approach to check bias between methods – Part I

Plot of reference and trial methods

Linear regression is used to establish a relationship between two variables. In analytical chemistry, linear regression is commonly used in the construction of calibration curve for analytical instruments in, for example, gas and liquid chromatographic and many other spectrophotometric analyses….

A linear regression approach to bias between methods – Part I