Precision Engineering Division
[skip navigation]NIST Manufacturing Engineering LaboratoryNational Institute of Standards and TechnologyPrecision Engineering DivisionPrecision Engineering DivisionLarge-Scale Coordinate MetrologyEngineering MetrologySurface and Microform MetrologyNanoscale MetrologySearch
  ENGINEERING METROLOGY TOOLBOX  
 Selected Publications 

Selected Publications is a web-based collection of publications about dimensional metrology.

Download Free Acrobat Reader
PDF Icon

The Use of the Method of Least Squares in Calibration; NBSIR 74-587; 1974


Cameron, J.

NBS Internal Report 74-587; 30p. September 1974.

Keywords:
Least squares; calibration; statistics; measurement restraints in least squares.

Abstract:
This paper presents a discussion of the techniques of statistics that arise in the analysis of data from the comparative experiments used in the calibration of objects relative to a reference group of standards. In calibration one usually measures differences between nominally equal objects and uses the values assigned to the standards as the linear restraint to bring the system up to full rank. The use of the method of least squares in this situation is discussed with examples taken from the calibration work of the National Bureau of Standards.
This summary of statistical techniques is intended for metrologists and was presented at the NBS seminar on High-Efficiency Methods for Dimensional Calibrations given 10-11 June 1974.


Return to Top of Document

Web Site Home: Engineering Metrology Toolbox
Technical Inquiries: Ted Doiron, Group Leader
Engineering Metrology
Precision Engineering Division
Manufacturing Engineering Laboratory
NIST, 100 Bureau Drive, Stop 8211, Gaithersburg, MD 20899-8211

NIST / MEL / Precision Engineering Division

NIST Program Questions: Public Inquires Unit
(301) 975-NIST (6478) TTY (301) 975-8295
NIST, 100 Bureau Drive, Stop 3460, Gaithersburg, MD 20899-3460
Technical Web Site Questions: Jay Zimmerman
Privacy Policy, Security Notice, and Accessiblity Statement
Disclaimer / Freedom of Information Act (FOIA) / No Fear Act Policy
NIST Information Quality Standards / Feedback and Comments

NIST is an agency of the: U.S. Department of Commerce

Date Created: Friday, October 18, 2002
Last Updated: Tuesday, May 03, 2005