Vernier Caliper and Micrometer Screw Gauge: Least Count and Zero Error

Study guideUpdated 15 Oct 2026

A vernier caliper combines a main scale with a sliding vernier scale. A micrometer combines a sleeve scale with a rotating thimble scale. First read the instrument, then apply any signed zero error. Neither extra digits nor tighter contact guarantees a better measurement.

The worked examples below use a vernier resolution of 0.01 cm and micrometer graduations of 0.01 mm. These are example scales, not specifications for every instrument. Check the supplied model, units and lesson instructions before measuring.

Read a vernier caliper

The outside jaws measure an external dimension, such as a ball's diameter. Smaller inside jaws and a depth probe, where fitted, serve different measurements. Use the faces intended for the task.

An enlarged example vernier has its zero just beyond 3.4 centimetres and its seventh division aligned with a main-scale line. The reading is 3.47 centimetres before zero correction; subtracting a separate positive zero error of 0.02 centimetres gives 3.45 centimetres.

This is an enlarged scale model, not a photograph of Eclat's instrument. Mitutoyo's caliper explanation describes the sliding-scale principle and gives a different metric resolution example. Always use the resolution of the scale in front of you.

  1. Read the last main-scale division passed by the vernier zero. Here it is 3.4 cm.
  2. Find the vernier division that aligns with a main-scale line. Here it is division 7.
  3. Multiply that division number by the stated resolution: 7 × 0.01 cm = 0.07 cm.
  4. Add the contributions: 3.4 cm + 0.07 cm = 3.47 cm.

Do not use the far end of the sliding scale as the reference. The zero locates the coarse reading; the aligned line supplies the smaller contribution.

Check and apply zero error

For a caliper whose range starts at zero, gently check the closed-jaw reading as demonstrated. A positive zero error means it reads above zero at that reference; a negative error means it reads below zero. With a negative vernier error, the aligned division alone is not its signed value. Follow the scale's negative-reading convention.

The correction is always measured reading minus signed zero error. Keep the unit the same throughout.

Measured readingSigned zero errorCorrected reading
3.47 cm+0.02 cm3.47 - (+0.02) = 3.45 cm
2.36 cm+0.02 cm2.36 - (+0.02) = 2.34 cm
2.36 cm-0.02 cm2.36 - (-0.02) = 2.38 cm

These are hypothetical readings. The second and third rows show why the sign matters in a ball-bearing diameter calculation. Apply the relevant error once, not once for each contribution to the reading. If before/after zero checks disagree, report the change rather than choosing the more convenient value.

Read a micrometer screw gauge

The anvil is the fixed measuring face; the spindle is the moving face. The sleeve, also called the barrel, carries the length scale and datum line. The rotating thimble adds the smaller scale contribution. The model's force-limiting mechanism controls contact force.

For the 0.01 mm example scale:

  1. Read the whole millimetres visible on the sleeve.
  2. Check whether the next half-millimetre mark is also visible.
  3. Read the thimble division at the sleeve's datum line.
  4. Add its contribution, then correct for signed zero error.

Mitutoyo's illustrated scale guide distinguishes standard, vernier and mechanical-digit micrometers. The guide shows different reading increments. Check your instrument's scale before applying this example.

Worked reading and ball-bearing example

StepExample sleeve/thimble readingSeparate ball-bearing example
Whole and half millimetres visible5.50 mm4.50 mm
Aligned thimble division2318
Thimble contribution at 0.01 mm per division0.23 mm0.18 mm
Measured reading5.73 mm4.68 mm
Signed zero error0.00 mm-0.03 mm
Corrected reading5.73 mm4.68 - (-0.03) = 4.71 mm

Missing the half-millimetre mark changes the first result by 0.50 mm. Check that mark before adding the thimble contribution. For zero checks, use the supplied model's reference and force-limiting method. If its range does not start at zero, use the specified reference. Do not try to close it beyond its range.

Contact force is part of the measurement

Mitutoyo's ratchet-thimble example uses a preset measuring force. Other models can use different mechanisms. Have the trainer demonstrate yours; a click is not permission to keep tightening.

A soft specimen can deform under contact. Repeated readings at the same excessive force can agree while still describing the compressed specimen. Release the specimen before repositioning it. Stop for sticking movement, damage or inconsistent readings instead of forcing the instrument.

Compare with a digital caliper

Digital caliper on a wooden surface, with numbered markers identifying the outside jaws and display.
  1. Outside jaws. Contact the external dimension with the demonstrated alignment and light force.
  2. Display. Shows a reading; check units, reference and model instructions.

Illustrative photo: Alexey Demidov on Pexels.

A digital display removes the vernier calculation, but not the need for correct contact and alignment. The displayed increment alone cannot tell you its accuracy. Mitutoyo's caliper guidance discusses light measuring force and model-dependent zero behaviour. Do not assume every model needs the same reset sequence.

Separate reference checks from measuring the object

A zero check tests one prescribed reference, not every reading across the range. Two instruments can agree at zero and disagree when measuring a specimen. Do not decide which is right from the displayed digits or instrument type alone.

Mitutoyo's handling guide identifies several influences on caliper readings, including contact force, jaw alignment, viewing angle and temperature differences. These are possible checks, not a diagnosis from one mismatch. The teacher chooses the appropriate reference and comparison procedure for the supplied instruments.

Keep the specimen, measuring faces and contact position comparable before interpreting a disagreement. If a reading changes when you tighten, tilt or move the jaws, report the observation. Do not keep adjusting until the instrument displays the expected value.

Distinguish variation in readings from variation in the specimen

Suppose a wire gives different diameter readings at two positions. That could be a real difference along the wire, a change in contact or another measurement problem. The two numbers alone do not identify the cause. Record where and how each reading was taken, then follow the assigned repeat plan.

Measurements repeated at one place answer a different question from measurements along the wire. Do not automatically average them together. The wire resistance practical controls which dimensions and locations are needed for its calculation.

For a ball-bearing example, first confirm that you are measuring its external diameter with the appropriate faces. Changing direction or contacting a different feature can change what is measured. Repeated agreement is useful, but it does not by itself prove the ball's exact size or shape.

Choose and record the measurement

Select an instrument for the dimension, specimen, required uncertainty and permitted method. The table compares the example resolutions used here; it is not a universal specification.

Example instrumentExample scale incrementRelevant measurement
Millimetre ruler1 mmLength between two positions
This vernier scale0.1 mm, equal to 0.01 cmExternal/internal dimension or depth with the appropriate faces
This micrometer scale0.01 mmSmall external dimension within the model's range

Record units and the decimal places justified by the actual instrument and lesson convention. For these examples, 3.40 cm and 5.00 mm retain the final measured place. Keep the measured reading, zero error and corrected result separate so someone can check the calculation.

Before measuring a fragile, sharp or unfamiliar specimen, confirm its suitability with the trainer. Keep fingers clear of closing faces. Measuring jaws are not clamps, levers or tools for pulling an object. Use the lab safety briefing principles before starting.

What teachers and technicians check

Staff match the instrument's range, faces and contact mechanism to the specimen and the required measurement. They demonstrate the actual zero/reference check and force-limiting method, inspect condition and decide whether an inconsistent instrument needs checking or replacement. There is no universal ratchet click count or reset sequence to apply from another model.

Students need to record the instrument, units, location, raw reading and signed correction. Report sticking movement, sharp or damaged faces and unexpected changes in the reference check. Repairs, unfamiliar cleaning products and adjustments belong with staff. A successful zero correction does not remove errors from measuring the wrong feature or using unsuitable contact.

For practice, pair this guide with the wire resistance experiment, meniscus and parallax guide and sources of error guide. The O-Level Physics practical hub and

Sources

  1. https://www2.mitutoyo.co.jp/eng/useful/E11003/pageindices/index23.html
  2. https://www.mitutoyo.com/metrology-insights/mitutoyo-calipers-digital-dial-and-vernier-calipers-precision-measurement-tools-for-manufacturing/
  3. https://isomer-user-content.by.gov.sg/334/42ee79d0-bb13-43f5-94ab-629729f88aa0/6091_y26_sy.pdf

Save or continue learning

Want supervised lab practice?

Explore practical lessons, with timings, fees, and locations on the programme page.

View O-Level Physics Practicals (Labs & Experiments)