Easy Way to Round "Big" Fractions from Digital Calipers - Woodworking Talk - Woodworkers Forum
Old 02-21-2018, 05:51 PM Thread Starter
Senior Member

Join Date: Aug 2017
Posts: 2,536
My Photos
Easy Way to Round "Big" Fractions from Digital Calipers

http://www.woodworkingtalk.com/f2/calipers-194881/

... and it got me thinking about how to solve a minor annoyance with digital calipers:

I have an iGaging IP54 Electronic Digital Caliper. I like it very much. The one drawback is the way that it displays fractions. If your measurement rounds to 128ths, you see 128ths. You can't set it to round to the nearest 1/16, for example.

I have some small experience with math, but rounding quickly from 128ths is not my best skill. Sometimes I want to round the reading to what I think is the "real" or "intended" value, and not the exact measure. That's because I may accidentally tilt the caliper jaws when measuring, for example.

When I see "113/128" on the caliper display, I am not super fast at figuring out that the "actual value" or "rounded value" is 7/8 inch. It turns out that 113/128 is only 1/128th of an inch above 7/8 inch. The actual value is probably 7/8ths, but I angled the caliper jaws when I made the measurement.

To deal with that, I just made a quick and dirty spreadsheet in Excel. When you get a "large fraction", use the table in the spreadsheet to scan for a nearby row with a "longer line" to round up or down to a "nicer" fraction in 16ths, 8ths, or whatever.

INSTRUCTIONS:
At the top of the chart, find the denominator (bottom) of your fraction on the caliper display. Slide your finger down the column until you find the numerator (top) of your fraction. Now look just above and just below it for a row that has more values to the right. You must decide how much you want to round up or down. (How far away from your reading that you want to stray.) It depends on whether you are looking for the nearest 16ths or 8ths or whatever, to get your "rounded" value.

The next time I go out to the garage, I will tape this printout inside one of the cabinets. I hope it helps others.
Attached Files
 File Type: pdf Fractions Table for Digital Calipers.pdf (24.9 KB, 94 views)

Last edited by Tool Agnostic; 02-21-2018 at 05:53 PM.
Tool Agnostic is online now
 The Following User Says Thank You to Tool Agnostic For This Useful Post: Woodknack (04-06-2020)

Old 02-21-2018, 06:08 PM
where's my table saw?

Join Date: Jan 2009
Location: SE, Michigan
Posts: 26,949
My Photos
simple math

It's taken quite a while, but over the years I've memorized some decimals from fractions. 1/4" = .250, 1/8" = .125, 1/16" =.0625 and so forth. You can get to all the others by adding those fractions together:
5/16" is 1/4" plus 1/16" so .250 + .062 = .312 etc..... no need to memorize them all, just the basic ones.

Going backwards from digital (decimals) to fractions means subtracting the big easy ones like .750 0r .500 and dealing with the remainders. Here's a good chart if this doesn't work for Ya:

The answer to your question will only be as detailed and specific as the question is detailed and specific. Good questions also include a sketch or a photo that illustrates your issue. (:< D)
woodnthings is online now
Old 02-21-2018, 06:10 PM
Senior Member

Join Date: Sep 2011
Posts: 25,995
My Photos
Might have to get a calculator and covert it to decimals. 113/128 comes out to .8828125 which is a fuzz over 7/8". It's less than 1/64" so I would round it to 7/8". Unless you are figuring the openings of a number of shelf spacings there is no reason to get into 64ths in woodworking.
Steve Neul is offline

Old 02-21-2018, 06:53 PM Thread Starter
Senior Member

Join Date: Aug 2017
Posts: 2,536
My Photos
Quote:
Originally Posted by Steve Neul View Post
Might have to get a calculator and covert it to decimals. 113/128 comes out to .8828125 which is a fuzz over 7/8". It's less than 1/64" so I would round it to 7/8". Unless you are figuring the openings of a number of shelf spacings there is no reason to get into 64ths in woodworking.
Thanks. Your decimal method works well. I would want something like your chart, but out to 128ths, since that is what the digital calipers display.

For now, I'll give my home-brew chart a try first; I think it will be the fastest solution for me.
Tool Agnostic is online now
Old 02-21-2018, 07:03 PM
Senior Member

Join Date: Mar 2015
Location: Panama City, Florida
Posts: 838
My Photos
I have a drill graph similar to @woodnthings does drill size, fraction and decimal the 3 I usually need
new2woodwrk is offline
Old 02-21-2018, 07:12 PM
Senior Member

Join Date: Sep 2011
Posts: 25,995
My Photos
Quote:
Originally Posted by Tool Agnostic View Post
Thanks. Your decimal method works well. I would want something like your chart, but out to 128ths, since that is what the digital calipers display.

For now, I'll give my home-brew chart a try first; I think it will be the fastest solution for me.
I don't know, I've never seen a tape measure with 128ths increments. The dimension wouldn't mean anything unless it translates into usable increments. You might be better off with a caliper which reads in decimal equivalencies. If you use it enough it doesn't take long to memorize the decimal equivalencies of at least the 1/16" increments on the tape measure. The decimal equivalence is then rounded off to a usable dimension.
Steve Neul is offline
Old 02-21-2018, 07:32 PM
An experienced novice

Join Date: Jun 2015
Location: Grants Pass OR
Posts: 322
My Photos
I've never seen a tape measure that read to better than 1/16." I have a precision Starret scale that reads to 1/64" on one side and 1/100" on the other. My Wixey digital readout on my router table reads to 1/64, but I ignore everything beyond 1/32"

Someplace in my youth, I was require to memorize the decimal to fractional equivalents table to 1/64" and have never forgotten it. So my decimal-only dial calipers reads 1/1000's, and I still calculate in my mind to 1/64"

YMMV

<Chas>

<Chas>
I'll burn that bridge when I come to it
GuitarPhotographer is offline
Old 02-21-2018, 07:33 PM
Senior Member

Join Date: May 2014
Location: Central PA
Posts: 1,298
My Photos
I do so love a good millimeter. so simple . . .
TomCT2 is offline
Old 02-21-2018, 09:16 PM
Senior Member

Join Date: Jul 2008
Location: Florida Panhandle
Posts: 12,259
My Photos
The best way I know to handle a problem like that is to get rid of the offending caliper and buy one that reads the way you want it to read.

George
GeorgeC is offline
Old 02-22-2018, 07:12 AM
Member

Join Date: Jan 2018
Location: Lancashire, England
Posts: 52
My Photos
Guys the problem was solved in 1791 when the Metric system came into use.

Measure twice, Cut once, Then force it to fit with a big hammer.
AltcarBob is offline
 The Following User Says Thank You to AltcarBob For This Useful Post: Brian T. (02-24-2018)
Old 02-22-2018, 07:13 AM
Member

Join Date: Jan 2018
Location: Lancashire, England
Posts: 52
My Photos
Quote:
Originally Posted by GeorgeC View Post
The best way I know to handle a problem like that is to get rid of the offending caliper and buy one that reads METRIC the way you want it to read.

George
Fixed that for you

Measure twice, Cut once, Then force it to fit with a big hammer.
AltcarBob is offline
 The Following User Says Thank You to AltcarBob For This Useful Post: 35015 (02-24-2018)
Old 02-23-2018, 01:19 PM
nonmember

Join Date: May 2017
Posts: 95
My Photos
Most of time when using a caliper it's to transfer a measurement and I don't need to turn it on for that. If measuring to 1/8 or 1/16 then a rule should be good enough. I actually prefer working in tenths of an inch.
Woodknack is offline
Old 02-23-2018, 02:35 PM
Senior Member

Join Date: Apr 2012
Posts: 2,886
My Photos
I don't know why the calipers won't let you set the degree of accuracy you want. 32nds for imperial and 1/2 millimeters for metric would be plenty for me in most cases.
Quickstep is offline
Old 02-24-2018, 06:09 AM
Senior Member

Join Date: Jul 2008
Location: Florida Panhandle
Posts: 12,259
My Photos
Quote:
Originally Posted by quickstep View Post
i don't know why the calipers won't let you set the degree of accuracy you want. 32nds for imperial and 1/2 millimeters for metric would be plenty for me in most cases.
cost/price!!!
GeorgeC is offline
Old 02-24-2018, 11:31 AM
Member

Join Date: Feb 2015
Location: Near San Diego
Posts: 44
My Photos
I printed this one up and have it in the shop.
Attached Thumbnails

JoeFromSD is offline
Old 02-24-2018, 12:44 PM
nonmember

Join Date: May 2017
Posts: 95
My Photos
Quote:
Originally Posted by Quickstep View Post
I don't know why the calipers won't let you set the degree of accuracy you want. 32nds for imperial and 1/2 millimeters for metric would be plenty for me in most cases.
You can buy fractional dial calipers. Also those pocket calipers measure in fractions and metric.
Woodknack is offline
Old 02-24-2018, 01:02 PM
Senior Member

Join Date: Dec 2012
Location: McBride, BC
Posts: 2,648
My Photos
Stick to the metric system. Common global language.

You cannot measure it with any accuracy.
Brian T. is offline
Old 04-04-2020, 04:00 PM Thread Starter
Senior Member

Join Date: Aug 2017
Posts: 2,536
My Photos
I just got a PM asking for better instructions on how to use my "Fractions Table for Digital Calipers.pdf" chart. Let's see if this makes it easier:

Instructions:
1. Print the chart and put it in a place where it is handy. Mine is taped on the inside of a cabinet door.
2. Get a reading from the caliper in fractions of an inch (not decimal inches or mm).
3. Look at the bottom part of the fraction, the "denominator" - 128, 64, 32, 16, 8, 4, or 2
4. Put your finger on the top of the column with the matching denominator.
5. Slide your finger down the column (or the second column) until you see the top part of the fraction, the "numerator."
6. Look above and below your finger for a "nearby" fraction with a longer row. The longer nearby row may extend out to the 16ths column or the 8ths column or perhaps the 4ths column.
7. Use the nearby line that you found in step 6 as a close estimate. Read the number for the numerator (top) of the fraction.

EXAMPLE:
* Take your finger and put it on the top of the "64" column in the second half of the chart.
* Slide your finger down the 64ths column until you reach the "41".
* Look two rows above it, and you will see a longer line "80 - 40 - 20 - 10 - 5" Note that the "5" is in the "8ths" column.
* Your 41/64 inch measurement is slightly larger than 5/8 inch.

Your measurement is only 2/128 inch larger than 5/8 inch, so perhaps the intended measurement was supposed to be 5/8 inch.

I hope this helps.

Last edited by John Smith_inFL; 04-05-2020 at 07:33 AM. Reason: per OP request
Tool Agnostic is online now
Old 04-04-2020, 04:31 PM
Senior Member

Join Date: Aug 2012
Posts: 5,622
My Photos
Quote:
Originally Posted by Quickstep View Post
I don't know why the calipers won't let you set the degree of accuracy you want. 32nds for imperial and 1/2 millimeters for metric would be plenty for me in most cases.
Calipers are made to be accurate, just get some old fashioned ones with the marks on them where you can see how close you are to those 32nds.

Wise men speak because they have something to say; fools because they have to say something -Plato

FrankC
http://sawdustmaking.com
http://woodworkerglossary.com
FrankC is online now
Old 04-04-2020, 05:59 PM
Ancient Termite

Join Date: Mar 2018
Location: Huntington Beach, California
Posts: 741
My Photos
A couple of things here. . . .

Back in the early 1970's, when we tried to convert to the metric system, the stay at home Moms in the US said "I won't cook in metric". For those of you who don't understand, cooking in metric is by mass and not volume.

The rest of us, that are mostly borderline inept in the kitchen decided to remain imperial rather than starve.

Also, there is a company that makes digital displays. Terribly expensive for a table saw (several hundred dollars) and a really bad customer service but solved the problem. I don't know if it is patented or not. After the fraction there are three bars. You configure the display for 1/16 or 1/32. Then the fraction is displayed plus the number of bars over the faction. If you see 11/16 plus one bar, the measurement is 23/32 or 11/16 plus 2 bar is 47/64. The nice thing is that you know about where you are.

Harbor Freight sells a batteryless caliper for about \$3. It will read to the nearest 1/128. However you can read w/o a problem and w/o counting to a 32 just by a quick glance.
https://www.harborfreight.com/hand-t...per-63664.html
Occasionally they are on sale for \$1.
The bad thing about the caliper is the numbers wear off easily. I spray them with clear Krylon before putting them into use. I have compared their measurements to a couple of digital calipers. They are all right on. The batteries in your digital calipers will wear out 3 or 4 times before you'll wear the numbers off of one of these. When you buy them just make sure that they read zero when closed.

For those of you of the Metric persuasion, the caliper will read to tenths.

Rich
In furniture 1/32" is a Grand Canyon
NoThankyou is online now

Message:
Options

## Register Now

In order to be able to post messages on the Woodworking Talk - Woodworkers Forum forums, you must first register.

User Name:
OR