• chiliedogg@lemmy.world
    link
    fedilink
    arrow-up
    2
    arrow-down
    2
    ·
    edit-2
    8 days ago

    But that 5/32 screw has its precision built into the measurement. Sig figs and error ranges aren’t required for fractional, because both are built into the denominator.

    If your 5/32 measurement is super precise you can record it as 160/1024ths, because the denominator has “+/- 1/2048” built into the measurement.

    • calcopiritus@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      7 days ago

      As I said in another (larger) comment, you just don’t know how precision is encoded in decimals, which doesn’t mean that it isn’t. In fact, precision is encoded in decimals, just like with fractions.

      0,7 is 0,7 ± 0,05 0,7000 is 0,7 ± 0,00005

      • chiliedogg@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        7 days ago

        I have a set of precision digital calipers that shows decimal or fractional units. Verus a worse set of calipers that’snot 10x worse, it shows exactly the same measurements in decimal units, but with fractional units it will show a difference because that difference can be represented.

        • calcopiritus@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          7 days ago

          Is there anyone in this world needs a caliper of precision between 1cm and 1mm that can’t afford a 1mm of precision caliper?

            • calcopiritus@lemmy.world
              link
              fedilink
              arrow-up
              1
              ·
              6 days ago

              And that is shown by the markings.

              I just looked one up, it’s less than 20€, 0,02mm of precision. There are just 4 markings between 1mm and the next.

              So instead of 9 markings, each marking adding 0,01mm, you just add 0,02mm. Doesn’t sound complicated at all.

              I haven’t found an analog one, but a digital one with 0,01mm of precision costs 30€. Maybe an analog one costs 50€.

              So if adding 0,02 is too complicated, you can just buy a 0,01 one for 30€ more. Which is the price of a pizza for a tool that will last years.

              Anything more precise than 0,01. You probably have a lot of experience using a caliper. Whatever method it uses to display that precision is gonna be second nature.

              • chiliedogg@lemmy.world
                link
                fedilink
                arrow-up
                1
                ·
                6 days ago

                Yes, but by recording your measurements as being precise to the neareat 1/5th you’re saying they’re precise to the nearest 1/10 if you record it with decimals unless you add a qualifying statement.