Jump to content

stupid thing thats bothering me


Recommended Posts

I have a Macintosh and the calculator program obviously doesn't have the same bug as does the Windows brand. If you are getting a number like +-0.00000000000001 or something, it may be because of infinitesimal errors that propagate offscreen and then get displayed at the end. This can be observed in programming if one multiplies/divides huge numbers or incredibly small numbers.

Link to comment
Share on other sites

Yeah, I get 4.231503478368152916468244968377e-38

 

computers have trouble rounding when it comes to that degree of precision. It has to do with the fact that the registers that store the numbers are finite in size.

Link to comment
Share on other sites

  • 1 month later...

Yeah, but what's weird is that the error isn't in the calculation 2-2=0, the error is in displaying 2 as the result of sqrt(2)^2, which is where the bug occurs. If it calced the result as 1.999999999999... why didn't it display that?

Link to comment
Share on other sites

  • 2 weeks later...

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.