Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Odd error
#3
Float, Jose LCD. Float:

Britlion Wrote:The value calculated from square rooting in floats is...er 0. So that's an error of 255, apparently. Except the correct answer would be 256.1952

The ubyte bit is coming out nicely. I was baffled by the float version of the calculation, here.

I changed how it all worked anyway, so it might not matter. I did wonder if it was pointing to an odd bug, though.
Reply


Messages In This Thread

Forum Jump:


Users browsing this thread: 1 Guest(s)