Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Odd error
Float, Jose LCD. Float:

Britlion Wrote:The value calculated from square rooting in floats 0. So that's an error of 255, apparently. Except the correct answer would be 256.1952

The ubyte bit is coming out nicely. I was baffled by the float version of the calculation, here.

I changed how it all worked anyway, so it might not matter. I did wonder if it was pointing to an odd bug, though.

Messages In This Thread

Forum Jump:

Users browsing this thread: 1 Guest(s)