FAQ  •  Register  •  Login

Odd error

<<

britlion

Posts: 677

Joined: Mon Apr 27, 2009 7:26 pm

Location: Slough, Berkshire, UK

Post Mon Feb 27, 2012 6:57 pm

Odd error

This might be another float bug. I wrote up the distance algorithm na_th_an showed us. It seems to work - but in this test program, it's the floating point values that go wrong...

If you set your emulator to full speed, you see it looking for the biggest error it can find, showing larger errors as it finds them. Eventually it hits distance (250,56) which my function says is > 255 (so returns 255). The value calculated from square rooting in floats is...er 0. So that's an error of 255, apparently. Except the correct answer would be 256.1952 Is the int (256) returning 0 for some reason? On a float?

When I'm happy with this funtion, it will go in the function library as a code snippet.


  Code:

FUNCTION fastcall distance (a as ubyte, b as ubyte) as uByte

' returns a fast approximation of SQRT (a^2 + b^2) - the distance formula, generated from taylor series expansion.

asm
POP DE ; return address
; First parameter in A
POP BC ; second parameter -> B

LD C,A ; Put second parameter in C for safekeeping.
LD HL,0

ADD A,B

LD L,A ; Put result in HL
RL H   ; Pull in carry bit if necessary.

LD A,B ; get original
CP C   ; compare with C
JP NC, distance_Cbigger
LD C,A ; B was smaller, so we replace the value in C with the smaller value in A
distance_Cbigger:
; C was smaller, so we leave it alone.

SRL C ; C=C/2

XOR A
LD B,A
SBC HL,BC ; take half our smallest from HL

SRL C
AND A ; Clear carry flag.
SBC HL,BC

SRL C
SRL C
AND A ; Clear carry flag.
ADD HL,BC

LD A,H
AND A
JP NZ, distance_toobig

LD A,L ; Get result.
EX DE,HL ; return address is in DE.
JP (HL)

distance_toobig:
; If the answer turns out to be > 255, we'll return 255.
LD A,255
EX DE,HL ; return address is in DE.
JP (HL)

END ASM

END FUNCTION

CLS
DIM i,imax as uByte
dim j,jmax as uByte
dim answer,realanswer as uByte
dim errorval,errorvalmax as float
imax=0
jmax=0
errorvalmax=0

for j=1 to 250
for i=1 to 250

answer=distance(i,j)
realanswer=SQR(CAST(float,i)*i+CAST(float,j)*j)
errorval=ABS(CAST(float,realanswer)-answer)

if errorval>errorvalmax then
 PRINT i;" ";j;" ";answer;" ";INT realanswer; "   ";int errorval
 imax=i
 jmax=j
 errorvalmax=errorval
end if
border j
next i
next j
<<

LCD

Posts: 506

Joined: Fri Feb 13, 2009 3:11 pm

Location: Vienna, Austria

Post Tue Feb 28, 2012 7:09 pm

Re: Odd error

If the Answer is defined as uByte, then 256 is 0...
No Error of ZXBC I guess.
------------------------------------------------------------
http://lcd-one.da.ru redirector is dead
Visit my http://members.inode.at/838331/index.html home page!
<<

britlion

Posts: 677

Joined: Mon Apr 27, 2009 7:26 pm

Location: Slough, Berkshire, UK

Post Wed Feb 29, 2012 1:55 pm

Re: Odd error

Float, Jose LCD. Float:

Britlion wrote:The value calculated from square rooting in floats is...er 0. So that's an error of 255, apparently. Except the correct answer would be 256.1952


The ubyte bit is coming out nicely. I was baffled by the float version of the calculation, here.

I changed how it all worked anyway, so it might not matter. I did wonder if it was pointing to an odd bug, though.
Last edited by britlion on Wed Feb 29, 2012 2:18 pm, edited 1 time in total.
<<

boriel

Site Admin

Posts: 1145

Joined: Wed Nov 01, 2006 6:18 pm

Location: Santa Cruz de Tenerife, Spain

Post Wed Feb 29, 2012 2:13 pm

Re: Odd error

britlion wrote:Float, Jose. Float:

Britlion wrote:The value calculated from square rooting in floats is...er 0. So that's an error of 255, apparently. Except the correct answer would be 256.1952


Uh:?: I haven't said a word... yet. :roll:
<<

britlion

Posts: 677

Joined: Mon Apr 27, 2009 7:26 pm

Location: Slough, Berkshire, UK

Post Wed Feb 29, 2012 2:17 pm

Re: Odd error

Ah. Fundamental problem. I can't read. Apart from that, carry on as normal.
<<

britlion

Posts: 677

Joined: Mon Apr 27, 2009 7:26 pm

Location: Slough, Berkshire, UK

Post Fri Apr 06, 2012 2:00 pm

Re: Odd error

No comment if this is a bug? Did it go away?

Return to Bug Reports

Who is online

Users browsing this forum: No registered users and 1 guest

Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group.
Designed by Vjacheslav Trushkin for Free Forums/DivisionCore.

phpBB SEO