Re: rounding issue
- Posted by gwalters Aug 20, 2010
- 997 views
I understand what you're saying Matt. My real question is what does EU put in the sequence when the incoming item is double precision? It appears to be single precision in the sequence above. Do you know the answer to that? For example
sequence temp atom dbl
temp = {} dbl = .11 temp &= dbl
What is in temp, single precision item or double precision?