[Info-vax] VMS Software Q1 '23 Update
Steven Schweda
sms.antinode at gmail.com
Sat Jan 28 18:36:43 EST 2023
> But it can be difficult to determine upfront what a good value
> for small it with absolute if one does not know the magnitude of
> the numbers up front.
The magnitude of the numbers might not matter as much as the number
of bits in the mantissa.
Everything's complicated, but a bad method (like, say, comparing
rounded values) is still a bad method. (I claim.)
More information about the Info-vax
mailing list