[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

PSPP-BUG: [bug #41734] Handling of very large Values: pspp exports to e-

From: Ben Pfaff
Subject: PSPP-BUG: [bug #41734] Handling of very large Values: pspp exports to e-notation, losing content
Date: Mon, 10 Mar 2014 16:22:30 +0000
User-agent: Mozilla/5.0 (X11; Linux i686 on x86_64; rv:17.0) Gecko/20131030 Firefox/17.0 Iceweasel/17.0.10

Follow-up Comment #5, bug #41734 (project pspp):

> An example number is
> 100000000000000032,
> exported by pspp to
> 1.0000000000000003e+17 

PSPP is exporting this number with as many digits as required to fully express
the internal precision.  All of the numbers from 100000000000000030 to
100000000000000039 (and perhaps in a wider range) have exactly the same
representation in the 64-bit form used in the computer.  Adding a '2' at the
end does not indicate an additional digit of precision; on the contrary, it is
deceptive in that it claims some precision that is not there.


Reply to this item at:


  Message sent via/by Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]