[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: variable precision arithmetic (vpa) errant results in windows 10, o
From: |
Jordi Gutiérrez Hermoso |
Subject: |
Re: variable precision arithmetic (vpa) errant results in windows 10, octave-4.0.1 |
Date: |
Wed, 22 Jun 2016 14:04:06 -0400 |
On Wed, 2016-06-22 at 08:31 -0700, Colin Macdonald wrote:
> Whereas vpa(1/3, 64) first creates the a double precision floating
> point number near 1/3 and then converts it to have 64 digits, which
> must be lossy.
"Lossy" is a funny word to use here, as vpa("1/3", 64) is also lossy,
but you are prescribing how much you want to lose. :-)
- Jordi G. H.