[bug #60923] Standard deviation returning NaN

[Natáli Anzanello]

URL:
  <https://savannah.gnu.org/bugs/?60923>

                 Summary: Standard deviation returning NaN
                 Project: GNU Astronomy Utilities
            Submitted by: ndanzanello
            Submitted on: Fri 16 Jul 2021 01:44:53 AM UTC
                Category: Libraries
                Severity: 3 - Normal
              Item Group: Output not reasonable
                  Status: None
                 Privacy: Public
             Assigned to: None
             Open/Closed: Open
         Discussion Lock: Any

    _______________________________________________________

Details:

The standard deviation calculation (within gal_statistics_std and
gal_statistics_mean_std) is returning a NaN value in some situations.

This is due to calculations involving floating numbers giving the square of
the average value greater than the average of the squares of the values, thus
making a square root of a negative number.






    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?60923>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/