Antonio Sanchez 8e875719b3 Replace norm() with squaredNorm() to address integer overflows ...

For random matrices with integer coefficients, many of the tests here lead to
integer overflows. When taking the norm() of a row/column, the squaredNorm()
often overflows to a negative value, leading to domain errors when taking the
sqrt(). This leads to a crash on some systems. By replacing the norm() call by
a squaredNorm(), the values still overflow, but at least there is no domain
error.

Addresses https://gitlab.com/libeigen/eigen/-/issues/1856

2020-04-07 19:48:28 +00:00

17 KiB

Raw Blame History

View Raw