Numpy allclose tolerances for single and half precision?

137 views Asked by At

atol=1e-8 isn't suitable for single or half precision, unsure of rtol=1e-5 - they appear calibrated for float64.

What should be the standard for float32 and float16?

A reference is preferred - I found this but there's no summary and I don't know how applicable it is to np.allclose. Simply reasoning also works.

0

There are 0 answers