[Eva] Test math_builtin: fixes the filter of floating-point values.

Properly filters the single-precision values of function acos/asin/atan.
Also filters the last digit of some double precision values.

This is a workaround to avoid oracle differences due to imprecisions of the
system libc (on which the Eva math builtins rely).