Fix float vector comparisons with signed zero and NaN, add test coverage

Fix float vector comparisons with signed zero and NaN, add test coverage #17735