-
-
Notifications
You must be signed in to change notification settings - Fork 59
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Weird formatting behavior #112
Labels
Comments
This is due to PI not being equal to 3.14 when converted to a 16-bit float. It's actually: 3.0996094. Loss of precision can be surprisingly nasty with 16-bit floats. |
3.09 should still print 3.1 when given the single decimal formatting |
Oh I see, I read this all backwards. Yeah that is odd
…On Thu, Mar 13, 2025, 11:24 p.m. TheIronBorn ***@***.***> wrote:
3.09 should still print 3.1 when given the single decimal formatting
—
Reply to this email directly, view it on GitHub
<#112 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AB7JFRYMNIPUQWQ66ER7IVL2UJDWBAVCNFSM6AAAAABY7RGR42VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMRTGMYTCMJQG4>
.
You are receiving this because you modified the open/close state.Message
ID: ***@***.***>
[image: TheIronBorn]*TheIronBorn* left a comment (VoidStarKat/half-rs#112)
<#112 (comment)>
3.09 should still print 3.1 when given the single decimal formatting
—
Reply to this email directly, view it on GitHub
<#112 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AB7JFRYMNIPUQWQ66ER7IVL2UJDWBAVCNFSM6AAAAABY7RGR42VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMRTGMYTCMJQG4>
.
You are receiving this because you modified the open/close state.Message
ID: ***@***.***>
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
this code:
produces this
f16::debug
just usesfmt(self.to_f32(), f)
so I don't know what might be causing thisThe text was updated successfully, but these errors were encountered: