this post was submitted on 22 Dec 2023
53 points (100.0% liked)

STOP DOING SCIENCE

413 readers
1 users here now

A community for memes like this.

Not at all affiliated with the subreddit, I just shamelessly stole the name.

Rules:

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[โ€“] anton@lemmy.blahaj.zone 2 points 1 year ago (1 children)

Let's say our integers are 64 bit, say we put half before the point. Now our largest value is just below 4 294 967 296, a 32 bit float goes to 3.4*10^38. The representation also enables some operations to be faster (multiplication, division iirc).

[โ€“] TheChurn@kbin.social 4 points 1 year ago

Floats have a wider range, at the cost of not having full coverage over that range. Even the integers in that range cannot be exactly represented