Skip to content

Wrong sqrt calculation #338

@tompng

Description

@tompng
BigDecimal('16.000000000000000001').sqrt(1000)
#=> 0.4e1

Expected result is 0.4000000000000000000124999999999999999998046875...

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions