My problem is similar to a previous thread (unable to link SPAM warning) regarding a high degree of accuracy to adjusting fields (a fractional small number; a multiplier of another field [a currency data type]). The consensus seems to store the multiplier as a double & the currency as a currency data type to 4dp. That sounds like it will work well to my needs (I won't bloat the thread with my needs here; just trying to learn what's going on). I understand that there are storage sizes & storage accuracy though MSN article is lacking yet again... Seems it's all related to how numbers are stored in binary. I would have thought these essential specs would be on the DataType MSN article. Decimal would be perfectly accurate but concerned that it'll greatly slow the db.
After much reading:
Testing
Testing by repeating digits 123,456,789 in row1 & repeating this group of numbers twice in row2:
I'm confused that MSN states a Single can store up to 39 significant figures. Yet fails at storing a 9 digit; non-floating number straight away. Converting back the notation 1.2345678*10^8 yeilds 123,456,800; opposed to the real value typed in 123,456,789; so we are 11 full digits of innaccuracy on a basic number. Despite changing the auto decimal point to 9 digits.
MSN says:
a Single with a floating point:
Currency is as expected from the MSN article; 15 digits to left & 4dp. Cool thanks MSN as tested in Currency4dp row2.
After much reading:
Testing
Testing by repeating digits 123,456,789 in row1 & repeating this group of numbers twice in row2:
I'm confused that MSN states a Single can store up to 39 significant figures. Yet fails at storing a 9 digit; non-floating number straight away. Converting back the notation 1.2345678*10^8 yeilds 123,456,800; opposed to the real value typed in 123,456,789; so we are 11 full digits of innaccuracy on a basic number. Despite changing the auto decimal point to 9 digits.
MSN says:
a Single with a floating point:
- -3.402823E38 to -1.401298E-45 for negative values
- 1.401298E-45 to 3.402823E38 for positive values
Currency is as expected from the MSN article; 15 digits to left & 4dp. Cool thanks MSN as tested in Currency4dp row2.
Attachments
Last edited: