Printable View
I know my problem is probably due to my variable type but I have tried many thins and am not able to figure it out.
My variable types:
Dim Prime as Single
Dim Percentage as Single
in VB:
Prime = 266.09
Percentage = 0.1
Prime = Prime * Percentage
'Now here... vb puts something like 26.60899945761 in Prime
'We all know that 10% of 266.09 = 26.609
How come I dont get the right answer???
please help me
thank you
I tried that right now and got 26.609 :confused:
By the way. Incase you need it, here is the exact code that I used.
Code:Private Sub Command1_Click()
Dim num As Single
Dim Prime As Single
num = 266.09
Prime = 0.1
blah = num * Prime
MsgBox (blah)
End Sub
When you calculate with floating points, you can't have the exact values returned, but you will have a good approximation with double...
It might just be the version of VB because it worked for me.
No it isn't meg, floating points are always stored the same way, if it shows that number it doesn't mean that it shows the same in the memory. Next time you calculate with it you may notice the difference.
Megatron: What is the variable type of BLAH ??
Variant?
I use only single types...
as for calculating with floating points, isn't it still supposed to give the right answer?? I mean 266.09 * 0.1 is not hard to do.... a good old simple calculator does it right... why not VB
Declare both variable as currency:
Dim num@,Prime@
Hi,
Do you remember a few years ago that some Intel microprocessors had a flaw that caused some calculation errors? I forget exactly which MPU it was but it was a Pentium. There were some tests you could perform to see if you had one of the defective ones.
Just a thought.
Al.