Rounding question
Joe Boyle
atla38@dsl.pipex.com
Tue, 3 May 2005 17:03:10 +0100
could it be that the field attributes allow only for three dps and therefore
the rounding function never sees the fourth digit entered ?
What is the element syntax in the dictionary, and what is the output from
qshow command 'show ele name' ?
I am assuming you are entering the value into a field in a quick screen, is
that right ?
Regards, Joe.
-----Original Message-----
From: powerh-l-admin@lists.sowder.com
[mailto:powerh-l-admin@lists.sowder.com] On Behalf Of Guy Werry
Sent: 03 May 2005 16:47
To: PH Mailing List (E-mail)
Subject: Rounding question
Ph 7.33.D3, Ux 10.20
The rounding function is giving me fits. Specifically, I have a value in a
FLOAT data item and was rounding it like this:
round(inp_val,3,near)
So I'm trying to round to 3 decimals. If I enter 0.0015, it rounds DOWN to
0.001!
I have tried various combinations of the "multiply by 1000, round it, divide
by 1000" rigamarole, with no success.
Is there a clean, neat solution to this? Is there some way of telling the
stupid thing to round UP on that 5? Note that the "UP" and "DOWN" options
don't give the results that I need.
[The frustration mirrored here is largely due to the fact that COBOL rounds
wonderfully and predictably and I've NEVER found another language that could
round its way out of a wet paper bag!]
Thanks,
Guy L. Werry
Senior Systems Analyst
Hudson Bay Mining & Smelting Co., Limited.
--
= = = = = = = = = = = = = = = = = = = = = = = = = = = =
Mailing list: powerh-l@lists.sowder.com
Subscribe: "subscribe" in message body to powerh-l-request@lists.sowder.com
Unsubscribe: "unsubscribe <password>" in message body to
powerh-l-request@lists.sowder.com
http://lists.sowder.com/mailman/listinfo/powerh-l
This list is closed, thus to post to the list you must be a subscriber.