Strange results from DB2 in Quiz

[Byron Welch]

Bob,
  Two comments but unfortunately I don't have a solution:(

  I think you are getting different results between PowerHouse and
DecisionStream because they are using different database layers.  My
understanding is that they will be merged in the next major release but for
now you get slightly different database layers between PowerHouse and the
newer products.

  I think you are running into a precession error.  In a couple of cases
when I was using floating point in the past I came across similar results.
If I remember correctly the PH manuals used to have a caveat about floating
point numbers.  It was something like for fractions or very large numbers a
loss of precision can occur.  i.e. .2 might actually be stored as .1999.
This used to prevent me from comparing a Floating point to an integer in a
select statement.  I usually solved this by multiplying by 100 and then
dividing by 100 in a define.  

Byron Welch
Manager Consulting Services
Creative Computing, Inc.
100 Middle Street
Lincoln, RI 02865
(401) 727-0183


-----Original Message-----
From: Edis, Bob [mailto:bob.edis@fleetpride.com]
Sent: Thursday, May 03, 2001 3:01 PM
To: 'powerh-l@list.swau.edu'
Subject: Strange results from DB2 in Quiz


G'day all

Environment: PH 8.21D4, WinNT 4.0, HitODBC 400, DB/400 

We are using HitODBC to pull data from a DB2 database on an AS/400 machine
and are getting erroneous results in PowerHouse Quiz.  E.g.

Case record:

DB2 shows the cost amount column as 3.670
DecisionStream using the above ODBC driver shows 3.670
Quiz using the above ODBC driver shows 3.610.

In another case Quiz reports 4.950 whereas DB2 and DS show 5.00.

The values reported by DB2 and DecisionStream are the correct ones.  The
column is stored to 3 decimal places (float) in the DB2 table.

The discrepancy between Quiz and DecisionStream is NOT consistent.  I.e.
some records in the table match exactly.

Any ideas why Quiz is reporting incorrect values?  

Regards,

Robert Edis
Manager - Business Intelligence
FleetPride 
520 Lake Cook Rd., Suite 100
Deerfield IL 60015
Tel: 847.572.8039
Fax: 847.444.1096
www.fleetpride.com


= = = = = = = = = = = = = = = = = = = = = = = = = = = =
Mailing list: powerh-l@lists.swau.edu
Subscribe: "subscribe" in message body to powerh-l-request@lists.swau.edu
Unsubscribe: "unsubscribe" in message body to
powerh-l-request@lists.swau.edu
http://lists.swau.edu/mailman/listinfo/powerh-l
This list is closed, thus to post to the list you must be a subscriber.