Success !! (was RE:Indexed or Seq?)

Mon Aug 29 14:00:12 CDT 2005

Hi Fernando,

looking at the code attached in the original email again, it looks like
this was an attempt at a solution to the subfile writing > 2Gig bytes
problem, as opposed to a test that the problem is still present.

To see if this problem exists in PH 8.43 with Oracle, you could run the
attached code against a table with more than 3 million rows and row size >=
2000 bytes ( or any combination where rowsize * rownum >> 2Gig (2^^32).

Regards, Joe.

-----Original Message-----
From: powerh-l-bounces+atla38=dsl.pipex.com at lists.sowder.com
[mailto:powerh-l-bounces+atla38=dsl.pipex.com at lists.sowder.com] On Behalf Of
Joe Boyle
Sent: 25 August 2005 12:40
To: fernando.olmos at hpa.com.au; powerh-l at lists.sowder.com
Subject: RE: Success !! (was RE:Indexed or Seq?)

then again, it might be that the problem exists only with the number of
bytes being written, and that there is no (practical) limit to the number of
bytes PH is reading.

You could test this using the attached screen, after creating a simple 2k
row length table. 

As I said earlier, I'm not sure that this affects Oracle, I only ever tested
with Cisam in the past, but I suppose that's the purpose of testing :)

Regards, Joe.

-----Original Message-----
From: powerh-l-bounces+atla38=dsl.pipex.com at lists.sowder.com
[mailto:powerh-l-bounces+atla38=dsl.pipex.com at lists.sowder.com] On Behalf Of
Joe Boyle
Sent: 25 August 2005 11:12
To: fernando.olmos at hpa.com.au; powerh-l at lists.sowder.com
Subject: RE: Success !! (was RE:Indexed or Seq?)

Hi fernando,

while you are making tests, I would be very interested to know what happens
if you run the attached screen; first against a large Cisam file, and then
against a large Oracle table. 

With the PH version you have, I would expect to see a problem at about a
million reads for a 2000 byte record/row length.

Regards, Joe.

-----Original Message-----
From: powerh-l-bounces+atla38=dsl.pipex.com at lists.sowder.com
[mailto:powerh-l-bounces+atla38=dsl.pipex.com at lists.sowder.com] On Behalf Of
fernando.olmos at hpa.com.au
Sent: 25 August 2005 01:29
To: atla38 at dsl.pipex.com; powerh-l at lists.sowder.com
Subject: RE: Success !! (was RE:Indexed or Seq?)

Correction. I waqs wrong.

We are using the following ...

setenv PH_USR /usr/cognos/ph823d7

I don't know what version of Oracle we're using, but our PL/SQL server
is 5.1.4.729

-----Original Message-----
From: atla38 at dsl.pipex.com [mailto:atla38 at dsl.pipex.com] 
Sent: Thursday, August 25, 2005 9:40 AM
To: Fernando Olmos; powerh-l at lists.sowder.com
Subject: RE: Success !! (was RE:Indexed or Seq?)

no problem then, I should have mentioned it was definitely a pre 8.4
issue,

Regards, Joe.

-----Original Message-----
From: fernando.olmos at hpa.com.au [mailto:fernando.olmos at hpa.com.au] 
Sent: 25 August 2005 00:37
To: powerh-l at lists.sowder.com
Cc: atla38 at dsl.pipex.com
Subject: RE: Success !! (was RE:Indexed or Seq?)

Our PH version is 8.43

Our Oracle db is 9.2

-----Original Message-----
From: atla38 at dsl.pipex.com [mailto:atla38 at dsl.pipex.com] 
Sent: Thursday, August 25, 2005 9:35 AM
To: Fernando Olmos; powerh-l at lists.sowder.com
Subject: RE: Success !! (was RE:Indexed or Seq?)

I recall that early PH8 versions on Unix were limited to processing 2
Gig's worth of data; later versions were upgraded to process 2 Gig rows
of any
(valid) row size - what version are you using ?

I also suspect that Unix partitions are 2 Gig by default but they can be
increased - no idea how though :(

P.S. the problem with the 2Gig processing limit came to light via Cisam,
but I recall someone ( who shall remain nameless, lets call him Bob )
suggesting that this is also the case when accessing an RDB. So it all
depends on the version of PH that you are using.

Regards, Joe.

-----Original Message-----
From: powerh-l-bounces+atla38=dsl.pipex.com at lists.sowder.com
[mailto:powerh-l-bounces+atla38=dsl.pipex.com at lists.sowder.com] On
Behalf Of fernando.olmos at hpa.com.au
Sent: 24 August 2005 23:49
To: powerh-l at lists.sowder.com
Subject: RE: Success !! (was RE:Indexed or Seq?)

Thanks Darren/et al,

Mind you, I have yet to present the case to my supervisors, because to
get the before/after reports I have to run the original program in a
test environment with a big enough spread of data. Unfortunately I just
came into the office this morning and found I have filled up the entire
test server's disk space!! The program was trying to sort over 6 million
records (3 million per table) each with a size of around 600 bytes.
That's a sort file of the size close to 1,757,812.5 kilobytes or over
1.5 gig! I don't know what the partition size is, but it does not sound
that it's too big to handle a sort file this big. How can I find that
out in UNIX? I am a VMS man personally! (*wink*).

Cheers

-----Original Message-----
From: darren.reely at latticesemi.com [mailto:darren.reely at latticesemi.com]

Sent: Thursday, August 25, 2005 4:40 AM
To: Fernando Olmos; powerh-l at lists.sowder.com
Subject: Re: Success !! (was RE:Indexed or Seq?)

Fernando,

That is a _VERY_ dramatic run time difference. Congradulations!

Thanks for the response and the kudos. It is nice to see the results 
people can get from the list.

Darren

fernando.olmos at hpa.com.au wrote:
> Bob, Darren, Joe and Conrad:
> 
> I have finished the project and I have made huge in-roads into the 
> performance issues with this particular program. In short, the program

> took over 12 HOURS to run on some end of months, and I have reduced it

> to under 10 minutes!! Thank God for SQL cursors!
> 
> Here are the times from the original batch run (only one of the QUIZ
> programs I changed):   ....
**********************************************************************
IMPORTANT
The contents of this e-mail and its attachments are confidential and
intended solely for the use of the individual or entity to whom they are
addressed.  If you received this e-mail in error, please notify the HPA
Postmaster, postmaster at hpa.com.au, then delete  the e-mail. This
footnote also confirms that this e-mail message has been swept for the
presence of computer viruses by MimeSweeper.  Before opening or using
any attachments, check them for viruses and defects. Our liability is
limited to resupplying any affected attachments. HPA collects personal
information to provide and market our services. For more information
about use, disclosure and access see our Privacy Policy at
www.hpa.com.au
**********************************************************************

-- 
= = = = = = = = = = = = = = = = = = = = = = = = = = = =
Mailing list: powerh-l at lists.sowder.com
Subscribe: "subscribe" in message body to
powerh-l-request at lists.sowder.com
Unsubscribe: "unsubscribe &lt;password&gt;" in message body to
powerh-l-request at lists.sowder.com
http://lists.sowder.com/mailman/listinfo/powerh-l
This list is closed, thus to post to the list you must be a subscriber.
**********************************************************************
IMPORTANT
The contents of this e-mail and its attachments are confidential and
intended solely for the use of the individual or entity to whom they are
addressed.  If you received this e-mail in error, please notify the HPA
Postmaster, postmaster at hpa.com.au, then delete  the e-mail. This
footnote also confirms that this e-mail message has been swept for the
presence of computer viruses by MimeSweeper.  Before opening or using
any attachments, check them for viruses and defects. Our liability is
limited to resupplying any affected attachments. HPA collects personal
information to provide and market our services. For more information
about use, disclosure and access see our Privacy Policy at
www.hpa.com.au
**********************************************************************
**********************************************************************
IMPORTANT
The contents of this e-mail and its attachments are confidential and
intended solely for the use of the individual or entity to whom they are
addressed.  If you received this e-mail in error, please notify the HPA
Postmaster, postmaster at hpa.com.au, then delete  the e-mail.
This footnote also confirms that this e-mail message has been swept for the
presence of computer viruses by MimeSweeper.  Before opening or using any
attachments, check them for viruses and defects.
Our liability is limited to resupplying any affected attachments.
HPA collects personal information to provide and market our services. For
more information about use, disclosure and access see our Privacy Policy at
www.hpa.com.au
**********************************************************************

-- 
= = = = = = = = = = = = = = = = = = = = = = = = = = = =
Mailing list: powerh-l at lists.sowder.com
Subscribe: "subscribe" in message body to powerh-l-request at lists.sowder.com
Unsubscribe: "unsubscribe &lt;password&gt;" in message body to
powerh-l-request at lists.sowder.com
http://lists.sowder.com/mailman/listinfo/powerh-l
This list is closed, thus to post to the list you must be a subscriber.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: name_loop_2gig_rev.qks
Type: application/octet-stream
Size: 848 bytes
Desc: not available
Url : http://lists.sowder.com/pipermail/powerh-l/attachments/20050829/66744495/name_loop_2gig_rev-0001.obj