Focal Point
[CASE-OPENED] Hyperstage extended bulk load options

This topic can be found at:
https://forums.informationbuilders.com/eve/forums/a/tpc/f/1381057331/m/5347093376

November 04, 2014, 04:23 AM
Martin vK
[CASE-OPENED] Hyperstage extended bulk load options
We are using Hyperstage and are loading large files into it.
For this we use DataMigrator and the extended bulk load facility.

For this you can supply some options for which I can not find any suitable documentation how to best set these options.

Load Type
Select Extended Bulk Load Utility to take advantage of the bulk load options specific to the Hyperstage adapter. These options are listed below.

Commit every row(s)
A commit command will be issued every time the specified number of rows is loaded successfully.

Use Distribute Load Processor for loading data in Hypestage Data Base
Selecting this option will allow you to use the Distribute Load Processor (DLP), a parallel loading tool built into Hyperstage DB.

Maximum Number of Load Sessions
The maximum amount of simultaneous parallel threads which the DLP can use to load data.


How do I know what are the best settings for our environment? Does anyone have best practices on this?

regards, Martin.

This message has been edited. Last edited by: Tamra,


WebFocus 8206M, iWay DataMigrator, Windows, DB2 Windows V10.5, MS SQL Server, Azure SQL, Hyperstage, ReportCaster
November 04, 2014, 03:30 PM
Tamra
Martin vk

Searching on the IBI knowledge base I found the following links : How to set up HyperStage for bulk load

Creating a Quick ETL Copy

Specifying Data Target Options

Hopefully, the above will provide a bit more insight into what you are trying to do.

Kindest regards,
Tamra Colangelo
iWay Focal Point Forum Moderator


WebFOCUS 8x - BI Portal, Developer Studio, App Studio, Excel, PDF, Active Formats and HTML5
November 04, 2014, 03:51 PM
Martin vK
Hi Tamra,

Unfortunately, this documentation does not provide an answer which would be the best settings for the available options.

I am looking for best practices to set the values for these extended bulk load options.

regards, Martin.


WebFocus 8206M, iWay DataMigrator, Windows, DB2 Windows V10.5, MS SQL Server, Azure SQL, Hyperstage, ReportCaster
November 19, 2014, 08:38 AM
Tamra
Martin,

Thank you for the response.

Can you provide more details about your environment that might help with a suggestion?

What type of data file is being loaded into Hyperstage?

What is the volume of data?

What is the OS?

Anything else may also help determine a possible suggestion?

Kindest regards,
Tamra Colangelo
iWay Focal Point Forum Moderator


WebFOCUS 8x - BI Portal, Developer Studio, App Studio, Excel, PDF, Active Formats and HTML5
November 26, 2014, 04:21 AM
Martin vK
It is data from DB2 that is loaded into Hyperstage. The volume depends on the specific table but ranges from 1 to 100 miljon records.
DataMigrator and Hyperstage run on Windows 2008 Server.

Martin.


WebFocus 8206M, iWay DataMigrator, Windows, DB2 Windows V10.5, MS SQL Server, Azure SQL, Hyperstage, ReportCaster
December 02, 2014, 10:30 AM
Tamra
Hi Martin

It looks like a case has been opened to handle these questions.

Please share with us what the final resolution is so that others can benefit as well.

Thank you for participating in iWay Focal Point Forum.

Kindest regards,
Tamra Colangelo
iWay Focal Point Forum Moderator


WebFOCUS 8x - BI Portal, Developer Studio, App Studio, Excel, PDF, Active Formats and HTML5