Focal Point
[CLOSED] Data Migrator- How to limit the no. of rec. pulled in an automated fashion?

This topic can be found at:

June 17, 2016, 04:08 PM
[CLOSED] Data Migrator- How to limit the no. of rec. pulled in an automated fashion?
I have to pull 10% of the data from about 400 tables, and I likely need to do this over and over again. So here's the question -- when I make the flow, is there a way to specify "select top 2500" for the records to pull? This is DB2 and SQL*Server, two separate efforts.

I'd like to be able to specify a preset number of records for copying whenever the flow is run.

This is in I-Way version 8.

This message has been edited. Last edited by: Tamra,

June 20, 2016, 02:42 PM
In WebFOCUS you can always add in a recordlimit for a table request.


I am sending this to the Data Migrator group for assistance. This post will be moved to the iWay Forum.

Thank you for participating in the Focal Point Forum.

Kindest regards,
Tamra Colangelo
Focal Point Moderator - Information Builders Inc.

WebFOCUS 8x - BI Portal, Developer Studio, App Studio, Excel, PDF, Active Formats and HTML5
June 21, 2016, 08:44 AM
You can set the STARTAT and STOPAT variables before the data flow runs to limit what goes in your target.

June 21, 2016, 09:14 AM
Is there a way to embed that into the routine itself for when I run in batch mode?

This is for a sample of all tables across a very big database, about 350 transforms running one after the other and each pulling about 10% of the total content. I've opted to use the FETCH FIRST 1 ROWS ONLY feature. But this has meant I've had to create custom (though simple) SQL requests for each table. This appears a workable solution.

June 21, 2016, 10:11 AM
An example of usage for STARTAT/STOPAT:
June 22, 2016, 03:26 PM
Ah -- I like that. It puts all my tables' selection limits in a single process flow file too.

Thanks for the tip!

June 27, 2016, 09:28 AM
Test this carefully, as I believe the stop at is a write limit and not a read limit.

"There is no limit to what you can achieve ... if you don’t care who gets the credit." Roger Abbott