Focal Point Banner
Community Center Education Summit Technical Support User Groups
Let's Get Social!

Facebook Twitter LinkedIn
Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    [CLOSED] Data Migrator- How to limit the no. of rec. pulled in an automated fashion?
Go
New
Search
Notify
Tools
Reply
  
[CLOSED] Data Migrator- How to limit the no. of rec. pulled in an automated fashion?
 Login/Join
 
Master
posted
I have to pull 10% of the data from about 400 tables, and I likely need to do this over and over again. So here's the question -- when I make the flow, is there a way to specify "select top 2500" for the records to pull? This is DB2 and SQL*Server, two separate efforts.

I'd like to be able to specify a preset number of records for copying whenever the flow is run.

This is in I-Way version 8.

This message has been edited. Last edited by: Tamra,



 
Posts: 837 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Guru
posted Hide Post
John_Edwards,
In WebFOCUS you can always add in a recordlimit for a table request.

WHERE READLIMIT EQ 2500

I am sending this to the Data Migrator group for assistance. This post will be moved to the iWay Forum.

Thank you for participating in the Focal Point Forum.

Kindest regards,
Tamra Colangelo
Focal Point Moderator - Information Builders Inc.


WebFOCUS 8x - BI Portal, Developer Studio, App Studio, Excel, PDF, Active Formats and HTML5
 
Posts: 487 | Location: Toronto | Registered: June 23, 2009Reply With QuoteReport This Post
Member
posted Hide Post
You can set the STARTAT and STOPAT variables before the data flow runs to limit what goes in your target.


WebFOCUS 8.0.0.9
 
Posts: 1 | Location: Raleigh, NC | Registered: March 25, 2013Reply With QuoteReport This Post
Master
posted Hide Post
Is there a way to embed that into the routine itself for when I run in batch mode?

This is for a sample of all tables across a very big database, about 350 transforms running one after the other and each pulling about 10% of the total content. I've opted to use the FETCH FIRST 1 ROWS ONLY feature. But this has meant I've had to create custom (though simple) SQL requests for each table. This appears a workable solution.



 
Posts: 837 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Silver Member
posted Hide Post
An example of usage for STARTAT/STOPAT:
EX CMASAP APPDIR=app1,REQ_NAME=req1,STARTAT=0,STOPAT=2
 
Posts: 28 | Registered: February 13, 2007Reply With QuoteReport This Post
Master
posted Hide Post
Ah -- I like that. It puts all my tables' selection limits in a single process flow file too.

Thanks for the tip!



 
Posts: 837 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Virtuoso
posted Hide Post
Test this carefully, as I believe the stop at is a write limit and not a read limit.


"There is no limit to what you can achieve ... if you don’t care who gets the credit." Roger Abbott
 
Posts: 1039 | Location: Toronto, Ontario | Registered: May 26, 2004Reply With QuoteReport This Post
  Powered by Social Strata  
 

Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    [CLOSED] Data Migrator- How to limit the no. of rec. pulled in an automated fashion?

Copyright © 1996-2017 Information Builders, leaders in enterprise business intelligence.