Focal Point Banner
Community Center Education Summit Technical Support User Groups
Let's Get Social!

Facebook Twitter LinkedIn YouTube
Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    [CLOSED] Any way to get a Read count in Data Migrator?
Go
New
Search
Notify
Tools
Reply
  
[CLOSED] Any way to get a Read count in Data Migrator?
 Login/Join
 
Master
posted
I have a very simple routine that reads records from DB2 with the following format in the SQL Statement box:

select * from alert

I select records from one database this way, write them all to another. When I run this routine the ETLLog shows the number of records written to my destination table, but it does not show the number of records read.

Yes, in theory every record should write and it should be a perfectly even match, or an error thrown if not. But I have been given a requirement to show both the number of records read and the number of records written for accounting purposes, and I'm trying to figure out a way to get the records-read count to appear.

I can put '-TYPE &RECORDS' after the select command, and it prints the number of records read. But, I can't close the box and save the routine. It throws an error.

Any suggestions? Looking at SQL options but don't see one that fits the bill.

This message has been edited. Last edited by: FP Mod Chuck,



 
Posts: 848 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Guru
posted Hide Post
The count of rows processed (read) and accepted (written) both appear in the log regardless as to whether you generate the SQL or type it in provided that you use load type insert/update. .

These same numbers are available in the statistics report after the flow has completed.

The SQL object is just for SELECT statements.

If you want to add a -TYPE statement to a flow, create a stored procedure with it, and then on the process flow tab it after the (embedded) data flow and connect the objects.
 
Posts: 369 | Location: New York City | Registered: May 03, 2007Reply With QuoteReport This Post
Master
posted Hide Post
This is what I get when I query ETLLog after the run:


 
------ Start of Log Record for core_db2p_all_rows/load_alert ------              
Request - load_alert (Owner: admin) submitted.                                   
coredb_alert_core type MS SQL Server Existing target                             
Issuing PREPARE                                                                  
ROWS AFFECTED BY PASSTHRU COMMAND  : 32967/DELETE                                
Bulk Insert active. INSERTSIZE = 10000                                           
Starting Load                                                                    
0 WARNING.. ON MATCH INCLUDE INPUTS DUPLICATE SEGMENTS                           
REFERENCE...AT TRANS   10000                                                     
Commit forced at:  10000 for  10000 row(s)                                       
REFERENCE...AT TRANS   20000                                                     
Commit forced at:  20000 for  10000 row(s)                                       
REFERENCE...AT TRANS   30000                                                     
Commit forced at:  30000 for  10000 row(s)                                       
Commit forced at:  32964 for   2964 row(s)                                       
Ending Load                                                                      
Return Code = 0                                                                  
Request: load_alert - finished processing                                        
CPU Time : 2485                                                                  
Finished                                                                         
Elapsed run time 0:00:08                                                         
------ End of Log Record for core_db2p_all_rows/load_alert ------                
  



How do I get those additional messages to print to the log file please?



 
Posts: 848 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Master
posted Hide Post
Yeah, and my ibif_max_messages is set at 20 on my I-Way server too. Need to figure out where to change that, and all the help sends me to the client console, where it's set to 20,000. So if you can explain how I change that in the I-Way service I'd appreciate it as well.



 
Posts: 848 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Guru
posted Hide Post
As I said "provided that you use load type insert/update." Since that does row-at-a-time processing we can count the rows.

You are using load type "Insert records from memory" with a blocksize of 10,000.

As documented in the DMUG

Insert records from memory:
* Loads much faster, since a block of rows are inserted at once...
* Does not provide row counts (the number of records inserted or rejected) in the detail log or statistics.
 
Posts: 369 | Location: New York City | Registered: May 03, 2007Reply With QuoteReport This Post
Master
posted Hide Post
Thank you Clif.

If anyone can offer any recommendations on either of the two issues above I'm all ears, I can't move to insert/update due to the size of what I'm moving, and I'd very much like to capture all log rows.



 
Posts: 848 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
  Powered by Social Strata  
 

Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    [CLOSED] Any way to get a Read count in Data Migrator?

Copyright © 1996-2018 Information Builders, leaders in enterprise business intelligence.