Focal Point Banner
Community Center Education Summit Technical Support User Groups
Let's Get Social!

Facebook Twitter LinkedIn YouTube
Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    [CLOSED] Incremental loading
Go
New
Search
Notify
Tools
Reply
  
[CLOSED] Incremental loading
 Login/Join
 
Member
posted
HI,
I have table on my MySQL source for which I have to create flow to incrementally load data once a day. How can I implement it as I have timestamp column there for this purpose.

This message has been edited. Last edited by: Tamra,


WebFOCUS 8.x
Windows Server 2008
 
Posts: 18 | Location: Europe | Registered: November 28, 2014Reply With QuoteReport This Post
Guru
posted Hide Post
If I understand what you want to do you could use a WHERE condition with a sub-select to find the last timestamp in the target table.

sourcetimestamp > SELECT MAX(targettimestamp) FROM targettable

Does that do it?

I suspect that MySQL will run that sub-select for every row of your source which may be slow for large data volumes. If so that could be avoided by obtaining the filter value first. Do you need do that?
 
Posts: 382 | Location: New York City | Registered: May 03, 2007Reply With QuoteReport This Post
Member
posted Hide Post
How can I do it if my target DBMS is Postgre? I cannot use data from two different adapters in SQL flow. Or can I?


WebFOCUS 8.x
Windows Server 2008
 
Posts: 18 | Location: Europe | Registered: November 28, 2014Reply With QuoteReport This Post
Guru
posted Hide Post
Not in a DBMS SQL Flow. In a Data Flow? Of course you can!
 
Posts: 382 | Location: New York City | Registered: May 03, 2007Reply With QuoteReport This Post
  Powered by Social Strata  
 

Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    [CLOSED] Incremental loading

Copyright © 1996-2018 Information Builders, leaders in enterprise business intelligence.