As of December 1, 2020, Focal Point is retired and repurposed as a reference repository. We value the wealth of knowledge that's been shared here over the years. You'll continue to have access to this treasure trove of knowledge, for search purposes only. Moving forward, myibi is our community platform to learn, share, and collaborate. We have the same Focal Point forum categories in myibi, so you can continue to have all new conversations there. If you need access to myibi, contact us at firstname.lastname@example.org and provide your corporate email address, company, and name.
We need to setup an iWay Data Migrator process to move data from several tables in Oracle DB to DataWarehouse on daily basis.
If a source table contains a Datetime column, we can base on the date time to identify and easily move these records. However, when a source table doesn't contain any date time column, what would be a proper way to select the newly inserted/updated records?
One way to solve this is to build triggers on the source tables to keep track of what being insert/update. Then iWay will base on this info to move data. This will work but i don't think this is a good approach.
Could you recommend any alternatives? Thanks a lot.This message has been edited. Last edited by: Tamra,
You'll have to double check the manual but I belive that Oracle supports Change Data Capture.
Then you can set up DM to only get the changed data.
If that doesn't work then one hack is to create hashes of the concatenated fields you are interested in and compare that against your warehouse - not exactly efficient but much better than comparing field to field.
When I've used this I've added the hash as a separate field in the warehouse to speed up comparison.
WebFOCUS 8.2.03 (8.2.06 in testing)
Posts: 253 | Location: Melbourne, Australia | Registered: February 07, 2007
There is an optional add-on to DataMigrator that we call Change Data Capture that reads from the ORACLE Archive Logs to identify rows that have changed (insert, update or delete). It's documented in the Data Migrator User's Guide, Chapter 12, "Change Data Capture."
Note that for an ORACLE source it's only required that full logging is enabled. It does not require what ORACLE calls Change Data Capture (which is being deprecated) or Golden Gate.
While CDC is available in Release 7704 it's been improved since that release was first posted. I'd recommend using the current production Release 7706.This message has been edited. Last edited by: Clif,
Posts: 397 | Location: New York City | Registered: May 03, 2007