September 01, 2009, 01:55 PM
JaniceEfficiency Question
I am loading a lot of data into the PMF data mart. It uses prefix procedures that reads the full data source and formats the data as needed. My question is around the most efficient way to load this into PMF. Currently I'm doing a complete refresh. If I were to to use add new, replace actual and delete old, is this going to be faster or will this take more overhead? Just looking for a recommendation. PMF 5.12 and WF 7.6.5.
September 01, 2009, 02:03 PM
Bob Jude FerranteFull refresh is very expensive. It deletes all Measure data before inserting the new data and deletion is very expensive.
Wherever possible, you should use the add/change option. These automatically will include anything new, and revise anything old. It will not delete. You will see a noticeable improvement in load times.
thanks
September 01, 2009, 02:21 PM
JaniceOK. I will have to use the add/replace/delete option because there may be records in there that will need to be deleted. I was just concerned that the process of determining what needed to be added, updated and deleted would have been more time consuming. Thanks for the advice.