Focal Point Banner


As of December 1, 2020, Focal Point is retired and repurposed as a reference repository. We value the wealth of knowledge that's been shared here over the years. You'll continue to have access to this treasure trove of knowledge, for search purposes only.

Join the TIBCO Community
TIBCO Community is a collaborative space for users to share knowledge and support one another in making the best use of TIBCO products and services. There are several TIBCO WebFOCUS resources in the community.

  • From the Home page, select Predict: WebFOCUS to view articles, questions, and trending articles.
  • Select Products from the top navigation bar, scroll, and then select the TIBCO WebFOCUS product page to view product overview, articles, and discussions.
  • Request access to the private WebFOCUS User Group (login required) to network with fellow members.

Former myibi community members should have received an email on 8/3/22 to activate their user accounts to join the community. Check your Spam folder for the email. Please get in touch with us at community@tibco.com for further assistance. Reference the community FAQ to learn more about the community.



Read-Only Read-Only Topic
Go
Search
Notify
Tools
DMC and STAR SCHEMAS
 Login/Join
 
bcook278
Gold member
posted
I am looking for some feedback from folks that have been using DMC to build out traditional star schemas (aka kimball dimensional design). We have been loading to star schema for about 8 years using a custom ETL process coded in RPG on an iSeries Platform. We are in the process of moving of iSeries to Linux servers running MySQL and are re-writing our ETL using DMC and noticing a few challenges trying to get this to work the way our old process did. I'd be interested in hearing from anyone that has either faced similar challenges or anyone that thinks this tool works very well with regard to the Star Schema. I see that in the upcoming version 7.7 they are touting some enhancements for star schema loads which makes me think this functionality is still maturing. Any feedback related to this would be appreciated.


WebFOCUS 7.6.8
WebFOCUS Client and Server running on RedHat Linux, Developer Studio on Windows XP
All output formats
 
Posts: 52 | Registered: May 13, 2009Report This Post
Marina
Silver Member
posted Hide Post
Some of the improvements, to provide faster loading of slowly changing dimensions, planned for 7.7 have been retrofitted into 7.6.10. Also, DataMigrator allows now overriding the default dates; such as for the end date for active rows, instead of NULL using a day far in the future

This message has been edited. Last edited by: Marina,
 
Posts: 37 | Registered: February 13, 2007Report This Post
Endre
Gold member
posted Hide Post
bcook278 ,

We are using DMC for years with true star schemas. Both Type I and Type II dimensions.

One of the most important thing, and it is for any rdbms, that you should remove indexes before loading and recreate them after load. You can issue SQL level commands with DM, so it is pretty easy to do. (leave logical/natural key indexes on dimensions, but regenerate them after load)

Also, when loading SCD, you should join the target dimension with the source table on the left side of the SQL icon. Join on the logical/natural key. Than in the SQL, filter for columns that are not EQ between the source and the dimension. This cuts down the number of row going over for update/insert on the target dimension. If you have a large dimension, this should give you a big improvement. Remember that every column of every row has to be checked for equality when dealing with SCD.

If you specify specific challenges you run into, I might be able to help.

Endre
"Kimball forever - Inmon never..."


WebFocus 7.6.8
iWay Data Migrator 7.6.8
PMF 5.1
 
Posts: 83 | Registered: March 28, 2006Report This Post
  Powered by Social Strata  

Read-Only Read-Only Topic


Copyright © 1996-2020 Information Builders