Focal Point Banner


As of December 1, 2020, Focal Point is retired and repurposed as a reference repository. We value the wealth of knowledge that's been shared here over the years. You'll continue to have access to this treasure trove of knowledge, for search purposes only.

Join the TIBCO Community
TIBCO Community is a collaborative space for users to share knowledge and support one another in making the best use of TIBCO products and services. There are several TIBCO WebFOCUS resources in the community.

  • From the Home page, select Predict: WebFOCUS to view articles, questions, and trending articles.
  • Select Products from the top navigation bar, scroll, and then select the TIBCO WebFOCUS product page to view product overview, articles, and discussions.
  • Request access to the private WebFOCUS User Group (login required) to network with fellow members.

Former myibi community members should have received an email on 8/3/22 to activate their user accounts to join the community. Check your Spam folder for the email. Please get in touch with us at community@tibco.com for further assistance. Reference the community FAQ to learn more about the community.


Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [CLOSED] SCD flow in DMC taking extremely long

Read-Only Read-Only Topic
Go
Search
Notify
Tools
[CLOSED] SCD flow in DMC taking extremely long
 Login/Join
 
jgolden
Member
posted
Hi all,
I have a performance issue with a Slowly Changing Dimension flow taking an unacceptable amount of time to load; and i'm looking for some feedback/advice.

It is a relatively simple flow, with one source file with only 63000 records.

The target table has 1.3 million rows.

I have 4 fields designated as logical key fields (Company, Program, Prefix Code, and Unit#).

Does the flow process have to read every record in the target table? every record for each logical? (1.3 mill X 4)?

Would it be beneficial to create one Unique ID in the source to use as "1" logical key field to the target (create the same Unique ID in Target)?

Does anyone have any similar experiences, troubleshooting, etc..?

thank you,
James Golden

This message has been edited. Last edited by: Kerry,


WebFocus Developer Studio v. 7610
MySQL/Linux
All different outputs including map technology and using the DMC for our ETL process as well
 
Posts: 13 | Registered: April 28, 2009Report This Post
Darin Lee
Virtuoso
posted Hide Post
You might get a better answer if you post this to the iWay Forum where the ETL users mingle. I have a little experience with our ETL processes but not enough to answer your question. Sorry.


Regards,

Darin


In FOCUS since 1991
WF Server: 7.7.04 on Linux and Z/OS, ReportCaster, Self-Service, MRE, Java, Flex
Data: DB2/UDB, Adabas, SQL Server Output: HTML,PDF,EXL2K/07, PS, AHTML, Flex
WF Client: 77 on Linux w/Tomcat
 
Posts: 2298 | Location: Salt Lake City, Utah | Registered: February 02, 2007Report This Post
jgolden
Member
posted Hide Post
thanks for the feedback


WebFocus Developer Studio v. 7610
MySQL/Linux
All different outputs including map technology and using the DMC for our ETL process as well
 
Posts: 13 | Registered: April 28, 2009Report This Post
<JG>
posted
quote:
key

Darin is quite correct, Wrong forum, but INDEX for the purpose is the answer.
 
Report This Post
  Powered by Social Strata  

Read-Only Read-Only Topic

Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [CLOSED] SCD flow in DMC taking extremely long

Copyright © 1996-2020 Information Builders