Focal Point Banner


As of December 1, 2020, Focal Point is retired and repurposed as a reference repository. We value the wealth of knowledge that's been shared here over the years. You'll continue to have access to this treasure trove of knowledge, for search purposes only.

Join the TIBCO Community
TIBCO Community is a collaborative space for users to share knowledge and support one another in making the best use of TIBCO products and services. There are several TIBCO WebFOCUS resources in the community.

  • From the Home page, select Predict: WebFOCUS to view articles, questions, and trending articles.
  • Select Products from the top navigation bar, scroll, and then select the TIBCO WebFOCUS product page to view product overview, articles, and discussions.
  • Request access to the private WebFOCUS User Group (login required) to network with fellow members.

Former myibi community members should have received an email on 8/3/22 to activate their user accounts to join the community. Check your Spam folder for the email. Please get in touch with us at community@tibco.com for further assistance. Reference the community FAQ to learn more about the community.


Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    [SOLVED]How to write DataMigrator logs to Vertica DB

Read-Only Read-Only Topic
Go
Search
Notify
Tools
[SOLVED]How to write DataMigrator logs to Vertica DB
 Login/Join
 
slee
Member
posted
We have a number of flows and processes running daily through DataMigrator. We use Datamigrator to control both our ETL process as well to control the processing of our various analytics performed on our Vertica databases. Because of this, we'd like to retain logs for up to a month (or longer) to reference in case we need to debug a faulty procedure.

Instead of storing these log files on the local computer, we were wondering if we could instead direct the logs to write to a table in our Vertica Database. We could handle any archiving/retention policies easily there as well as save the space on our hard drive.

I've found a brief mention in the docs of the potential to do something like this, but haven't been able to find anything detailed. Has anyone had any experience with doing something like this?

This message has been edited. Last edited by: Tamra,


DataMigrator 7.7.06
Windows Server 2012
 
Posts: 4 | Location: United States | Registered: October 19, 2016Report This Post
dhagen
Virtuoso
posted Hide Post
I've done this for very much the same reasons, but with a slight change. I don't believe that you can use anything other than the existing logging mechanism. So we left that alone. What we did was set up a reoccurring job to extract the log changes and load them into an alternate DB. We keep that live logs as small as possible, and delete data from the external log repository weekly.


"There is no limit to what you can achieve ... if you don’t care who gets the credit." Roger Abbott
 
Posts: 1102 | Location: Toronto, Ontario | Registered: May 26, 2004Report This Post
slee
Member
posted Hide Post
Thanks dhagen. After a couple of days mulling it over. That's the approach we decided to take as well. Was hoping we could implement a more direct approach, but alas, this'll have to do.


DataMigrator 7.7.06
Windows Server 2012
 
Posts: 4 | Location: United States | Registered: October 19, 2016Report This Post
Doug
Expert
posted Hide Post
Darryl, slee, or anyone,

Does anyone have the details (a fex?) to make this happen?

Thanks in advance, Doug




   In FOCUS Since 1983 ~ from FOCUS to WebFOCUS.
   Current: WebFOCUS Administrator at FIS Worldpay | 8204, 8206
 
Posts: 3132 | Location: Tennessee, Nashville area | Registered: February 23, 2005Report This Post
  Powered by Social Strata  

Read-Only Read-Only Topic

Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    [SOLVED]How to write DataMigrator logs to Vertica DB

Copyright © 1996-2020 Information Builders