March 08, 2010, 11:17 AMDeanna Dobson
Log files in a Real Time (or close to) Environment
Does anyone have a way to handle the log files when running the ETLs on a constant basis? We currently run ETLs to load our Data Warehouse at night on a scheduled basis and want to go to a more frequent basis throughout the day. Currently before our nightly ETL load of our tables to the Data Warehouse, the logs are backuped and cleared out.
Any suggestions on how to handle this is appreciated.
We are on version 7.6.10.
March 18, 2010, 02:53 PMKerry
Can you please provide a little more details on what you are trying to do? For example, what exactly you mean by "handle the log file"? What is not currently being handled properly? What is the problem you are having?
March 18, 2010, 04:04 PMDeanna Dobson
I was under the impressiong that the log files were limited to 2 GB, but I just now found that they can be increased to 16 GB by adding the XFOCUS file format to the master file.
I think that it is going to solve my concern. We currently have a process that runs nightly to recreate the logs before our nightly run loads. We are going to be updating our Data Warehouse on a more frequent basis and the concern was on how to prevent the log file from filling up during the day before it reaches the scheduled recreation.