Focal Point
[CLOSED] Open ETLLOG.FOC

This topic can be found at:
https://forums.informationbuilders.com/eve/forums/a/tpc/f/7971057331/m/5787054986

March 01, 2018, 09:49 AM
Suga
[CLOSED] Open ETLLOG.FOC
Please assist what tool can be used to open ETLLOG.FOC located in ibi/srv77/dm/catalog?

NotePad++ does not read the file.

This message has been edited. Last edited by: FP Mod Chuck,


WebFOCUS 8
Windows, All Outputs
March 01, 2018, 10:16 AM
FP Mod Chuck
Suga

A .foc file is a FOCUS database and can only be accessed using WebFOCUS. There is a master file .mas associated with it that WebFOCUS will use as it's metadata.


Thank you for using Focal Point!

Chuck Wolff - Focal Point Moderator
WebFOCUS 7x and 8x, Windows, Linux All output Formats
March 01, 2018, 10:26 AM
Wep5622
I guess the webconsole gets stuck on reading it in your case? At least, that was happening for us...

As a viable workaround, we just TABLE it (with some filters to limit the output to the relevant) to a FORMAT ALPHA file somewhere on disk.
Then we view that file with Baretail, which is specialized in displaying (parts of) log files on Windows - similar to the UNIX tail command, but with a GUI.

Text editors usually aren't good at handling multi-megabyte text files, as they'll attempt to colour-code the contents and to track changes that are not going to occur anyway. For large files that will take time!


WebFOCUS 8.1.03, Windows 7-64/2008-64, IBM DB2/400, Oracle 11g & RDB, MS SQL-Server 2005, SAP, PostgreSQL 11, Output: HTML, PDF, Excel 2010
: Member of User Group Benelux :
March 01, 2018, 10:58 AM
Francis Mariani
A log file in a FOCUS database? Not very efficient in my opinion. If it was a text file, there are utilities with which you can view the first or last x lines, or text editors that can handle large files, such as UltraEdit (with a minor config mod)...


Francis


Give me code, or give me retirement. In FOCUS since 1991

Production: WF 7.7.05M, Dev Studio, BID, MRE, WebSphere, DB2 / Test: WF 8.1.05M, App Studio, BI Portal, Report Caster, jQuery, HighCharts, Apache Tomcat, MS SQL Server
March 01, 2018, 11:38 AM
Doug
How about reading it within DataMigrator?
March 01, 2018, 12:54 PM
Suga
Thank you Doug,

Yes, I want to know how to read it within Data Migrator. How do I access and open ibi/srv77/dm/catalog/ETLLOG.FOC from DM?

Does ETLLOG.FOC file contain Datamigrator Log and Statistics(Logs and Traces)? My DM Log and statistics is not showing logs anymore when I click the blue link.


WebFOCUS 8
Windows, All Outputs
March 01, 2018, 04:57 PM
FP Mod Chuck
Suga

Yes it does contain the log data. One bad thing about having a focus database is that it has a 2 GB size restriction. Once it reaches that size it becomes unreadable. Using the Data Management Console you can recreate it by right mouse clicking on DataMigrator Log and Statistics under the Logs and Traces folder and choose Recreate.


Thank you for using Focal Point!

Chuck Wolff - Focal Point Moderator
WebFOCUS 7x and 8x, Windows, Linux All output Formats
April 17, 2018, 01:29 PM
Suga
I just follow up with this discussion. Please advise how to open

/opt/insight/uat1/dm7704/ibi/srv77/dm/catalog/etllog.foc
file of 1 GB.

How can the file be opened from Webfocus Developer Studio?


WebFOCUS 8
Windows, All Outputs
April 17, 2018, 01:41 PM
FP Mod Chuck
You have to use WebFOCUS to create a report against it using the metadata.


Thank you for using Focal Point!

Chuck Wolff - Focal Point Moderator
WebFOCUS 7x and 8x, Windows, Linux All output Formats
April 17, 2018, 01:44 PM
Francis Mariani
.foc files are "FOCUS databases" which is a proprietary format, you cannot use a text editor to read them.

Since you're using Data Migrator, you could use it to create an ETL process to read etllog.foc and HOLD it in an alpha format, which will be readable by any text editor. Or create a simple fex to read and hold:

TABLE FILE ETLLOG
PRINT *
ON TABLE HOLD AS baseapp/ETLLOG_ALPHA FORMAT ALPHA
END


Your file is /opt/insight/uat1/dm7704/ibi/srv77/dm/catalog/etllog.foc
You should be able to find the Master for this file at /opt/insight/uat1/dm7704/ibi/srv77/dm/catalog/etllog.mas or /opt/insight/uat1/dm7704/ibi/srv77/home/catalog/etllog.mas or somewhere else in /opt/insight/uat1/dm7704/ibi/srv77/

You could even filter on the DATE_STAMP column if you need to reduce the number of extracted rows.


Francis


Give me code, or give me retirement. In FOCUS since 1991

Production: WF 7.7.05M, Dev Studio, BID, MRE, WebSphere, DB2 / Test: WF 8.1.05M, App Studio, BI Portal, Report Caster, jQuery, HighCharts, Apache Tomcat, MS SQL Server
April 18, 2018, 10:00 AM
dhagen
quote:
Originally posted by Suga:

Does ETLLOG.FOC file contain Datamigrator Log and Statistics(Logs and Traces)? My DM Log and statistics is not showing logs anymore when I click the blue link.


Nope. The etllog contains only the logs. The etlstats.foc contains the statistics.

If left unchecked, the log and stats files can get corrupted in time. I recommend that you build a routine to dump and reload these files every once in a while - depending on the number of jobs you run. The etlstats is not typically the problem as it is usually pretty small. The etllog can get very large over time. These are XFOCUS tables and not FOCUS tables, and as such are usually safe up to 9G in size.

If you want to see your stats, just use Francis' suggestion by use ETLSTATS instead of ETLLOG.


"There is no limit to what you can achieve ... if you don’t care who gets the credit." Roger Abbott