Focal Point
HTTP500: same .fex, different database

This topic can be found at:
https://forums.informationbuilders.com/eve/forums/a/tpc/f/7971057331/m/1761018872

April 02, 2008, 03:37 PM
leo13
HTTP500: same .fex, different database
Hi,
We have a .fex that creates a datamart for our advancement division. When I run this .fex against our production database (which is a bunch of Oracle tables) it takes about 43 minutes to run and creates a multi-segment focus file of about 195MB (and there are a bunch of other smaller files). When I run this same .fex against one of our test databases (which is a recent clone of our production environment) it crashes after an hour or so and I get an HTTP 500 error. The main file for the datamart is only 180MB. When I looked at the tomcat logs I could see the out of memory error and our systems person changed the properties for Tomcat (which were previously blank) to: Initial memory pool 256 MB, Maximum memory pool 512MB, and he left the Thread Stack Size blank.

I'm not surprised that this .fex would take longer to run against one of our non-production environments because they are tuned differently (they have fewer resources, swap space, etc.) than our production database. But I guess I don't really understand why I would be running out of memory on the tomcat end.

Any ideas?

We are running WebFOCUS 7.1.4 on a Windows machine running Windows 2003 (standard edition, service pack 1). IBM 2.80GHz CPU with 2.5 GB RAM. Tomcat version 5.0.28.

Thanks!


WebFOCUS 7.7.05
Windows 2008
April 02, 2008, 06:44 PM
Francis Mariani
Is it possible that the http500 is caused by a timeout rather than by a memory problem?


Francis


Give me code, or give me retirement. In FOCUS since 1991

Production: WF 7.7.05M, Dev Studio, BID, MRE, WebSphere, DB2 / Test: WF 8.1.05M, App Studio, BI Portal, Report Caster, jQuery, HighCharts, Apache Tomcat, MS SQL Server
April 03, 2008, 05:30 AM
GamP
Are you sure that the memory error in tomcat is absolutely sure linked to the execution of your fex against the prod environment? I mean: have you checked that the time of occurrence of the error is the same as the occurence of your http500? OOM errors in tomcat usually occur because of trying to display large reports or some such action. And from the look of your description, this is not the case with you procedure.
If the http500 is not related to the OOM, then it may very well be because of a time-out. If that is the case, your agent should still be running, trying to do whatever it is that it needs to do. Check to see if your agent is still running after the http500, and if so, it is a time out issue.


GamP

- Using AS 8.2.01 on Windows 10 - IE11.
in Focus since 1988
April 03, 2008, 01:50 PM
leo13
Hi,
The error message from the corresponding localhost log is:
2008-03-26 16:01:09 StandardWrapperValve[WFServlet]: Servlet.service() for servlet WFServlet threw exception
java.lang.OutOfMemoryError


WebFOCUS 7.7.05
Windows 2008
April 03, 2008, 02:12 PM
jbanas6
What version of JVM are you running?

I would look at increasing your heap size. I beleive the default heap size is around 1 MB.


WF 7.6.10 /IIS 6/ JBoss Enterprise 4.3
Windows XP SP 2/Windows 2003 Server
MVS 7.3.3
April 03, 2008, 04:25 PM
susannah
leo,
are you executing LIVE , or in Deferred Mode or Caster? If Live, i'ld go w/ Frankie and Gamp and try it Deferred if you've got mre, or caster if you dont. Testing the TimeOut idea alone, first.
-s




In Focus since 1979///7706m/5 ;wintel 2008/64;OAM security; Oracle db, ///MRE/BID
April 03, 2008, 04:39 PM
Waz
To determine where the problem exists, I would suggest running the fex with edastart -t. If it works, then therror is either in WebFOCUS Client of Tomcat.

I have also seen WebFOCUS return an HTTP500 error when the output is too large, can't remember how many lines though.


Waz...

Prod:WebFOCUS 7.6.10/8.1.04Upgrade:WebFOCUS 8.2.07OS:LinuxOutputs:HTML, PDF, Excel, PPT
In Focus since 1984
Pity the lost knowledge of an old programmer!

April 04, 2008, 10:06 AM
leo13
The version of JVM on the WebFOCUS server is 1.4.2_10. I have Java 1.5.0_04-b05 on my PC. (I know that ReportCaster would use the JVM on the server -- does DevStudio use that or the JVM on your PC?).

When I run the .fex via ReportCaster, again, it works fine in our production environment (we run this job nightly with no problems). However, when I run it against our test environment, it stops after about 10 minutes. I get an email saying it completed successfully, but it clearly didn't complete at all.

I don't know how to run this job deferred. It is not in a domain (managed reporting) -- it is located in one of the application folders on EDASERVE.

The "output" of this fex isn't what I would call output in the traditional sense -- no HTML, PDF, Excel, etc. files are created, but the -TYPE commands, and messages are sent to my Internet Explorer window. With over 10,000 lines of code in the .fex the data sent to the browswer window is very long, but since there is no problem in my production environment, I don't think that should be the problem since I should get approximately the same size file in the test environment.

How do I run the fex with edastart -t? Is this something I do on my PC, or is this something that has to be done on the server?


WebFOCUS 7.7.05
Windows 2008
April 06, 2008, 06:12 PM
Waz
edastart -t is described in the manuals , you will need to get onto the server machine, in a DOS/telnet/etc session, depending on the OS.

If it is windows, the installation will have a
quote:
Interactive Agent Tool
option in the menu. if not cd to the bin directory, usually /ibi/srv??/wfs??/bin, then type edastart -t.

Once run you will get the FOCUS prompt ">>" you can type in commands, but no dialog manager.

Set your path, e.g. APP PATH IBISAMP IBIDEMO

You may want to set MORE to OFF as the output will be paused every page.

Run you fex, e.g. ex fexname parm1=?, parm2=?, parmn=?

See what happens.

To exit FOCUS type FIN


Also if you want to run this online or deferred from the server, log into the server console, click on procedures, select teh App directory, add it if necessary, click on the fex, select Run or Run Advanced, select Run Deferred and click Continue.


Waz...

Prod:WebFOCUS 7.6.10/8.1.04Upgrade:WebFOCUS 8.2.07OS:LinuxOutputs:HTML, PDF, Excel, PPT
In Focus since 1984
Pity the lost knowledge of an old programmer!