Focal Point Banner
Community Center Education Summit Technical Support User Groups
Let's Get Social!

Facebook Twitter LinkedIn YouTube
Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     Long - WebFocus webcgi/webapi killing WWW Publishing Service?
Go
New
Search
Notify
Tools
Reply
  
Long - WebFocus webcgi/webapi killing WWW Publishing Service?
 Login/Join
 
<ggeinec>
posted
About once a week we get one of these messages in the Event log on our web server that is running IIS 5.0 on Windows 2000 Advanced Server:

8/6/2004 9:27:38 AM WAM Error None 204 N/A (server name here) The HTTP server encountered an unhandled exception while processing the ISAPI Application '
MSVCRT!memset + 0x49
webcgi!_mr_all_malloc + 0xBB
webcgi!_mr_free + 0x16
webcgi!_wf_getenv + 0xD6
webcgi!_get_env_var + 0x7E
webcgi!_look_up_var + 0x88
webcgi!_look_up_var_string + 0x63
webcgi!_do_command + 0x15AB
webcgi!_run_script + 0x1C3
webcgi!_webfoc2 + 0x6E3
webcgi!_webfocex + 0x8B
webcgi!_cgient + 0x5D1
webapi!_HttpExtensionProc@4 + 0x41
wam!DllCanUnloadNow + 0x636
wam!DllCanUnloadNow + 0x20C
RPCRT4!CheckVerificationTrailer + 0x61
RPCRT4!NdrStubCall2 + 0x552
RPCRT4!CStdStubBuffer_Invoke + 0xA6
ole32!WdtpInterfacePointer_UserSize + 0x6CB
ole32!WdtpInterfacePointer_UserSize + 0x9A6
ole32!CoFreeAllLibraries + 0x80C4
ole32!CoGetPSClsid + 0x104A
ole32!WdtpInterfacePointer_UserSize + 0x5B0
ole32!WdtpInterfacePointer_UserSize + 0xCF2
ole32!StgGetIFillLockBytesOnFile + 0x1A753
RPCRT4!I_RpcGetBufferWithObject + 0x2F9
RPCRT4!I_RpcGetBufferWithObject + 0x217
RPCRT4!I_RpcGetBufferWithObject + 0x13A
RPCRT4!NdrConformantArrayUnmarshall + 0x1FE
RPCRT4!RpcBindingFree + 0x20E2
RPCRT4!RpcBindingFree + 0x1BEC
RPCRT4!NdrCorrelationInitialize + 0x147
RPCRT4!NdrCorrelationInitialize + 0x76
RPCRT4!RpcBindingFree + 0x492
KERNEL32!TlsSetValue + 0xF0
'.

Then we get a series of 40 - 50 of the following message over a period of a couple of hours or so (the difference being in the additional ntdll! lines at the top of the message which varies from 2 - 4 aditional lines):

8/6/2004 10:49:40 AM WAM Error None 204 N/A server name here The HTTP server encountered an unhandled exception while processing the ISAPI Application '
ntdll!RtlDestroyHeap + 0x8E6
ntdll!RtlSizeHeap + 0x3C6
ntdll!RtlSizeHeap + 0x167
MSVCRT!malloc + 0x89
MSVCRT!malloc + 0x26
webcgi!_cgient + 0x2F
webapi!_HttpExtensionProc@4 + 0x41
wam!DllCanUnloadNow + 0x636
wam!DllCanUnloadNow + 0x20C
RPCRT4!CheckVerificationTrailer + 0x61
RPCRT4!NdrStubCall2 + 0x552
RPCRT4!CStdStubBuffer_Invoke + 0xA6
ole32!WdtpInterfacePointer_UserSize + 0x6CB
ole32!WdtpInterfacePointer_UserSize + 0x9A6
ole32!CoFreeAllLibraries + 0x80C4
ole32!CoGetPSClsid + 0x104A
ole32!WdtpInterfacePointer_UserSize + 0x5B0
ole32!WdtpInterfacePointer_UserSize + 0xCF2
ole32!StgGetIFillLockBytesOnFile + 0x1A753
RPCRT4!I_RpcGetBufferWithObject + 0x2F9
RPCRT4!I_RpcGetBufferWithObject + 0x217
RPCRT4!I_RpcGetBufferWithObject + 0x13A
RPCRT4!NdrConformantArrayUnmarshall + 0x1FE
RPCRT4!RpcBindingFree + 0x20E2
RPCRT4!RpcBindingFree + 0x1BEC
RPCRT4!NdrCorrelationInitialize + 0x147
RPCRT4!NdrCorrelationInitialize + 0x76
RPCRT4!RpcBindingFree + 0x492
KERNEL32!TlsSetValue + 0xF0
'.

Beginning with the first message above, the number of concurrent users on the web server starts a sharp and steady climb until eventually it hits around 140 - 270 concurrent users.

At this point the web server disappears from the network - we cannot get pages through HTTP, we cannot ping it or FTP to it.

If we stop and restart the World Wide Web Publishing service everything returns to normal and the number of concurrent users drops straight down to the normal 25 - 45 and stays there. We get no more of the messages shown above until the next time this cycle repeats.

On our web server we have installed the WebFocus cgi piece that allows us to interact with a WebFocus application server on a separate server.

On the web server we also have ColdFusion 5.0.

Does anyone have ideas on what might be going on here?

Why are we getting these webapi/webcgi errors?

Is the source of these errors a WebFocus problem that is ultimately causing the WWW Publishing service to fail or are the messages the symptom of another problem?

Thanks!

George
 
Reply With QuoteReport This Post
Platinum Member
posted Hide Post
What release of WebFocus are you running
and what is the service level of the release.
 
Posts: 226 | Registered: June 08, 2003Reply With QuoteReport This Post
Expert
posted Hide Post
George, all i can offer is that, like you, we run iis5, wn2ka server, and always use isapi for our selfserv wf site and servlet for our Caster activities and our mre development activities. and we've never had this problem,in any version from 436 up to 525.
But we do have a dedicated box, nothing else runs on it. We run webfocus in security protected mode, not as a service, and on reboot we always have to start caster manually. Are you running as a service?
 
Posts: 3811 | Location: Manhattan | Registered: October 28, 2003Reply With QuoteReport This Post
Member
posted Hide Post
Gerry,

I have also been following this problem at SSA for a while now. The WebFOCUS software involved is release 4.3.1. We are running this as a service. This problem is also evident in our Chicago regional office with their WebFOCUS setup. Chicago has upgraded to 5.2.5 and this did not solve the CGI issue. They are now looking to move to servlets.

Lou
 
Posts: 17 | Location: SSA, Maryland | Registered: May 06, 2003Reply With QuoteReport This Post
Silver Member
posted Hide Post
George,
Unfortunately, the likely scenario is that the isapi.dll is bringing down your webserver. It is important to know the release, since there were various memory leaks fixed using isapi after 431.
ibiweb.exe would most likely not have this problem, since it is not as tightly integrated with the web server.
Lets see which version your using.

Regards, Ben Naphtali
Strategic Support Manager
Business Intelligence Products Group
 
Posts: 34 | Location: 2 Penn Plaza | Registered: July 29, 2004Reply With QuoteReport This Post
Member
posted Hide Post
Ben,

We originally deployed our apps using ibiweb.exe but we were forced to use isapi (webapi.dll) because our webmaster could not get the permissions correct with IWA to use ibiweb.exe. This occured after a Windows server upgrade and one of our major apps was rendered inaccessable due to permissions on the file ibiweb.exe so we switched to isapi access which worked.

A second app has always used ibiweb.exe but it is not under IWA security. Maybe you are on to something.

Lou
 
Posts: 17 | Location: SSA, Maryland | Registered: May 06, 2003Reply With QuoteReport This Post
Silver Member
posted Hide Post
Lou,
I expected all of the isapi memory problems to be addressed in the release your running. If you need something running TODAY, then you can use ibiweb.exe which is process based. If there is some sort of failure in one of the connections, there is much less chance that it will affect the WebServer, and it will also work with IWA.
The benefit and tradeoff of using ibiweb.exe is that it is process based. The processes are better isolated, but you have the potential to lose some performance.
You should also be aware that IIS provides some protection like this as well. Depending on the version of IIS, there are different settings. IIS 5.0 provides 3 levels of Application Protection: low, medium and high. High will run applications outside of the Web Server Service. All of this does not solve the original problem, but lessens the impact.
To pursue the original problem, please open a case with Customer Support. If there is some sort of reproduction, that would be helpful. If not, I'm sure we can come up with some additional diagnostics that will pinpoint the problem.
Regards, Ben Naphtali
Strategic Support Manager
Business Intelligence Products Group
 
Posts: 34 | Location: 2 Penn Plaza | Registered: July 29, 2004Reply With QuoteReport This Post
  Powered by Social Strata  
 

Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     Long - WebFocus webcgi/webapi killing WWW Publishing Service?

Copyright © 1996-2018 Information Builders, leaders in enterprise business intelligence.