Having srv crashing issues due to losing excess amt of VRAM from edapgwy.exe process:
Hi all,
Does anyone know what the edapgwy.exe application does or is in charge of? We've got 2 8201M environment servers that seem to be crashing of late due to this process taking up excessive amounts of VRAM.
Any information on this process would be greatly appreciated.
Thanks in advance!
8.2.02M (production), 8.2.02M (test), Windows 10, all outputs.
July 26, 2017, 07:05 PM
Waz
I would suggest talking to Techsupport about what edapgwy is expected to do and user
Waz...
Prod:
WebFOCUS 7.6.10/8.1.04
Upgrade:
WebFOCUS 8.2.07
OS:
Linux
Outputs:
HTML, PDF, Excel, PPT
In Focus since 1984
Pity the lost knowledge of an old programmer!
July 26, 2017, 09:20 PM
BabakNYC
According to tech support edapgwy.exe corresponds to the following daemon processes:
1) The Deferred Requests Special Services Daemon. The DFM daemon is used for deferred requests. There is one process per server.
2) The HTTP Listener Daemon. The HTTP daemon is used for requests using the HTTP protocol. There is one process per server.
3) The TCP Listener Daemon. The TCP daemon is used for requests using the TCP protocol. There is one process per server.
What gen are you running? Have you reviewed edaprint.log file to see what errors are being logged? Also, check the min and max heap sizes on Tomcat.
WebFOCUS 8206, Unix, Windows
July 27, 2017, 09:55 AM
KenFR
Could be someone launch huge process deferred and taking all the memory You can go into properties on DFM_default and limit memory_limit and/or cpu_limit to see if that helps
8105 Tomcat and AIX reporting server input: Teradata, SQL, DB2, Essbase, Oracle, text output:html, excel, PDF,
July 27, 2017, 11:06 AM
CoolGuy
Thanks all for chiming in. I appreciate your time and the insights you've each provided.
BabakNYC, the Gen # for the server that's crashed twice thus far: 1060; the other that's crashed once thus far: 1086. Will be looking at all the logs from the last 2 days shortly, and will update this thread after I find anything. Where can I go to find the heap sizes for Tomcat?
I've reviewed various Tech Support Case entries that were searchable via the Tech Support site, and learned a few things. Not sure whether helpful or not as of yet.
So, in the Adapter settings for our Hyperstage server install, we have the ability to change the FETCHSIZE from the default 100 record value to something higher if needed. My colleague found by changing this setting it would speed up the data retrieval from Hyperstage (or other types of DBMSs via differing adapter types) I think he was saying. Would him setting this to 5000 (both servers for various adapter types) be a possible cause to our server crashes?
** The setting can be found by going to the Reporting Server Console > Adapters > Hyperstage (PG) JDBC & right-clicking the folder and going to Change Settings > Read/Write Optimization section > FETCHSIZE. **This message has been edited. Last edited by: CoolGuy,
8.2.02M (production), 8.2.02M (test), Windows 10, all outputs.
July 27, 2017, 12:06 PM
CoolGuy
So, in the archived edaprint.log, that was logging right before the crash from the first day, I have a loooooong string of blocks of info like this where TSCOM agents are ready to be ran but something isn't able to find an OCI.dll file? And some values are saying they aren't set after which, probably due to being gathered from the missing dll?
Here's a section of the log that details out what I'm describing below. Any ideas?
07/25/2017 12:31:51.113 I request by t3rp2420 to notify agent is ready (tscomid=8)
07/25/2017 12:31:51.114 I request by t3rp2468 to notify agent is ready (tscomid=14)
07/25/2017 12:31:51.269 I request by t3rp2452 to notify agent is ready (tscomid=12)
07/25/2017 12:31:50.268 E OCI.dll not found
07/25/2017 12:31:50.269 - OCI.dll not found
07/25/2017 12:31:50.276 - (FOC1261) PHYSICAL INTERFACE NOT FOUND FOR SUFFIX SQLORA. MODULE NAME : OR8PS11
07/25/2017 12:31:50.276 - (FOC1262) THE FOLLOWING NATIVE ERROR MESSAGE(S) CAPTURED :
07/25/2017 12:31:50.276 - (FOC1260) Loading D:\ibi\srv82\home\bin\or8ps11.dll: SearchPath: failed to find OCI.dll
07/25/2017 12:31:50.277 - (FOC1263) THE CURRENT ENVIRONMENT VARIABLES FOR SUFFIX SQLORA ARE :
07/25/2017 12:31:50.277 - (FOC1260) NLS_LANG : NOT SET
07/25/2017 12:31:50.277 - (FOC1260) ORA_NCHAR_LITERAL_REPLACE : NOT SET
07/25/2017 12:31:50.277 - (FOC1260) PATH : C:\Program Files\Java\jdk1.8.0_111\jre\bin
07/25/2017 12:31:50.277 - (FOC1260) C:\Program Files\Java\jdk1.8.0_111\jre\bin\server
07/25/2017 12:31:50.277 - (FOC1260) D:\ibi\srv82\home\bin
07/25/2017 12:31:50.277 - (FOC1260) C:\ProgramData\Oracle\Java\javapath
07/25/2017 12:31:50.277 - (FOC1260) C:\Windows\system32
07/25/2017 12:31:50.277 - (FOC1260) C:\Windows
07/25/2017 12:31:50.277 - (FOC1260) C:\Windows\System32\Wbem
07/25/2017 12:31:50.277 - (FOC1260) C:\Windows\System32\WindowsPowerShell\v1.0\
07/25/2017 12:31:50.282 - (FOC1676) UNRECOGNIZED SET COMMAND FOR ORACLE INTERFACE
07/25/2017 12:31:50.282 - (FOC1261) PHYSICAL INTERFACE NOT FOUND FOR SUFFIX SQLORA. MODULE NAME : OR8PS11
07/25/2017 12:31:50.282 - (FOC1262) THE FOLLOWING NATIVE ERROR MESSAGE(S) CAPTURED :
07/25/2017 12:31:50.282 - (FOC1260) Loading D:\ibi\srv82\home\bin\or8ps11.dll: SearchPath: failed to find OCI.dll
07/25/2017 12:31:50.283 - (FOC1263) THE CURRENT ENVIRONMENT VARIABLES FOR SUFFIX SQLORA ARE :
07/25/2017 12:31:50.283 - (FOC1260) NLS_LANG : NOT SET
07/25/2017 12:31:50.283 - (FOC1260) ORA_NCHAR_LITERAL_REPLACE : NOT SET
07/25/2017 12:31:50.283 - (FOC1260) PATH : C:\Program Files\Java\jdk1.8.0_111\jre\bin
07/25/2017 12:31:50.283 - (FOC1260) C:\Program Files\Java\jdk1.8.0_111\jre\bin\server
07/25/2017 12:31:50.283 - (FOC1260) D:\ibi\srv82\home\bin
07/25/2017 12:31:50.283 - (FOC1260) C:\ProgramData\Oracle\Java\javapath
07/25/2017 12:31:50.283 - (FOC1260) C:\Windows\system32
07/25/2017 12:31:50.283 - (FOC1260) C:\Windows
07/25/2017 12:31:50.283 - (FOC1260) C:\Windows\System32\Wbem
07/25/2017 12:31:50.283 - (FOC1260) C:\Windows\System32\WindowsPowerShell\v1.0\
07/25/2017 12:31:50.283 - (FOC1261) PHYSICAL INTERFACE NOT FOUND FOR SUFFIX SQLORA. MODULE NAME : OR8PS11
07/25/2017 12:31:50.283 - (FOC1262) THE FOLLOWING NATIVE ERROR MESSAGE(S) CAPTURED :
07/25/2017 12:31:50.283 - (FOC1260) Loading D:\ibi\srv82\home\bin\or8ps11.dll: SearchPath: failed to find OCI.dll
07/25/2017 12:31:50.283 - (FOC1263) THE CURRENT ENVIRONMENT VARIABLES FOR SUFFIX SQLORA ARE :
07/25/2017 12:31:50.283 - (FOC1260) NLS_LANG : NOT SET
07/25/2017 12:31:50.283 - (FOC1260) ORA_NCHAR_LITERAL_REPLACE : NOT SET
07/25/2017 12:31:50.283 - (FOC1260) PATH : C:\Program Files\Java\jdk1.8.0_111\jre\bin
07/25/2017 12:31:50.283 - (FOC1260) C:\Program Files\Java\jdk1.8.0_111\jre\bin\server
07/25/2017 12:31:50.283 - (FOC1260) D:\ibi\srv82\home\bin
07/25/2017 12:31:50.283 - (FOC1260) C:\ProgramData\Oracle\Java\javapath
07/25/2017 12:31:50.283 - (FOC1260) C:\Windows\system32
07/25/2017 12:31:50.283 - (FOC1260) C:\Windows
07/25/2017 12:31:50.283 - (FOC1260) C:\Windows\System32\Wbem
07/25/2017 12:31:50.283 - (FOC1260) C:\Windows\System32\WindowsPowerShell\v1.0\
07/25/2017 12:31:50.283 - (FOC1400) SQLCODE IS -1 (HEX: FFFFFFFF)
07/25/2017 12:31:50.283 - (FOC1479) ERROR CONNECTING TO SQL DATABASE
8.2.02M (production), 8.2.02M (test), Windows 10, all outputs.
July 27, 2017, 12:11 PM
FP Mod Chuck
Hi Coolguy
Is the oracle client installed on this machine? If so in what directory. Can you search for the oci.dll on the actual machine?
Thank you for using Focal Point!
Chuck Wolff - Focal Point Moderator WebFOCUS 7x and 8x, Windows, Linux All output Formats
July 27, 2017, 12:15 PM
CoolGuy
Hi Chuck,
I'm not sure on this one with the logs saying things are missing. HD did the install for this one. I'll look around and see if I can find it though.
Thanks for chiming in! Will keep you and all posted on anything I find.
8.2.02M (production), 8.2.02M (test), Windows 10, all outputs.
July 27, 2017, 12:25 PM
BabakNYC
The latest 8201M should say:
Configuration Date 12/08/2016 10:53:07 Build Date 05/11/2017 14:56:36 Gen Number 1086 Release 82 Source Date 05/01/2017 14:53:13
Your edasprof is trying to execute commands that don't relate to the adapters you've configured. What commands (SET, DEFAULT SQLORA type stuff) do you have in edasprof?
WebFOCUS 8206, Unix, Windows
July 27, 2017, 12:45 PM
CoolGuy
BabakNYC,
Here's what's in our edasprof config file for this environment. I've replaced all the unneeded/sensitive information with "..." within the code below:
-*********************************************************
-* Profile generated on 08 December 2016 at 09:31:07
-*********************************************************
-*
-*
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET CONNECTION_ATTRIBUTES ...
ENGINE SQLORA SET CONNECTION_ATTRIBUTES ...
ENGINE SQLORA SET CONNECTION_ATTRIBUTES ...
ENGINE SQLMSS SET ISOLATION RU
ENGINE SQLORA SET ISOLATION RU
SET ACRSVRBTITL = ON
-INCLUDE IBFS:/EDA/EDASERVE/baseapp/dates.fex
-*
ENGINE SQLHYPG SET CONNECTION_ATTRIBUTES ...
APP PATH ...
ENGINE SQLHYPG SET BULKLOAD ON
ENGINE SQLHYPG SET FETCHSIZE 1000
8.2.02M (production), 8.2.02M (test), Windows 10, all outputs.
July 27, 2017, 01:02 PM
BabakNYC
quote:
ENGINE SQLORA SET ISOLATION RU
Do you have Oracle and SQL Server adapters configured? I can't tell from here. But if you don't, back up your edasprof and get rid of all these references to them and see if the error goes away.
WebFOCUS 8206, Unix, Windows
July 27, 2017, 01:12 PM
CoolGuy
BabakNYC,
We do have both types configured. Do we really need to set ISOLATION levels for these here? What are the defaults for this? Do you know?This message has been edited. Last edited by: CoolGuy,
8.2.02M (production), 8.2.02M (test), Windows 10, all outputs.
July 27, 2017, 01:17 PM
CoolGuy
Chuck,
Found the OCI.dll file here: \\serverName\...\ibi\srv82\home\etc\dbms\oracle_instant_client Is there a reason why the RS can't find it for some reason? Should something be set in the system environment variables?
8.2.02M (production), 8.2.02M (test), Windows 10, all outputs.
July 28, 2017, 10:00 AM
FP Mod Chuck
CoolGuy
I didn't realize that we packaged the instant client with the product. I am not sure how to register it though. I think your best option is to have H install the full Oracle client. I believe there are some limitations with using the instant client.
Thank you for using Focal Point!
Chuck Wolff - Focal Point Moderator WebFOCUS 7x and 8x, Windows, Linux All output Formats
July 28, 2017, 11:39 AM
CoolGuy
Chuck,
Didn't know there was an option for such. Good to know. Thanks for chiming in and lettings me know about these things. I'll let my team know this is an issue and the probable cause of some of the errors we've been getting.
All,
After lowering the fetch size for our data adapters yesterday, we haven't had any new crashes as of yet, but am still holding out for one or two to come. Hoping not though and that this was the cause or part of it at least. Thanks to everyone that willingly posted to help me on this. I will update this post as SOLVED in about a week if we no longer have any crashes by then.
8.2.02M (production), 8.2.02M (test), Windows 10, all outputs.