Focal Point Banner
Community Center Education Summit Technical Support User Groups
Let's Get Social!

Facebook Twitter LinkedIn YouTube
Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [CLOSED] SQL Tables are updating every Hour
Go
New
Search
Notify
Tools
Reply
  
[CLOSED] SQL Tables are updating every Hour
 Login/Join
 
Gold member
posted
We have some reports which are based on a new SQL reporting DB that updates at the top of every hour. We notice that our reports and dashboards seem to lock up and freeze during this time.

How could we fix this performance issue? Should we be using the SQL set command that enables "read uncommitted" in all our procedures in order to always read the database in a timely manner, regardless if it is in the process of updating?

Thank you,

This message has been edited. Last edited by: Joey Sandoval,




Prod/Dev: WebFOCUS 8.0.08 on Windows Server 2008/Tomcat , WebFOCUS DevStudio 8.0.08 on Windows 7 Pro


 
Posts: 94 | Location: Austin, TX | Registered: August 08, 2012Reply With QuoteReport This Post
Expert
posted Hide Post
First guess is that the tables may be being locked.


Waz...

Prod:WebFOCUS 7.6.10/8.1.04Upgrade:WebFOCUS 8.2.06OS:LinuxOutputs:HTML, PDF, Excel, PPT
In Focus since 1984
Know The Code

 
Posts: 6131 | Location: 33.8688° S, 151.2093° E | Registered: October 31, 2006Reply With QuoteReport This Post
Gold member
posted Hide Post
Yes they are being locked. I received this message earlier today.

Microsoft SQL Native Client: [40001] Transaction (Process ID 75) was dea
: dlocked on lock resources with another process and has been chosen as th
: e deadlock victim. Rerun the transaction.

Waz, do you think this is solvable from the WF side? Or do you think our IT group would have to access the update schedule?




Prod/Dev: WebFOCUS 8.0.08 on Windows Server 2008/Tomcat , WebFOCUS DevStudio 8.0.08 on Windows 7 Pro


 
Posts: 94 | Location: Austin, TX | Registered: August 08, 2012Reply With QuoteReport This Post
Expert
posted Hide Post
You may have to look at the DB and how its being updated, What sort of locking is being implemented ?


Waz...

Prod:WebFOCUS 7.6.10/8.1.04Upgrade:WebFOCUS 8.2.06OS:LinuxOutputs:HTML, PDF, Excel, PPT
In Focus since 1984
Know The Code

 
Posts: 6131 | Location: 33.8688° S, 151.2093° E | Registered: October 31, 2006Reply With QuoteReport This Post
Gold member
posted Hide Post
All I know is that IT setup a scheduled replication of the production data every hour.




Prod/Dev: WebFOCUS 8.0.08 on Windows Server 2008/Tomcat , WebFOCUS DevStudio 8.0.08 on Windows 7 Pro


 
Posts: 94 | Location: Austin, TX | Registered: August 08, 2012Reply With QuoteReport This Post
Expert
posted Hide Post
I think you should talk to IT about what they have done and impacts of report running against the data. They may have suggestions.


Waz...

Prod:WebFOCUS 7.6.10/8.1.04Upgrade:WebFOCUS 8.2.06OS:LinuxOutputs:HTML, PDF, Excel, PPT
In Focus since 1984
Know The Code

 
Posts: 6131 | Location: 33.8688° S, 151.2093° E | Registered: October 31, 2006Reply With QuoteReport This Post
Virtuoso
posted Hide Post
A deadlock error should really only occur if two transactions are trying to modify the same interdependent set of records in different orders. There's absolutely no reason to get a deadlock when you're only reading from a database (MS-SQL is a database based on the MVCC principle, so it should be able to deal with that situation gracefully).

Apparently your reports or dashboards are writing to the database and, apparently, to the same tables that the replication software is trying to update (is that master-slave replication, or master-master?).

Whether that's the intended scenario or whether that's desirable is up to you. I have to say though that I find it highly unusual that reporting software would attempt to modify data in a replicated DB.

That is how it should be according to theory. However, we're talking about a Microsoft product, so none of the above is necessarily true. It's also possible that the MSSQL adapter in WF is doing something it shouldn't.


WebFOCUS 8.1.03, Windows 7-64/2008-64, IBM DB2/400, Oracle 11g & RDB, MS SQL-Server 2005, SAP, PostgreSQL 11, Output: HTML, PDF, Excel 2010
: Member of User Group Benelux :
 
Posts: 1649 | Location: Enschede, Netherlands | Registered: August 12, 2010Reply With QuoteReport This Post
Expert
posted Hide Post
I am reasonably sure that I have seen some record locking cause problems on reads.

As this is some sort of backup, only the IT guys would know what they have done. (Hopefully)


Waz...

Prod:WebFOCUS 7.6.10/8.1.04Upgrade:WebFOCUS 8.2.06OS:LinuxOutputs:HTML, PDF, Excel, PPT
In Focus since 1984
Know The Code

 
Posts: 6131 | Location: 33.8688° S, 151.2093° E | Registered: October 31, 2006Reply With QuoteReport This Post
Master
posted Hide Post
Oh, updating a table can lock it for read. No doubt about that.

Presumably you have a real need for data that is updated that frequently?

If that is the case you may want to put a table in the middle that you have more control over. Depending on size copying the table to an XFocus table (scheduled task running on the half-mark of each hour) that strictly supports your reports could be an option.

J.



 
Posts: 931 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Gold member
posted Hide Post
None of our reports are updating tables, I can promise you that.

John, I like your idea but unfortunately there are way too many tables to schedule copies to webfocus.

Our company is in the logistics sector and our customers demand nearly real time data from our TMS.




Prod/Dev: WebFOCUS 8.0.08 on Windows Server 2008/Tomcat , WebFOCUS DevStudio 8.0.08 on Windows 7 Pro


 
Posts: 94 | Location: Austin, TX | Registered: August 08, 2012Reply With QuoteReport This Post
  Powered by Social Strata  
 

Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [CLOSED] SQL Tables are updating every Hour

Copyright © 1996-2018 Information Builders, leaders in enterprise business intelligence.