Focal Point Banner


As of December 1, 2020, Focal Point is retired and repurposed as a reference repository. We value the wealth of knowledge that's been shared here over the years. You'll continue to have access to this treasure trove of knowledge, for search purposes only.

Join the TIBCO Community
TIBCO Community is a collaborative space for users to share knowledge and support one another in making the best use of TIBCO products and services. There are several TIBCO WebFOCUS resources in the community.

  • From the Home page, select Predict: WebFOCUS to view articles, questions, and trending articles.
  • Select Products from the top navigation bar, scroll, and then select the TIBCO WebFOCUS product page to view product overview, articles, and discussions.
  • Request access to the private WebFOCUS User Group (login required) to network with fellow members.

Former myibi community members should have received an email on 8/3/22 to activate their user accounts to join the community. Check your Spam folder for the email. Please get in touch with us at community@tibco.com for further assistance. Reference the community FAQ to learn more about the community.


Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [CLOSED] Running large report with EXCEL output

Read-Only Read-Only Topic
Go
Search
Notify
Tools
[CLOSED] Running large report with EXCEL output
 Login/Join
 
fatboyjim
Platinum Member
posted
Hi,

I'm currently running a simple query report, but with large amounts of data in the output in EXCEL (approx 150mb).

I have used FILEDEF to save into a shared location.

But I keep getting the following error:
This report is invalid because the data retrieval has been killed or the job has been stopped.

Has anyone have similar problems with it or any alternatives to large excel files produced?

Thanks.

Best Regards,

Jimmy Pang

This message has been edited. Last edited by: fatboyjim,


DEV: WF 7.6.10
TEST: WF 7.6.10
PROD: WF 7.6.10
MRE: WF 7.6.4
OS/Platform: Windows
Dev Studio: WF 7.7
Output: HTML, EXCEL, PDF, GRAPH, LOTUS, CSV
 
Posts: 117 | Location: Toronto, Ontario, Canada | Registered: February 29, 2008Report This Post
Francis Mariani
Expert
posted Hide Post
Biggest clue: "150mb".

Which version of Excel? Excel 2003 and older has a limit of 65000 rows per tab (and some number of columns).

I would create a tab or comma delimited file on that shared drive and import that into Excel, remembering the limits of Excel.


Francis


Give me code, or give me retirement. In FOCUS since 1991

Production: WF 7.7.05M, Dev Studio, BID, MRE, WebSphere, DB2 / Test: WF 8.1.05M, App Studio, BI Portal, Report Caster, jQuery, HighCharts, Apache Tomcat, MS SQL Server
 
Posts: 10577 | Location: Toronto, Ontario, Canada | Registered: April 27, 2005Report This Post
fatboyjim
Platinum Member
posted Hide Post
Yes, I know, but the user requirement still want all the data at once (~approx 20% of the data in the table).

There are many columns and that report has over 100 000 rows. It is under the assumption that they have EXCEL 2007 installed into their PC as part of the specs. The reason for the EXCEL to for formatting purposes.

Would it be a much smaller file if it was comma delimited?

Best Regards,

Jimmy Pang


DEV: WF 7.6.10
TEST: WF 7.6.10
PROD: WF 7.6.10
MRE: WF 7.6.4
OS/Platform: Windows
Dev Studio: WF 7.7
Output: HTML, EXCEL, PDF, GRAPH, LOTUS, CSV
 
Posts: 117 | Location: Toronto, Ontario, Canada | Registered: February 29, 2008Report This Post
RSquared
Guru
posted Hide Post
Can you somehow break on any field that would limit the number of records per tab ? If yes, then save as EXL2K BYTOC may help


WF 7.6.11
Oracle
WebSphere
Windows NT-5.2 x86 32bit
 
Posts: 398 | Registered: February 04, 2008Report This Post
fatboyjim
Platinum Member
posted Hide Post
Hi,

Thanks for the suggestion, but in the end, it's still the same EXCEL file and the size would still be very large.

Found out that the transfer from the application server to local or shared file location was taking up the CPU usage (+90%) and the admin console has a CPU_LIMIT configuration setting that kills the agent when it reaches the limit. I believe it is set to 120 seconds by default.

Tested out with a larger limit and was able to get my report out successfully (500mb in size), but of course that increase the risk of having run away jobs or overload the server if the setting changes.

Luckily, was able to convince them that it was too big and even if the report came out, can't open it up.

Solution: Refine the search criteria.

Thanks for everyone's help.

Best Regards,

Jimmy Pang


DEV: WF 7.6.10
TEST: WF 7.6.10
PROD: WF 7.6.10
MRE: WF 7.6.4
OS/Platform: Windows
Dev Studio: WF 7.7
Output: HTML, EXCEL, PDF, GRAPH, LOTUS, CSV
 
Posts: 117 | Location: Toronto, Ontario, Canada | Registered: February 29, 2008Report This Post
  Powered by Social Strata  

Read-Only Read-Only Topic

Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [CLOSED] Running large report with EXCEL output

Copyright © 1996-2020 Information Builders