[CLOSED] Rounding off giving wrong result in 7.6.11
We have just installed WF 7.6.11 and migrated our applications from WF 7.1.4. But some of our reports started giving wrong values. e.g. We have one define field
The value of TABLE_FIELD/1000000 comes out to be 4.4861 but the field displayed in 7.6.11 is 4.4 which should be 4.5 as it is coming in 7.1.4.
Has anybody faced a similar issue with 7.6.11?
regards, DeepakThis message has been edited. Last edited by: Kerry,
Deepak WebFOCUS 7.6.11 Redhat Linux 5.5 Excel, pdf, HTML
September 29, 2010, 07:18 AM
A22.1 is not a valid format specifier. Did you mean D22.1?
It works fine here:
APP APPENDPATH IBISAMP
DEFINE FILE CAR
VALUE/D22.1 = 4486100/1000000;
TABLE FILE CAR
PRINT VALUE CAR
WHERE RECORDLIMIT EQ 1;
WebFOCUS 8.1.03, Windows 7-64/2008-64, IBM DB2/400, Oracle 11g & RDB, MS SQL-Server 2005, SAP, PostgreSQL 11, Output: HTML, PDF, Excel 2010 : Member of User Group Benelux :
September 29, 2010, 09:55 AM
4.5 in v7.6.8.
It's called "rounding", so, is it "wrong" or is it just "different"?
Give me code, or give me retirement. In FOCUS since 1991
Production: WF 7.7.05M, Dev Studio, BID, MRE, WebSphere, DB2 / Test: WF 8.1.05M, App Studio, BI Portal, Report Caster, jQuery, HighCharts, Apache Tomcat, MS SQL Server
September 29, 2010, 01:24 PM
I'm getting 4.5 in v7.6.11 as well. Something else must be going on
In FOCUS since 1991 WF Server: 7.7.04 on Linux and Z/OS, ReportCaster, Self-Service, MRE, Java, Flex Data: DB2/UDB, Adabas, SQL Server Output: HTML,PDF,EXL2K/07, PS, AHTML, Flex WF Client: 77 on Linux w/Tomcat
September 30, 2010, 09:48 AM
I don't think D22 is valid either. I thought the max was D15.
In FOCUS since 1985. Prod WF 8.0.08 (z90/Suse Linux) DB (Oracle 11g), Self Serv, Report Caster, WebServer Intel/Linux.
October 01, 2010, 06:29 AM
The documentation all says 16 display characters for D format including the minus sign.
But I believe that this is nolonger correct.
20 display characters is valid and is generally generated against relational tables for numbers as D20.2.
However the numeric funtions such as FTOA still only accept a maximum of 15.