Focal Point Banner


As of December 1, 2020, Focal Point is retired and repurposed as a reference repository. We value the wealth of knowledge that's been shared here over the years. You'll continue to have access to this treasure trove of knowledge, for search purposes only.

Join the TIBCO Community
TIBCO Community is a collaborative space for users to share knowledge and support one another in making the best use of TIBCO products and services. There are several TIBCO WebFOCUS resources in the community.

  • From the Home page, select Predict: WebFOCUS to view articles, questions, and trending articles.
  • Select Products from the top navigation bar, scroll, and then select the TIBCO WebFOCUS product page to view product overview, articles, and discussions.
  • Request access to the private WebFOCUS User Group (login required) to network with fellow members.

Former myibi community members should have received an email on 8/3/22 to activate their user accounts to join the community. Check your Spam folder for the email. Please get in touch with us at community@tibco.com for further assistance. Reference the community FAQ to learn more about the community.


Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [CLOSED]Compute or Define in masters

Read-Only Read-Only Topic
Go
Search
Notify
Tools
[CLOSED]Compute or Define in masters
 Login/Join
 
FrankDutch
Virtuoso
posted
I wonder what the difference is, but I also had a problem today.
I changed a master by adding 4 new fields in one segment and to keep several reports working I made a computed field that summed these four fields together.
The result ? bad...I got stars in most of my reports, so it seemed to be that the description was to small to hold the values.

FIELDNAME=VALUE1, ACTUAL=D20.2,..,$
FIELDNAME=VALUE2, ACTUAL=D20.2,..,$
FIELDNAME=VALUE3, ACTUAL=D20.2,..,$
DEFINE VALUE4/D20.2=VALUE1+VALUE2+VALUE3;


Is there a limitation in the size?

This message has been edited. Last edited by: <Emily McAllister>,




Frank
prod: WF 7.6.10 platform Windows,
databases: msSQL2000, msSQL2005, RMS, Oracle, Sybase,IE7
test: WF 7.6.10 on the same platform and databases,IE7

 
Posts: 2387 | Location: Amsterdam, the Netherlands | Registered: December 03, 2006Report This Post
jnc
Gold member
posted Hide Post
Isn't the limit for D format 15. If you need larger, then P is good for 31.


WebFocus 7x, 8x, Win / Linux, any output format
 
Posts: 70 | Location: reading, pa | Registered: April 07, 2007Report This Post
Tony A
Expert
posted Hide Post
Actually, the limit for D is 16 chars including decimal point and leading minus sign as applicable. D20.2 is often used though (just like I10 used to function when the max was I9 - I think) - it is now documented as max I11.

The limit for P is 33 characters, again including the decimal point and leading sign.

On the other hand, F limit is 9 with the same provisions as for other non-integer numbers

So, in theory you can declare (as of Version 5.3) -

D16 - using D16.14 to include signage
      through to D16 without decimal places
P33 - using P33.31 to include signage
      through to P33 (if you do not have any decimals)
F9  - using F9.7 to include signage
      etc. etc.
I11 - using I10 to include signage

Of course, many folks will require the Double precision format due to the way the original value is retained irrespective of the usage format. Especially in accounts processing.

T


In FOCUS
since 1986		WebFOCUS Server 8.2.01M, thru 8.2.07 on Windows Svr 2008 R2  
WebFOCUS App Studio 8.2.06 standalone on Windows 10 
 
Posts: 5694 | Location: United Kingdom | Registered: April 08, 2004Report This Post
GamP
Virtuoso
posted Hide Post
And then there is of course also the scientific notation, which has a somewhat more extended display range: Maximally 33 positions.
For instance: COMPUTE FLD/E33.25=DCOST;
This will result in figures like: 0.4292000000000000000000000E+04

Hope this helps.


GamP
- Using AS 8.2.01 on Windows 10 - IE11.
in Focus since 1988
 
Posts: 1961 | Location: Netherlands | Registered: September 25, 2007Report This Post
PBrightwell
Master
posted Hide Post
What type of database? With Oracle D20.2 is the default for a numeric field and I am sure it will work in 5.3 and higher. When you added the 3 new fields did you rebuild the file? Is it possible that you are hitting nulls or alpha data? Does your MFD match the metadata?


Pat
WF 7.6.8, AIX, AS400, NT
AS400 FOCUS, AIX FOCUS,
Oracle, DB2, JDE, Lotus Notes
 
Posts: 755 | Location: TX | Registered: September 25, 2007Report This Post
FrankDutch
Virtuoso
posted Hide Post
thx for thinking...

Pat, I did a rebuild the file, that was not the issue. I resized the 4 fields to D12.2, and that helped.




Frank
prod: WF 7.6.10 platform Windows,
databases: msSQL2000, msSQL2005, RMS, Oracle, Sybase,IE7
test: WF 7.6.10 on the same platform and databases,IE7

 
Posts: 2387 | Location: Amsterdam, the Netherlands | Registered: December 03, 2006Report This Post
Brian Suter
Platinum Member
posted Hide Post
D or F format inside the computer looks something like scientific notation. You can display F20 if you like but you can only have 7 significant digits (because they use 24 bits for the digits, 7 bits for the power of 16, and one bit for the sign). A D format has 56 bits available for significant digits which means you can go up to 72,057,594,037,927,936 before you start loosing single units of precision.


Brian Suter
VP WebFOCUS Product Development
 
Posts: 200 | Location: NYC | Registered: January 02, 2007Report This Post
Doug
Expert
posted Hide Post
Hi Tony,

What's the max size for D##.# now, / 8.1.0.7?

Decimal: The GUI shows D(1-20).(0-18).

Packed : The GUI shows P(1-33).(0-31).

So, is D30.2 or D22.2 valid?

Thanks, Doug
 
Posts: 3132 | Location: Tennessee, Nashville area | Registered: February 23, 2005Report This Post
  Powered by Social Strata  

Read-Only Read-Only Topic

Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [CLOSED]Compute or Define in masters

Copyright © 1996-2020 Information Builders