Focal Point Banner


As of December 1, 2020, Focal Point is retired and repurposed as a reference repository. We value the wealth of knowledge that's been shared here over the years. You'll continue to have access to this treasure trove of knowledge, for search purposes only.

Join the TIBCO Community
TIBCO Community is a collaborative space for users to share knowledge and support one another in making the best use of TIBCO products and services. There are several TIBCO WebFOCUS resources in the community.

  • From the Home page, select Predict: WebFOCUS to view articles, questions, and trending articles.
  • Select Products from the top navigation bar, scroll, and then select the TIBCO WebFOCUS product page to view product overview, articles, and discussions.
  • Request access to the private WebFOCUS User Group (login required) to network with fellow members.

Former myibi community members should have received an email on 8/3/22 to activate their user accounts to join the community. Check your Spam folder for the email. Please get in touch with us at community@tibco.com for further assistance. Reference the community FAQ to learn more about the community.


Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [SOLVED] Precision in variables

Read-Only Read-Only Topic
Go
Search
Notify
Tools
[SOLVED] Precision in variables
 Login/Join
 
Shingles
Platinum Member
posted
Hello,

Seems I'm having trouble with the precision of a variable. I learned about DMPPRECION but I'm not getting the desired results. Here is some code:

...
SET DMPRECISION = 5
RUN
GRAPH FILE OFFICER_METRIC
...
-SET &BAR_MAX_1 = IF &A GT &B THEN &A ELSE &B;  //Just using A, B and C to keep it simple here
-SET &BAR_MAX_2 = IF &C GT &BAR_MAX_1 THEN &C ELSE &BAR_MAX_1;
-SET &BAR_MAX_FINAL = &BAR_MAX_2 * 1.1;

-TYPE BAR_MAX_1 is &BAR_MAX_1           //Spits out 0.29
-TYPE BAR_MAX_2 is &BAR_MAX_2           //Spits out 0.29
-TYPE BAR_MAX_FINAL is &BAR_MAX_FINAL   //Spits out 0
...


BAR_MAX_FINAL should be 0.319 right?, but it seems its ignoring decimals or taking the floor (I don't know). I tried to multiply by 11 and divide by 10 but the results are the same as above. I tried several other things with no success.

Any tips here?

Thank you,

This message has been edited. Last edited by: FP Mod Chuck,


WebFOCUS 8201, SP 0.1, Windows 7, HTML
 
Posts: 190 | Registered: May 19, 2017Report This Post
BabakNYC
Virtuoso
posted Hide Post
I've no idea what this code is doing. Could you give us an example we can run using sample data?


WebFOCUS 8206, Unix, Windows
 
Posts: 1853 | Location: New York City | Registered: December 30, 2015Report This Post
Shingles
Platinum Member
posted Hide Post
Nevermind... I didn't put the "-" in front of the RUN. Damnit!


WebFOCUS 8201, SP 0.1, Windows 7, HTML
 
Posts: 190 | Registered: May 19, 2017Report This Post
  Powered by Social Strata  

Read-Only Read-Only Topic

Focal Point    Focal Point Forums  Hop To Forum Categories  WebFOCUS/FOCUS Forum on Focal Point     [SOLVED] Precision in variables

Copyright © 1996-2020 Information Builders