Focal Point Banner
Community Center Education Summit Technical Support User Groups
Let's Get Social!

Facebook Twitter LinkedIn YouTube
Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    Is there a trick to writing to FOCUS files with Data Migrator?
Go
New
Search
Notify
Tools
Reply
  
Is there a trick to writing to FOCUS files with Data Migrator?
 Login/Join
 
Master
posted
I have a FOCUS file that appears impenetrable to Data Migrator. When I Run or Test Run to it I simply get a report indicating that no records are processed. No errors, no records in the log summary, just an 18708 at the end and otherwise it appears that I sent no records to the file. When I run the exact same transform to other non-focus tables all proceeds normally. All the sample datas work correctly. I can run the "Test Transforms" and see that data reaches the target. It just seems to bounce off.

Anyone care to pony up the secret to the process? Here is my master file, which is quite mundane:

FILENAME=COMB_TESTS, SUFFIX=FOC, $
SEGMENT=SEG01, SEGTYPE=S1, $
FIELDNAME=EVENT_ID, ALIAS=E01, USAGE=A10V, FIELDTYPE=I,
MISSING=OFF, $
FIELDNAME=ORAQUICK_TEST_TYPE, ALIAS=E02, USAGE=A10V,
MISSING=ON,
TITLE='ORAQUICK_TEST_TYPE', $
FIELDNAME=ORAQUICK_QUAL_RESUL, ALIAS=E03, USAGE=A1V,
MISSING=ON,
TITLE='ORAQUICK_QUAL_RESUL', $
FIELDNAME=ELISA_TEST_TYPE, ALIAS=E04, USAGE=A10V,
MISSING=ON,
TITLE='ELISA_TEST_TYPE', $
FIELDNAME=ELISA_QUAL_RESUL, ALIAS=E05, USAGE=A1V,
MISSING=ON,
TITLE='ELISA_QUAL_RESUL', $
FIELDNAME=WB_TEST_TYPE, ALIAS=E06, USAGE=A10V,
MISSING=ON,
TITLE='WB_TEST_TYPE', $
FIELDNAME=WB_QUAL_RESUL, ALIAS=E07, USAGE=A1V,
MISSING=ON,
TITLE='WB_QUAL_RESUL', $
FIELDNAME=HIV_TEST_TYPE, ALIAS=E08, USAGE=A10V,
MISSING=ON,
TITLE='HIV_TEST_TYPE', $
FIELDNAME=HIV_QUAL_RESUL, ALIAS=E09, USAGE=A1V,
MISSING=ON,
TITLE='HIV_QUAL_RESUL', $



 
Posts: 924 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Master
posted Hide Post
The result of a Test Run --

10/29/2008 11:01:34 AIDSDB (ICM18164) Request balt_city_data/std_mis_test_consolidator_2 was created/updated successfully for User: WFProxy.
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18122) Request - std_mis_test_consolidator_2 (Owner: WFProxy) submitted.
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18742) comb_tests type Focus/FDS Existing target
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18429) Issuing PREPARE
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18743) Starting Load
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 0 WARNING.. ON MATCH INCLUDE INPUTS DUPLICATE SEGMENTS
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18682) Check set to : 1000
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18041) -- stats for source file
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18516) 0 : Row(s) processed by job
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18519) 0 : Row(s) rejected due to format error
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18372) -- stats for target file: comb_tests
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18516) 0 : Row(s) processed by job
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18514) 0 : Row(s) accepted by target table
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18515) 0 : Row(s) inserted into target table
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18517) 0 : Row(s) updated in target table
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18518) 0 : Row(s) deleted from target table
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18520) 0 : Row(s) rejected due to validation errors
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18521) 0 : Row(s) rejected due to no match
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18522) 0 : Row(s) rejected because duplicate exist
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18808) 0 : Row(s) rejected due to DBMS error
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 BYPASSING TO END OF COMMAND
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18744) Ending Load
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18040) Return Code = 18708
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18076) Request: std_mis_test_consolidator_2 - finished processing
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18007) CPU Time : 62



 
Posts: 924 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Master
posted Hide Post
I have pushed the issue this far, by creating a defined field on the source, marking it as MISSING OFF and using that as the source for the Target table's key field. I now see the 1350 records selected and placed into SQLIN. Then I get no data processed. I have all the record logs turned on for the target table, and all receive no entries when I Run or Test Run.


10/29/2008 11:26:52 AIDSDB Successfully connected as user "WFProxy"
10/29/2008 11:27:04 AIDSDB (ICM18164) Request balt_city_data/std_mis_test_consolidator_2 was created/updated successfully for User: WFProxy.
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18122) Request - std_mis_test_consolidator_2 (Owner: WFProxy) submitted.
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18742) comb_tests type Focus/FDS Existing target
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18429) Issuing PREPARE
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18440) Request will process data via NON-Pass Through (NON-APT)
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18451) HOLD file will be created for output file named: SQLIN.
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 1
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 0 NUMBER OF RECORDS IN TABLE= 1350 LINES= 1350
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 0
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18743) Starting Load
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18682) Check set to : 1000
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18041) -- stats for source file
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18516) 0 : Row(s) processed by job
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18519) 0 : Row(s) rejected due to format error
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18372) -- stats for target file: comb_tests
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18516) 0 : Row(s) processed by job
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18514) 0 : Row(s) accepted by target table
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18515) 0 : Row(s) inserted into target table
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18517) 0 : Row(s) updated in target table
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18518) 0 : Row(s) deleted from target table
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18520) 0 : Row(s) rejected due to validation errors
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18521) 0 : Row(s) rejected due to no match
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18522) 0 : Row(s) rejected because duplicate exist
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18808) 0 : Row(s) rejected due to DBMS error
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 BYPASSING TO END OF COMMAND
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18744) Ending Load
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18040) Return Code = 0
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18076) Request: std_mis_test_consolidator_2 - finished processing
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18007) CPU Time : 250



 
Posts: 924 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Master
posted Hide Post
Arrrrrggggggggggggggggggggghhhhhhhhhhhhhhhhhhhh Icanttakethisanymoreitsjustsuchastupidlittlepieceofgarbagethatwontgetthehellouttamyway!!!!! This is ridiculous! Enough!

WebFOCUS. Ten minutes. Done. Same Reporting Server. Same core language. What's that about?



 
Posts: 924 | Location: At the Mast | Registered: May 17, 2007Reply With QuoteReport This Post
Guru
posted Hide Post
I would suggest adding a dataset paramater to the master file to tell DM where to write the file.
 
Posts: 383 | Location: New York City | Registered: May 03, 2007Reply With QuoteReport This Post
<etl dude>
posted
Hey John,

Do not dispair. IWAY can definitely be frustrating some times because of its weird rules and undocumented features.

I have worked with focus data sets in the recent past. Here are some things to try.

1 - Did you create the master meta data (mas) from hand or the tool? By hand might introduce errors.

2 - Goto to meta data for the focus file and right click.

Under data management, there is the option to recreate the DBMS table. Run this. Then execute the option insert sample data.

Then select sample data from the right click top menu. If sample data is not coming up, there is something wrong with the .mas file.

3 - Rerun your data flow and see if it works.

Best of luck

John
 
Reply With QuoteReport This Post
Virtuoso
posted Hide Post
One line
quote:
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 BYPASSING TO END OF COMMAND

caught my eye. That's a standard follow-on message, when Focus hits an error parsing a multi-line request (such as Define, Table, or Modify), and flushes the remainder down to the END statement.

DM is logging just the last error msg. That's smoke -- you need to find the fire -- get your hands on a full execution transcript of the request that DM submitted to WF for execution by an agent.

But chances are its the failure to specify where the Focus file resides (via either a USE in the fex, or a dataset clause in the mas)


- Jack Gross
WF through 8.1.05
 
Posts: 1925 | Location: NYC | In FOCUS since 1983 | Registered: January 11, 2005Reply With QuoteReport This Post
Virtuoso
posted Hide Post
John

Is this solved?

What took my attention is the fact that your focus filename is longer than 8 characters. I have had many times problems with longer names.
The second thing is that your keyfield is an A10V field, change that to A10. (or maybe shorter, long indexed keyfields will influence the performance.
The 3th thing is "ON MATCH INCLUDE" a bit strange, if it is a keyfield (S1) I would say either "ON MATCH UPDATE" or "ON MATCH REJECT"




Frank

prod: WF 7.6.10 platform Windows,
databases: msSQL2000, msSQL2005, RMS, Oracle, Sybase,IE7
test: WF 7.6.10 on the same platform and databases,IE7

 
Posts: 2387 | Location: Amsterdam, the Netherlands | Registered: December 03, 2006Reply With QuoteReport This Post
  Powered by Social Strata  
 

Focal Point    Focal Point Forums  Hop To Forum Categories  iWay Software Product Forum on Focal Point    Is there a trick to writing to FOCUS files with Data Migrator?

Copyright © 1996-2018 Information Builders, leaders in enterprise business intelligence.