I have a FOCUS file that appears impenetrable to Data Migrator. When I Run or Test Run to it I simply get a report indicating that no records are processed. No errors, no records in the log summary, just an 18708 at the end and otherwise it appears that I sent no records to the file. When I run the exact same transform to other non-focus tables all proceeds normally. All the sample datas work correctly. I can run the "Test Transforms" and see that data reaches the target. It just seems to bounce off.

Anyone care to pony up the secret to the process? Here is my master file, which is quite mundane:

FILENAME=COMB_TESTS, SUFFIX=FOC, $
SEGMENT=SEG01, SEGTYPE=S1, $
FIELDNAME=EVENT_ID, ALIAS=E01, USAGE=A10V, FIELDTYPE=I,
MISSING=OFF, $
FIELDNAME=ORAQUICK_TEST_TYPE, ALIAS=E02, USAGE=A10V,
MISSING=ON,
TITLE='ORAQUICK_TEST_TYPE', $
FIELDNAME=ORAQUICK_QUAL_RESUL, ALIAS=E03, USAGE=A1V,
MISSING=ON,
TITLE='ORAQUICK_QUAL_RESUL', $
FIELDNAME=ELISA_TEST_TYPE, ALIAS=E04, USAGE=A10V,
MISSING=ON,
TITLE='ELISA_TEST_TYPE', $
FIELDNAME=ELISA_QUAL_RESUL, ALIAS=E05, USAGE=A1V,
MISSING=ON,
TITLE='ELISA_QUAL_RESUL', $
FIELDNAME=WB_TEST_TYPE, ALIAS=E06, USAGE=A10V,
MISSING=ON,
TITLE='WB_TEST_TYPE', $
FIELDNAME=WB_QUAL_RESUL, ALIAS=E07, USAGE=A1V,
MISSING=ON,
TITLE='WB_QUAL_RESUL', $
FIELDNAME=HIV_TEST_TYPE, ALIAS=E08, USAGE=A10V,
MISSING=ON,
TITLE='HIV_TEST_TYPE', $
FIELDNAME=HIV_QUAL_RESUL, ALIAS=E09, USAGE=A1V,
MISSING=ON,
TITLE='HIV_QUAL_RESUL', $

The result of a Test Run --

10/29/2008 11:01:34 AIDSDB (ICM18164) Request balt_city_data/std_mis_test_consolidator_2 was created/updated successfully for User: WFProxy.
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18122) Request - std_mis_test_consolidator_2 (Owner: WFProxy) submitted.
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18742) comb_tests type Focus/FDS Existing target
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18429) Issuing PREPARE
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18743) Starting Load
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 0 WARNING.. ON MATCH INCLUDE INPUTS DUPLICATE SEGMENTS
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18682) Check set to : 1000
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18041) -- stats for source file
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18516) 0 : Row(s) processed by job
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18519) 0 : Row(s) rejected due to format error
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18372) -- stats for target file: comb_tests
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18516) 0 : Row(s) processed by job
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18514) 0 : Row(s) accepted by target table
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18515) 0 : Row(s) inserted into target table
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18517) 0 : Row(s) updated in target table
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18518) 0 : Row(s) deleted from target table
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18520) 0 : Row(s) rejected due to validation errors
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18521) 0 : Row(s) rejected due to no match
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18522) 0 : Row(s) rejected because duplicate exist
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18808) 0 : Row(s) rejected due to DBMS error
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 BYPASSING TO END OF COMMAND
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18744) Ending Load
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18040) Return Code = 18708
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18076) Request: std_mis_test_consolidator_2 - finished processing
10/29/2008 11:01:34 AIDSDB 10/29/2008 11:01:33 (ICM18007) CPU Time : 62

I have pushed the issue this far, by creating a defined field on the source, marking it as MISSING OFF and using that as the source for the Target table's key field. I now see the 1350 records selected and placed into SQLIN. Then I get no data processed. I have all the record logs turned on for the target table, and all receive no entries when I Run or Test Run.


10/29/2008 11:26:52 AIDSDB Successfully connected as user "WFProxy"
10/29/2008 11:27:04 AIDSDB (ICM18164) Request balt_city_data/std_mis_test_consolidator_2 was created/updated successfully for User: WFProxy.
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18122) Request - std_mis_test_consolidator_2 (Owner: WFProxy) submitted.
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18742) comb_tests type Focus/FDS Existing target
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18429) Issuing PREPARE
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18440) Request will process data via NON-Pass Through (NON-APT)
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18451) HOLD file will be created for output file named: SQLIN.
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 1
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 0 NUMBER OF RECORDS IN TABLE= 1350 LINES= 1350
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 0
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18743) Starting Load
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18682) Check set to : 1000
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18041) -- stats for source file
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18516) 0 : Row(s) processed by job
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18519) 0 : Row(s) rejected due to format error
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18372) -- stats for target file: comb_tests
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18516) 0 : Row(s) processed by job
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18514) 0 : Row(s) accepted by target table
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18515) 0 : Row(s) inserted into target table
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18517) 0 : Row(s) updated in target table
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18518) 0 : Row(s) deleted from target table
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18520) 0 : Row(s) rejected due to validation errors
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18521) 0 : Row(s) rejected due to no match
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18522) 0 : Row(s) rejected because duplicate exist
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18808) 0 : Row(s) rejected due to DBMS error
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 BYPASSING TO END OF COMMAND
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18744) Ending Load
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18040) Return Code = 0
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18076) Request: std_mis_test_consolidator_2 - finished processing
10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 (ICM18007) CPU Time : 250

Arrrrrggggggggggggggggggggghhhhhhhhhhhhhhhhhhhh Icanttakethisanymoreitsjustsuchastupidlittlepieceofgarbagethatwontgetthehellouttamyway!!!!! This is ridiculous! Enough!

WebFOCUS. Ten minutes. Done. Same Reporting Server. Same core language. What's that about?

I would suggest adding a dataset paramater to the master file to tell DM where to write the file.

Hey John,

Do not dispair. IWAY can definitely be frustrating some times because of its weird rules and undocumented features.

I have worked with focus data sets in the recent past. Here are some things to try.

1 - Did you create the master meta data (mas) from hand or the tool? By hand might introduce errors.

2 - Goto to meta data for the focus file and right click.

Under data management, there is the option to recreate the DBMS table. Run this. Then execute the option insert sample data.

Then select sample data from the right click top menu. If sample data is not coming up, there is something wrong with the .mas file.

3 - Rerun your data flow and see if it works.

Best of luck

John

One line

quote:

10/29/2008 11:27:05 AIDSDB 10/29/2008 11:27:04 BYPASSING TO END OF COMMAND

caught my eye. That's a standard follow-on message, when Focus hits an error parsing a multi-line request (such as Define, Table, or Modify), and flushes the remainder down to the END statement.

DM is logging just the last error msg. That's smoke -- you need to find the fire -- get your hands on a full execution transcript of the request that DM submitted to WF for execution by an agent.

But chances are its the failure to specify where the Focus file resides (via either a USE in the fex, or a dataset clause in the mas)

John

Is this solved?

What took my attention is the fact that your focus filename is longer than 8 characters. I have had many times problems with longer names.
The second thing is that your keyfield is an A10V field, change that to A10. (or maybe shorter, long indexed keyfields will influence the performance.
The 3th thing is "ON MATCH INCLUDE" a bit strange, if it is a keyfield (S1) I would say either "ON MATCH UPDATE" or "ON MATCH REJECT"