I work at an educational institution and want to create a data set to test some Machine Learning concepts I've learned. This means taking transactional data (each time a student takes a course it is a separate row)and flattening it into a single row for statistical analysis.

This means taking a field like "course" with 800 values and then creating 800 Define fields out of each value. "Indicator" is a statistical term meaning a field with a 0 or 1 in it.

Is there a fast way to do this with the data migrator, or another iWay product?

My first thought is to take excel output of field values, and then use the excel Concatenate command to create the text to make a define.

I would then go into the DMC to edit the process in the text editor, and then do a big copy and paste. I would adjust the number of rows read for the Defines.

This begs the next question: is there a limit in the DMC to the number of fields a table can have? I will need to make a table with several thousand fields in order to do the analysis.

This message has been edited. Last edited by: FP Mod Chuck,

Max

Rstat is a WebFOCUS add on for doing statistical analysis of transactional data. You might want to look into that option.

quote:

Originally posted by FP Mod Chuck:
Max

Rstat is a WebFOCUS add on for doing statistical analysis of transactional data. You might want to look into that option.

I have emailed my sales rep about a quote for Rstat. I've looked online and found marketing material, but nothing that implies implicit crosstabular analysis.

In the mean time, I was curious about my options with the data migrator:

Is there a limit to the number of defines I can add to a table to a table?

Max

I am not aware of any limitations with that.