Data that is sent to Devo directly from external systems is automatically parsed into fields using customized parsers. This means that the data arrives to the repository already structured correctly and ready to query.
However, data that is uploaded to Devo using the Data upload tool is not automatically parsed into fields. This means that the first time that you open the data table, you will have to use available tools to structure the data correctly.
Our sample data table my.upload.test.markets appears like this the first time we access the table:
Notice that the message column actually contains six fields separated by commas. We need to split the data in the message column into six new columns. Here's how we do it:
- First, click the message column’s header to highlight the column contents.
- Then click Create Column on the toolbar.
- In the Create Column dialog box, select Split from the Operation dropdown list. Split will appear below with the message column as the argument.
- The split operation requires three arguments; a column name, a separator, and a return peice. Then click New Argument twice. Click the edit buttons and enter a comma in the by separator field and a 0 in the and return piece field. The return piece indicates the data unit's position in the list (starting from the left with zero). This will create a new column for the first item in the list, in this case the ZIP code. So enter PostalCode in the Column Name field, the click the Create Column button.
- A new column called PostalCode appears in the table.
- Repeat the split operation for each field to finish parsing the message column. The rest of the fields should be parsed like this: City = piece 1, State = piece 2, Latitude = piece 3, Longitude = piece 4, and County = piece 5.