Aggregating data from more than one file

Some tips for the use of DataSlave

Moderators: Tom, ian

Aggregating data from more than one file

Postby ian » Thu Jun 02, 2005 11:07 am

If you have data held in more than one file and you want to combine these into a single database, DataSlave has the answer.

The data will need to have an ID field to tie the records together, but you can then build a map to add the appropriate data from many source files.

The key is that when writing to a database if the record already exists DataSlave will choose an update rather than an insert. All you need to do is to tell DataSlave which column is the unique key and then build a map to add the data from each of the source files.

If you want to see an example please email to info@baycastle.co.uk and we will send you a demo map and data.
ian
 
Posts: 364
Joined: Sat Dec 18, 2004 8:13 am
Location: UK

Version 1.1 offers batch processing

Postby ian » Thu Sep 29, 2005 9:44 am

New in version 1.1

DataSlave can handle all files of the same format found in a folder in one single pass. Thousands of files can be processed in one go.

DataSlave also supports files of a format where one record is held in each file with one field per row.
ian
 
Posts: 364
Joined: Sat Dec 18, 2004 8:13 am
Location: UK


Return to Tips

Who is online

Users browsing this forum: No registered users and 1 guest

cron