Count records processed or sum function

Support for DataSlave

Moderators: Tom, ian

Count records processed or sum function

Postby ceejayemm » Mon Mar 14, 2011 12:07 pm

Is there any way I can count the number of records processed by a map eg read/written from/to a file, pass/fail validation or changed in a transform function ? You obviously do this internally within DataSlave as the processing log shows this information but I would like to be able to capture (or create) this infomration and be able to write out summary records to a audit file or database showing the number of records processed by a map and how many had been processed by the various function sin a map. Is this possible ?

Chris
ceejayemm
 
Posts: 22
Joined: Mon Apr 23, 2007 1:29 pm
Location: London, UK

Re: Count records processed or sum function

Postby ian » Thu Mar 17, 2011 11:43 am

You can change the settings to save a log file. This will have the numbe rof records processed and may also form the basis of an Audit log. You could also post process this log file to gather the information you require adding this processing as a second map run after the first.

If you plan to use the DataSlave Loader to execute a map this allows you to sepcify the object that you want to use to set the number of rows (/r). This number is then passed as the return code.
ian
 
Posts: 364
Joined: Sat Dec 18, 2004 8:13 am
Location: UK


Return to Support

Who is online

Users browsing this forum: No registered users and 1 guest

cron