Execute When

From Starfish ETL
Revision as of 15:24, 27 October 2014 by Admin (talk | contribs)
Jump to navigation Jump to search
OP TYPE WHEN DESCRIPTION
Job Preperation, Before Rows Get Processed
PRE OnceBeforeConn Runs once per job when connections have not yet been opened – Use this to do things like download files, or modify your connection string in realtime.
PRE OnceBeforeQuery Runs once per job when after db connections are open but before the origin query has been executed – Use this if you need to perform some kind of lookup on your database in order to build your origin query (or a portion of it) on the fly.
PRE OnceAfterConn Runs once per job when connections have been opened, and the origin query has been executed.
Job Running, Rows Being Proccessed
PRE RepeatEachRow Runs once for each row, before any stages get executed.
PRE RepeatEachStage Runs once for each stage in,your job, before the stage is executed - Use this in conjunction with custom stage flow control but just to set up variables for that stage – use CurrentStageName to evaluate which stage you're on within your code.
Row Stage Mapping Gets Executed Here
POST RepeatEachStage Runs once for each stage after the mapping for that stage has been processed, use this for custom stage flow control logic – use CurrentStageName to evaluate which stage you're on within your code.
POST RepeatEachRow Runs once for each row after the mapping for all stages has been completed.
Row Processing Complete, Job Completing
POST OnceBeforeConn Runs once per job after all stages are complete but before your origin/destination connections have been closed – use this to execute any one-time cleanup code.
POST OnceAfterConn Runs once per job after the origin/destination connections have been closed – use this to set things like lastrundate.