Execute When: Difference between revisions

From Starfish ETL
Jump to navigation Jump to search
No edit summary
No edit summary
Line 3: Line 3:
! WHEN
! WHEN
! DESCRIPTION
! DESCRIPTION
|- style="background-color:#ffffcc;"
|- style="background-color:#ffffcc; font-weight: bold;"
| colspan="3" | JOB PREPERATION, BEFORE,ROWS GET PROCESSED
| colspan="3" | Job Preperation, Before Rows Get Processed
|-
|-
| PRE
| PRE
Line 23: Line 23:
| Runs once per job when connections have been
| Runs once per job when connections have been
opened, and the origin query has been executed
opened, and the origin query has been executed
|-
|- style="background-color:#ffffcc; font-weight: bold;"
| colspan="3" | JOB RUNNING, ROWS BEING,PROCESSED
| colspan="3" | Job Running, Rows Being Proccessed
|-
|-
| PRE
| PRE
Line 34: Line 34:
| RepeatEachStage
| RepeatEachStage
| Runs once for each stage in,your job, before the stage is executed, use this in conjunction with custom,stage flow control but just to set up variables for that stage – use,CurrentStageName to evaluate which stage you’re on within your code
| Runs once for each stage in,your job, before the stage is executed, use this in conjunction with custom,stage flow control but just to set up variables for that stage – use,CurrentStageName to evaluate which stage you’re on within your code
|-
|- style="background-color:#ffffcc; font-weight: bold;"
| colspan="3" | ROW STAGE MAPPING GETS,EXECUTED HERE
| colspan="3" | Row Stage Mapping Gets Executed Here
|-
|-
| POST
| POST
Line 44: Line 44:
| RepeatEachRow
| RepeatEachRow
| Runs once for each row after,the mapping for all stages has been completed
| Runs once for each row after,the mapping for all stages has been completed
|-
|- style="background-color:#ffffcc; font-weight: bold;"
| colspan="3" | ROW PROCESSING COMPLETE,,JOB COMPLETING
| colspan="3" | Row Processing Complete, Job Completing
|-
|-
| POST
| POST

Revision as of 15:20, 27 October 2014

OP TYPE WHEN DESCRIPTION
Job Preperation, Before Rows Get Processed
PRE OnceBeforeConn Runs once per job when connections have not yet

been opened – use this to do things like download files, or modify your connection string in realtime

PRE OnceBeforeQuery Runs once per job when after db connections are

open but before the origin query has been executed – use this if you need to perform some kind of lookup on your database in order to build your origin query (or a portion of it) on the fly)

PRE OnceAfterConn Runs once per job when connections have been

opened, and the origin query has been executed

Job Running, Rows Being Proccessed
PRE RepeatEachRow Runs once for each row, before any stages get

executed

PRE RepeatEachStage Runs once for each stage in,your job, before the stage is executed, use this in conjunction with custom,stage flow control but just to set up variables for that stage – use,CurrentStageName to evaluate which stage you’re on within your code
Row Stage Mapping Gets Executed Here
POST RepeatEachStage Runs once for each stage after,the mapping for that stage has been processed, use this for custom stage flow,control logic,– use CurrentStageName to evaluate which stage you’re on,within your code
POST RepeatEachRow Runs once for each row after,the mapping for all stages has been completed
Row Processing Complete, Job Completing
POST OnceBeforeConn Runs once per job after all,stages are complete but before your origin/destination connections have been,closed – use this to execute any one-time cleanup code
POST OnceAfterConn Runs once per job after the,origin/destination connections have been closed – use this to set things like,lastrundate