Execute When: Difference between revisions

From Starfish ETL
Jump to navigation Jump to search
No edit summary
No edit summary
Line 8: Line 8:
| PRE
| PRE
| OnceBeforeConn
| OnceBeforeConn
| Runs once per job when connections have not yet
| Runs once per job when connections have not yet been opened – Use this to do things like download files, or modify your connection string in realtime.
been opened – use this to do things like download files, or modify your
connection string in realtime
|-
|-
| PRE
| PRE
| OnceBeforeQuery
| OnceBeforeQuery
| Runs once per job when after db connections are
| Runs once per job when after db connections are open but before the origin query has been executed – Use this if you need to perform some kind of lookup on your database in order to build your origin query (or a portion of it) on the fly.
open but before the origin query has been executed – use this if you need to
perform some kind of lookup on your database in order to build your origin
query (or a portion of it) on the fly)
|-
|-
| PRE
| PRE
| OnceAfterConn
| OnceAfterConn
| Runs once per job when connections have been
| Runs once per job when connections have been opened, and the origin query has been executed.
opened, and the origin query has been executed
|- style="background-color:#ffffcc; font-weight: bold;"
|- style="background-color:#ffffcc; font-weight: bold;"
| colspan="3" | Job Running, Rows Being Proccessed
| colspan="3" | Job Running, Rows Being Proccessed
Line 28: Line 22:
| PRE
| PRE
| RepeatEachRow
| RepeatEachRow
| Runs once for each row, before any stages get
| Runs once for each row, before any stages get executed.
executed
|-
|-
| PRE
| PRE
| RepeatEachStage
| RepeatEachStage
| Runs once for each stage in,your job, before the stage is executed, use this in conjunction with custom,stage flow control but just to set up variables for that stage – use,CurrentStageName to evaluate which stage you’re on within your code
| Runs once for each stage in,your job, before the stage is executed - Use this in conjunction with custom stage flow control but just to set up variables for that stage – use CurrentStageName to evaluate which stage you're on within your code.
|- style="background-color:#ffffcc; font-weight: bold;"
|- style="background-color:#ffffcc; font-weight: bold;"
| colspan="3" | Row Stage Mapping Gets Executed Here
| colspan="3" | Row Stage Mapping Gets Executed Here
Line 39: Line 32:
| POST
| POST
| RepeatEachStage
| RepeatEachStage
| Runs once for each stage after,the mapping for that stage has been processed, use this for custom stage flow,control logic,– use CurrentStageName to evaluate which stage you’re on,within your code
| Runs once for each stage after the mapping for that stage has been processed, use this for custom stage flow control logic – use CurrentStageName to evaluate which stage you're on within your code.
|-
|-
| POST
| POST
| RepeatEachRow
| RepeatEachRow
| Runs once for each row after,the mapping for all stages has been completed
| Runs once for each row after the mapping for all stages has been completed.
|- style="background-color:#ffffcc; font-weight: bold;"
|- style="background-color:#ffffcc; font-weight: bold;"
| colspan="3" | Row Processing Complete, Job Completing
| colspan="3" | Row Processing Complete, Job Completing
Line 49: Line 42:
| POST
| POST
| OnceBeforeConn
| OnceBeforeConn
| Runs once per job after all,stages are complete but before your origin/destination connections have been,closed – use this to execute any one-time cleanup code
| Runs once per job after all stages are complete but before your origin/destination connections have been closed – use this to execute any one-time cleanup code.
|-
|-
| POST
| POST
| OnceAfterConn
| OnceAfterConn
| Runs once per job after the,origin/destination connections have been closed – use this to set things like,lastrundate
| Runs once per job after the origin/destination connections have been closed – use this to set things like lastrundate.
|}
|}

Revision as of 15:24, 27 October 2014

OP TYPE WHEN DESCRIPTION
Job Preperation, Before Rows Get Processed
PRE OnceBeforeConn Runs once per job when connections have not yet been opened – Use this to do things like download files, or modify your connection string in realtime.
PRE OnceBeforeQuery Runs once per job when after db connections are open but before the origin query has been executed – Use this if you need to perform some kind of lookup on your database in order to build your origin query (or a portion of it) on the fly.
PRE OnceAfterConn Runs once per job when connections have been opened, and the origin query has been executed.
Job Running, Rows Being Proccessed
PRE RepeatEachRow Runs once for each row, before any stages get executed.
PRE RepeatEachStage Runs once for each stage in,your job, before the stage is executed - Use this in conjunction with custom stage flow control but just to set up variables for that stage – use CurrentStageName to evaluate which stage you're on within your code.
Row Stage Mapping Gets Executed Here
POST RepeatEachStage Runs once for each stage after the mapping for that stage has been processed, use this for custom stage flow control logic – use CurrentStageName to evaluate which stage you're on within your code.
POST RepeatEachRow Runs once for each row after the mapping for all stages has been completed.
Row Processing Complete, Job Completing
POST OnceBeforeConn Runs once per job after all stages are complete but before your origin/destination connections have been closed – use this to execute any one-time cleanup code.
POST OnceAfterConn Runs once per job after the origin/destination connections have been closed – use this to set things like lastrundate.