Engine Web.Config Settings

From Starfish ETL
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

This file is generally located at: ..\inetpub\wwwroot\StarfishEngine\

Setting Default Description
LogPath C:\Inetpub\WWWRoot\StarfishEngine\ Path to save log files in when LogToFile is enabled.
LogToFile False Boolean, Default False. If enabled, a log file (at the “High” level) with be created within the specified LogPath location.
CommandTimeout 3000 Length in seconds for SQL commands to execute
ProxyEnabled False Boolean, Default False. If enabled, Starfish ETL™ will use the specified Proxy server when validating it’s license.
ProxyURL URL for proxy server
ProxyPort 80 Port proxy server is running on
ProxyUseDefaultCredentials False Boolean, Default False. If enabled, default network credentials will be used.
ProxyUseSuppliedCredentials False Boolean, Default False. If enabled, the credentials specified below will be used.
ProxyCredentialsUsername Proxy username
ProxyCredentialsPassword Proxy password
ProxyCredentialsDomain Proxy user’s domain
RowThreadCount 1 The default number of threads to use when executing a Starfish ETL™ job.
UseParamQueries False Boolean, Default False. If enabled (default), Starfish ETL™ will build parameterized SQL queries. If disabled, queries will instead be sent as normal text. Useful for performance tweaking.
UseNoLock False Boolean, Default False. If enabled, Starfish will append the SQL “WITH(NOLOCK)” command to generated lookup statements. Useful for performance tweaking.
UseDatabaseXref False Setting this value to true will use a SQLite database to store XREF files instead of text documents. This has the added benefit of automatically updating value pairs instead of appending duplicates.
CountStatement COUNT(*) Default “COUNT(*)”. When doing lookups, Starfish ETL™ will perform a statement such as “SELECT COUNT(*) FROM TABLE WHERE …” to determine if a record exists or not. Changing this value to something like “COUNT(1)” may help performance for some database systems.
HaultOnError False If any kind of error occurs, the entire job will be stopped.
LogErrorRowsToCSV True Creates the Exception CSV files when any errors occur, logging the entire row's data, the row # and error description.
DefaultLastRunDate 2000-01-01 When using the LastRunDate system variable, this is the initial date that will be used when the SetLastRunDate function has never been called for the particular job.
DateFormat yyyy-MM-dd HH:mm:ss The date formatting used for the LastRunDate variable.
SaveLogDatabase False If True, the entire high logging level output will be saved to the engine.db SQLite database in the "log" table.
SQLColumnPreceding If your database driver needs special column name handling, you may supply the value to surround the field names with. Typically [] or "".
SQLColumnTrailing See above.
PrefetchRowCount True Specifies whether Starfish should figure out how many rows it needs to process before starting a job. If set to false, the progress indicator will not be know. However, for some systems it may take a long time to determine this record count so you may choose to disable it.
RetryRowOnErrorAttempts 0 Options: 0 or greater. Retry Rows when an error is encountered. (January 18, 2023 - I have used up to 10 but more should work.)
RetryRowOnErrorAttemptWaitMS 5000 Options: 1 or greater. The number of milliseconds to wait between retry attempts.
RetryRowReconnectAfter 0 Options: 0 or greater. Attempt reconnect after x number of failures. This will tell Starfish to attempt to completely reconnect. Internally this calls the OpenConnection method of the connector, which for some connectors will cause it to get a new Session. (January 18, 2023 - I am not aware of anyone ever using this.)