Oracle Bulkload

Configure an Oracle Bulkload origin to read data from one or more static database tables. This origin is a Technology Preview feature. It is not meant for use in production.

1. In the Properties panel, on the General tab, configure the following properties:

   General Property	Description
   Name	Stage name.
   Description	Optional description.
   Produce Events	Generates event records when events occur. Use for event handling.
   On Record Error	Error record handling for the stage: Discard - Discards the record. Send to Error - Sends the record to the pipeline for error handling. Stop Pipeline - Stops the pipeline.

2. On the JDBC tab, configure the following JDBC properties:

   JDBC Property	Description
   JDBC Connection String	Connection string to use to connect to the database. Note: If you include the JDBC credentials in the connection string, use the user account created for the origin.
   Use Credentials	Enables entering credentials on the Credentials tab. Use when you do not include credentials in the JDBC connection string.
   Tables	Tables to read. Configure properties for each table or set of tables that you want to read. Using simple or bulk edit mode, click the Add icon to define another table configuration.
   Schema Name	Schema to use. You can enter a schema name or use SQL wildcards to define multiple schemas.
   Table Name	A table name pattern that defines the tables to read. You can enter a table name or use SQL wildcards to define multiple tables.
   Additional JDBC Configuration Properties	Additional JDBC configuration properties to use. To add properties, click Add and define the JDBC property name and value. Use the property names and values as expected by JDBC.

3. To enter JDBC credentials separately from the JDBC connection string, on the Credentials tab, configure the following properties:

   Credentials Property	Description
   Username	User name for the JDBC connection.
   Password	Password for the account. Tip: To secure sensitive information such as user names and passwords, you can use runtime resources or credential stores.

4. On the Advanced tab, optionally configure the following properties:

   Advanced Property	Description
   Maximum Pool Size	Determines the number of threads to use for multithreaded processing.
   Batches per Request	Number of batches to fetch from the database in each request. Default is 50.
   Max Batch Size (records)	Maximum number of records processed at one time. Honors values up to the Data Collector maximum batch size. Default is 1000. The Data Collector default is 1000.
   Minimum Idle Connections	Minimum number of connections to create and maintain. To define a fixed connection pool, set to the same value as Maximum Pool Size. Default is 1.
   Minimum Task Size	Minimum number of records to allow in a task. This property determines whether smaller tasks should be merged with larger tasks for processing. Tasks are based on chunks of data provided by Oracle. Use -1 to opt out of using this property.
   Stop for SQL Exception	Enables the origin to stop the pipeline upon encountering a SQL exception.
   Idle Timeout	Maximum time to allow a connection to idle. Use a time constant in an expression to define the time increment. Use 0 to avoid removing any idle connections. Default is 10 minutes, defined as follows: ${10 * MINUTES}
   Connection Timeout	Maximum time to wait for a connection. Use a time constant in an expression to define the time increment. Default is 30 seconds, defined as follows: ${30 * SECONDS}