Install External Libraries

Install external libraries to make them available to Data Collector stages. When using multiple stage libraries for a particular stage, to make external libraries available to all versions of the stage, install the external libraries for each stage library.

You can install external libraries using the Package Manager in the Data Collector user interface, or you can install them manually.

You can install external libraries for the following stages:
  • Before you use the following stages, install JDBC drivers for the implementation that you want to use:
    • JDBC Multitable Consumer origin
    • JDBC Query Consumer origin
    • MySQL Binary Log origin
    • Oracle CDC Client origin
    • SQL Server CDC Client origin
    • SQL Server Change Tracking origin
    • Teradata Consumer origin
    • JDBC Lookup processor
    • JDBC Tee processor
    • SQL Parser processor, when using the database to resolve the schema
    • JDBC Producer destination
    • MemSQL Fast Loader destination
    • JDBC Query executor

    For example, to use the JDBC Query Consumer or the JDBC Producer with Oracle, install the Oracle JDBC drivers.

  • Before you use the Hadoop FS origin to read from non-HDFS systems, install all required file system application JAR files. See the file system documentation for details about the files to install.
  • Before you use the Spark Evaluator processor, install the Spark application JAR file and any dependencies other than the streamsets-datacollector-api, streamsets-datacollector-spark-api, and spark-core libraries.
  • You can install external Java libraries to call external Java code from the scripting processors: Groovy, Java, and Jython Evaluator.
  • You can install the DataStax Enterprise (DSE) Java driver to configure the Cassandra destination to use DSE username and password authentication or Kerberos authentication.
  • Before you use the Google Bigtable destination, install the BoringSSL library.
  • Before you use the JMS Consumer origin or the JMS Producer destination, install the JMS drivers for the implementation that you are using.
  • You can install the Impala JDBC driver under the stage library selected for the executor. For more information, see Installing the Impala Driver.