This content has been archived and is no longer being maintained.

Table of Contents

Article

JAR file dependencies for the HBase and HDFS data sets

Data sets define collections of records that are stored in different sources and formats. The HBase data set reads and saves data from an external Apache HBase storage, while the HDFS data set reads and saves data from an external Apache Hadoop Distributed File System (HDFS).

Importing third-party client JAR files

Before you can connect to Apache HBase or HDFS data storage, you have to import relevant client JAR files into the application container with the Pega 7 Platform. Because you need different JAR files for specific versions of applications (Apache HBase and Apache Hadoop File System), the files are not stored in the Pega 7 Platform database. You must use the JAR files that match the versions of your applications.

For details about how to import JAR files, see the Import landing page.

For all public JAR files distributions, see the Apache Maven Repository Centre.

Sample third-party JAR files for the HBase data sets

Upload the following JAR files for the HBase data sets when you use Apache Hadoop 2.4.1 and HBase 0.98.3:

  • commons-configuration-1.6.jar
  • hadoop-auth-2.4.1.jar
  • hadoop-common-2.4.1.jar
  • hbase-client-0.98.3-hadoop2.jar
  • hbase-common-0.98.3-hadoop2.jar
  • hbase-protocol-0.98.3-hadoop2.jar
  • htrace-core-2.04.jar
  • protobuf-java-2.5.0.jar
  • zookeeper-3.4.5.jar

Sample third-party JAR files for the HDFS data sets

Upload the following JAR files for the HDFS data set when you use Apache Hadoop 2.4.1:

  • commons-configuration-1.6.jar
  • commons-io-2.4.jar
  • hadoop-auth-2.4.1.jar
  • hadoop-common-2.4.1.jar
  • hadoop-hdfs-2.4.1.jar
  • protobuf-java-2.5.0.jar

Sample third-party JAR files to support the Parquet file format in the HDFS data sets

Upload the following JAR files if you want to use the Parquet file format in the HDFS data set:

The Parquet file format is supported in Pega 7.2.1 and later versions.
  • parquet-hadoop-1.8.1.jar
  • parquet-common-1.8.1.jar
  • parquet-column-1.8.1.jar
  • parquet-format-2.3.1.jar
  • parquet-encoding-1.8.1.jar
  • hadoop-common-2.4.1.jar
  • hadoop-hdfs-2.4.1.jar
  • hadoop-auth-2.4.1.jar
  • commons-configuration-1.6.jar
  • protobuf-java-2.5.jar

Published November 20, 2015 — Updated August 23, 2018


100% found this useful

Have a question? Get answers now.

Visit the Pega Support Community to ask questions, engage in discussions, and help others.