2 What’s New in this Release

• These major features are introduced for the corresponding targets:

  BigQuery Handler

  Use the Google BigQuery Handler, which streams change data capture data from source trail files into Google BigQuery.

  Oracle Cloud Infrastructure Event Handler

  Use the Oracle Cloud Infrastructure Event Handler to load files generated by the File Writer Handler into an Oracle Cloud Infrastructure Object Store.

  Oracle Cloud Infrastructure Classic Event Handler

  Use the Oracle Cloud Infrastructure Classic Event Handler to load files generated by the File Writer Handler into an Oracle Cloud Infrastructure Classic Object Store.

  Connecting to Microsoft Azure Data Lake

  You can connect to Microsoft Azure Data Lake to process big data jobs with Oracle GoldenGate for Big Data.

  Length Delimited Value Formatter

  The Length Delimited Value Formatter is a row-based formatter. It formats database operations from the source trail file into a length delimited value output.

• These changes and enhancements were implemented:

  Cassandra Capture

  Support or SSL configuration and authentication was added.

• The following properties are introduced:

  HBase Handler

  You can omit null fields from being written with gg.handler.name.omitNullValues=true.

  Avro Formatters

  • You can write the Avro decimal logical type (per the Avro specification) using gg.handler.name.format.enableDecimalLogicalType=true.

  • To handle the Oracle NUMBER type, use gg.handler.name.format.oracleNumberScale=scale.

  • To write the Avro timestamp logical type (per the Avro specification), use gg.handler.name.format.enableTimestampLogicalType=formatter_spec.

  S3 Event Handler

  For Dell ECS, you can set the URL to connect to cloud storage with gg.eventhandler.name.url.

  All Handlers

  • You can consolidate the format of timestamp with this time zone property, gg.format.timestampWithTimeZone=formatter spec.

  • . For the template name property, ${primaryKey}, the syntax is extended to allow configuration of key column separator, ${primaryKey[separator_string]} where the desired separator string is specified within the square brackets].

• Theses major features are introduced for the corresponding targets:

  Capture for Cassandra

  Use Oracle GoldenGate capture (Extract) to get changes from Apache Cassandra databases.

  File Writer Handler

  The File Writer Handler allows you to write data to a local file system. Additionally, the File Writer employs event handlers to post process data after it is staged to files on the local file system. The event handlers are:

  HDFS Event Handler

  Uploads staged files to HDFS.

  Optimized Row Columnar Event (ORC) Handler

  Converts staged files to ORC format and writes either to a local file system or to HDFS.

  Parquet Event Handle

  Converts staged files to Parquet format and either write to a local file system or to HDFS.

  S3 Event Handler

  Loads staged files to Amazon S3.

  Kafka REST Proxy Handler

  Streams change data capture to Kafka via the Confluent Kafka REST Proxy. The Confluent Kafka REST Proxy provides and HTTPS interface for ingest into Kafka.

  Oracle NoSQL Handler

  Streams change data capture into Oracle NoSQL.

• All Oracle GoldenGate for Big Data Handlers are stateless and only maintain state in the context of the Replicat process that it was running. The File Writer Handler introduces the ability of maintaining state between invocations off the Replicat process.

• The HBase byte fields support was changed so that binary source data is moved into HBase as binary data. It is no longer converted to Base64.

• The duration data type was added in Cassandra 3.10. The Cassandra Handler now supports delivery to duration data type column. The duration value needs to be encoded as a string in your trail.

This section lists all items that were deprecated in each release.