All Versions
16
Latest Version
4.3
Avg Release Cycle
70 days
Latest Release
1427 days ago

Changelog History
Page 1

  • v4.3 Changes

    October 20, 2020
    • @MohamedMandouh implemented distributed sorting: BatchStage.sort().
    • @guenter-hesse added a high-throughput source with precisely controlled
      🚤 timing, to be used to benchmark Jet's throughput and latency.
    • 👷 We added the ability for Jet to suspend an unbounded, fault-tolerant job
      👻 when it fails due to an exception in the pipeline code. This allows you
      🚚 to diagnose the problem, remove its cause, and resume the pipeline without
      data loss.
    • We have improved the consistency of reconnect behaviour across CDC sources and
      🔧 introduced a uniform API to configure the reconnect strategy.
    • We improved the behavior of streaming pipelines based on ingestion time: a
      low event rate in any partition of the source used to stall the progress,
      now the watermark advances even without events.
    • 🚚 We moved the Pipeline to DAG transformation from the client to the server,
      in preparation for the upcoming feature of preventing event reordering in the
      pipeline.

  • v4.2 Changes

    July 14, 2020
    • 👍 We added Change Data Capture (CDC) support for PostgreSQL and MySql. New
      connectors use Debezium to provide a high-level API for processing the
      stream of changes from relational databases. A new map sink can be used to
      🔀 automatically keep the map in-sync with changes from the database.
    • We added new source and sink connectors for Elasticsearch 5, 6 and 7
      🐎 with support for slicing and co-located reading for maximum read performance
      and extended Elasticsearch's client retry mechanism for reliable writing.
    • 👍 We improved JSON support through a new file source which can read JSON files
      📜 directly and also added built-in Jet methods for parsing and mapping JSON strings.
    • We introduced .relabance() operator which can be used for distributing items
      across the cluster.
    • We made some improvements to Jet startup scripts:
      • You can now use the PROMETHEUS_PORT to start Jet with prometheus metrics enabled.
      • You can use the jvm.options file to edit the startup JVM parameters.
      • You can now use the JET_MODULES environment variable to add modules when using docker
        or jet-start script.
    • 📚 We did several rounds of improvements to the documentation:
      • Improvements to Docker and Kubernetes instructions
      • New guidance on Garbage Collector choice and settings
      • New and improved tutorials for CDC
      • New documentation for Python module and early results support in windowing

  • v4.2-elastic6

    August 04, 2020

  • v4.1.1 Changes

    June 05, 2020
    1. Enhancements

    ⚡️ [docker] Update Java version to 11 in Docker image

    🛠 1. Fixes

    [core] JmsSink should not throw when it receives a Watermark

  • v4.1 Changes

    April 29, 2020
    • You can now use our JMS and JDBC sinks with the exactly-once guarantee.
    • 🔧 We simplified adding classes to the Jet job configuration object. You
      📦 can add a whole package in one call and, for jobConfig.addClass, we
      automatically add all the class's nested classes, including anonymous
      ones.
    • We made the serialization setup simpler. You can now register custom
      👷 serializers with the job and we added extra convenience for protobuf
      serialization.
    • We added a ServiceFactory that accesses an external gRPC service. You
      can now use mapUsingService to transform the data by calling either
      a unary or a bidirectional streaming gRPC service.
    • We added the innerHashJoin transform that achieves an inner join
      directly instead of requiring custom code in the mapToOutputFn. Credit
      for this one goes to @TomaszGaweda.

  • v4.0 Changes

    March 02, 2020

    Hazelcast Jet 4.0

    • ⚡️ Updated Hazelcast IMDG version to 4.0, which brings many new features
      🐎 such as a revamped metrics system, improved performance.
    • 👍 Jet now supports calling user-defined Python function from within a
      pipeline using the mapUsingPython transform.
    • 👍 Snapshots now offer support for distributed two-phase commit (2PC),
      👍 which enables end-to-end exactly-once processing support for sinks and
      sources such as JMS and files.
    • 👷 Clients can now collect the results of jobs they have submitted via
      💅 Rx-style Observables.
    • 👉 Users can now add custom metrics to their Pipelines.
    • 👍 The distribution has been improved with support for daemon mode and
      🌲 rolling file based logging.
    • 👷 Snapshot statistics (keys & bytes saved) and job lifecycle-statistics
      👷 (no. of jobs submitted, terminated and so on) can be tracked via
      metrics now.
    • Debezium-Jet connector is now available in hazelcast-jet-contrib. The
      connector makes it possible to stream changes from a database into Jet,
      also known as Change Data Capture (CDC).
    • A Kafka Connect adapter is added which enables using any Kafka Connect
      source inside Jet.
    • 👷 It is now possible to specify the main class when submitting jobs from
      CLI.

  • v4.0-trade

    March 10, 2020

  • v3.2.2 Changes

    February 06, 2020

    Hazelcast Jet 3.2.2

    1. Enhancements

    ⚡️ [core] Update IMDG version to 3.12.6 [#1908]

    🛠 1. Fixes

    [core] Fix an issue which could lead to an older watermark overtaking a newer one [#1882]

  • v3.2.2-adobe

    April 02, 2020

  • v3.2.1 Changes

    January 06, 2020

    Hazelcast Jet 3.2.1

    • ⚡️ Optimize DAG iteration during job initialization for very large DAGs (>200+ vertices) [#1809]
    • 🛠 Fix error in snapshot chunking which could cause snapshot to fail intermittently [#1810]
    • ⚡️ Update IMDG version to 3.12.5 [#1812]