All Versions
16
Latest Version
4.3
Avg Release Cycle
70 days
Latest Release
203 days ago

Changelog History
Page 1

  • v4.3 Changes

    October 20, 2020
    • @MohamedMandouh implemented distributed sorting: BatchStage.sort().
    • @guenter-hesse added a high-throughput source with precisely controlled
      ๐Ÿšค timing, to be used to benchmark Jet's throughput and latency.
    • ๐Ÿ‘ท We added the ability for Jet to suspend an unbounded, fault-tolerant job
      ๐Ÿ‘ป when it fails due to an exception in the pipeline code. This allows you
      ๐Ÿšš to diagnose the problem, remove its cause, and resume the pipeline without
      data loss.
    • We have improved the consistency of reconnect behaviour across CDC sources and
      ๐Ÿ”ง introduced a uniform API to configure the reconnect strategy.
    • We improved the behavior of streaming pipelines based on ingestion time: a
      low event rate in any partition of the source used to stall the progress,
      now the watermark advances even without events.
    • ๐Ÿšš We moved the Pipeline to DAG transformation from the client to the server,
      in preparation for the upcoming feature of preventing event reordering in the
      pipeline.
  • v4.2 Changes

    July 14, 2020
    • ๐Ÿ‘ We added Change Data Capture (CDC) support for PostgreSQL and MySql. New
      connectors use Debezium to provide a high-level API for processing the
      stream of changes from relational databases. A new map sink can be used to
      ๐Ÿ”€ automatically keep the map in-sync with changes from the database.
    • We added new source and sink connectors for Elasticsearch 5, 6 and 7
      ๐ŸŽ with support for slicing and co-located reading for maximum read performance
      and extended Elasticsearch's client retry mechanism for reliable writing.
    • ๐Ÿ‘ We improved JSON support through a new file source which can read JSON files
      ๐Ÿ“œ directly and also added built-in Jet methods for parsing and mapping JSON strings.
    • We introduced .relabance() operator which can be used for distributing items
      across the cluster.
    • We made some improvements to Jet startup scripts:
      • You can now use the PROMETHEUS_PORT to start Jet with prometheus metrics enabled.
      • You can use the jvm.options file to edit the startup JVM parameters.
      • You can now use the JET_MODULES environment variable to add modules when using docker
        or jet-start script.
    • ๐Ÿ“š We did several rounds of improvements to the documentation:
      • Improvements to Docker and Kubernetes instructions
      • New guidance on Garbage Collector choice and settings
      • New and improved tutorials for CDC
      • New documentation for Python module and early results support in windowing
  • v4.2-elastic6

    August 04, 2020
  • v4.1.1 Changes

    June 05, 2020
    1. Enhancements

    โšก๏ธ [docker] Update Java version to 11 in Docker image

    ๐Ÿ›  1. Fixes

    [core] JmsSink should not throw when it receives a Watermark

  • v4.1 Changes

    April 29, 2020
    • You can now use our JMS and JDBC sinks with the exactly-once guarantee.
    • ๐Ÿ”ง We simplified adding classes to the Jet job configuration object. You
      ๐Ÿ“ฆ can add a whole package in one call and, for jobConfig.addClass, we
      automatically add all the class's nested classes, including anonymous
      ones.
    • We made the serialization setup simpler. You can now register custom
      ๐Ÿ‘ท serializers with the job and we added extra convenience for protobuf
      serialization.
    • We added a ServiceFactory that accesses an external gRPC service. You
      can now use mapUsingService to transform the data by calling either
      a unary or a bidirectional streaming gRPC service.
    • We added the innerHashJoin transform that achieves an inner join
      directly instead of requiring custom code in the mapToOutputFn. Credit
      for this one goes to @TomaszGaweda.
  • v4.0 Changes

    March 02, 2020

    Hazelcast Jet 4.0

    • โšก๏ธ Updated Hazelcast IMDG version to 4.0, which brings many new features
      ๐ŸŽ such as a revamped metrics system, improved performance.
    • ๐Ÿ‘ Jet now supports calling user-defined Python function from within a
      pipeline using the mapUsingPython transform.
    • ๐Ÿ‘ Snapshots now offer support for distributed two-phase commit (2PC),
      ๐Ÿ‘ which enables end-to-end exactly-once processing support for sinks and
      sources such as JMS and files.
    • ๐Ÿ‘ท Clients can now collect the results of jobs they have submitted via
      ๐Ÿ’… Rx-style Observables.
    • ๐Ÿ‘‰ Users can now add custom metrics to their Pipelines.
    • ๐Ÿ‘ The distribution has been improved with support for daemon mode and
      ๐ŸŒฒ rolling file based logging.
    • ๐Ÿ‘ท Snapshot statistics (keys & bytes saved) and job lifecycle-statistics
      ๐Ÿ‘ท (no. of jobs submitted, terminated and so on) can be tracked via
      metrics now.
    • Debezium-Jet connector is now available in hazelcast-jet-contrib. The
      connector makes it possible to stream changes from a database into Jet,
      also known as Change Data Capture (CDC).
    • A Kafka Connect adapter is added which enables using any Kafka Connect
      source inside Jet.
    • ๐Ÿ‘ท It is now possible to specify the main class when submitting jobs from
      CLI.
  • v4.0-trade

    March 10, 2020
  • v3.2.2 Changes

    February 06, 2020

    Hazelcast Jet 3.2.2

    1. Enhancements

    โšก๏ธ [core] Update IMDG version to 3.12.6 [#1908]

    ๐Ÿ›  1. Fixes

    [core] Fix an issue which could lead to an older watermark overtaking a newer one [#1882]

  • v3.2.2-adobe

    April 02, 2020
  • v3.2.1 Changes

    January 06, 2020

    Hazelcast Jet 3.2.1

    • โšก๏ธ Optimize DAG iteration during job initialization for very large DAGs (>200+ vertices) [#1809]
    • ๐Ÿ›  Fix error in snapshot chunking which could cause snapshot to fail intermittently [#1810]
    • โšก๏ธ Update IMDG version to 3.12.5 [#1812]