All Versions
10
Latest Version
Avg Release Cycle
36 days
Latest Release
1302 days ago

Changelog History

  • v0.8.0

    September 22, 2020

  • v0.7.0 Changes

    September 04, 2020

    👍 DJL 0.7.0 brings SetencePiece for tokenization, GravalVM support for PyTorch engine, a new set of Nerual Network operators, BOM module, Reinforcement Learning interface and experimental DJL Serving module.

    Key Features

    • Now you can leverage powerful SentencePiece to do text processing including tokenization, de-tokenization, encoding and decoding. You can find more details on extension/sentencepiece.
    • ⬆️ Engine upgrade:
      • MXNet engine: 1.7.0-backport
      • PyTorch engine: 1.6.0
      • TensorFlow: 2.3.0
    • 0️⃣ MXNet multi-gpu training now is boosted by MXNet KVStore by default, which saves lots of overhead by GPU memory copy.
    • 👍 GraalVM are fully supported on both of regular execution and native image for PyTorch engine. You can find more details on GraalVM example.

    • ➕ Add a new set of Neural Network operators that offers capability of full controlling over parameters for CV domain, which is similar to PyTorch nn.functional module. You can find the operator method in its Block class.

      Conv2d.conv2d(NDArray input, NDArray weight, NDArray bias, Shape stride, Shape padding, Shape dilation, int groups);

    • 📦 Bill of Materials (BOM) is introduced to manage the version of dependencies for you. In DJL, the engine you are using usually is tied to a specific version of native package. By easily adding BOM dependencies like this, you won’t worry about version anymore.

      <dependency> <groupId>ai.djl</groupId> <artifactId>bom</artifactId> <version>0.7.0</version> <type>pom</type> <scope>import</scope> </dependency>

      implementation platform("ai.djl:bom:0.7.0")

    • 👍 JDK 14 now get supported

    • 🆕 New Reinforcement Learning interface including RIAgent, RlEnv, etc, you can see a comprehensive TicTacToe example.

    • 👌 Support DJL Serving module. With only a single command, now you can enjoy deploying your model without bothering writing the server code or config like server proxy.

      cd serving && ./gradlew run --args="-m https://djl-ai.s3.amazonaws.com/resources/test-models/mlp.tar.gz"

    📚 Documentation and examples

    • We wrote the D2L book from chapter 1 to chapter 7 with DJL. You can learn basic deep learning concept and classic CV model architecture with DJL. Repo
    • 📄 We launched a new doc website that hosts abundant documents and tutorials for quick search and copy-paste.
    • New Online Sentiment Analysis with Apache Flink.
    • New CTR prediction using Apache Beam and Deep Java Library(DJL).
    • 🆕 New DJL logging configuration document which includes how to enable slf4j, switch to other logging libraries and adjust log level to debug the DJL.
    • 🆕 New Dependency Management document that lists DJL internal and external dependencies along with their versions.
    • 🆕 New CV Utilities document as a tutorial for Image API.
    • 🆕 New Cache Management document is updated with more detail on different categories.dependency management.
    • ⚡️ Update Model Loading document to describe loading model from various sources like s3, hdfs.

    ✨ Enhancement

    • ➕ Add archive file support to SimpleRepository
    • 👍 ImageFolder supports nested folder
    • ➕ Add singleton method for LambdaBlock to avoid redundant function reference
    • ➕ Add Constant Initializer
    • ➕ Add RMSProp, Adagrad, Adadelta Optimizer for MXNet engine
    • ➕ Add new tabular dataset: Airfoil Dataset
    • ➕ Add new basic dataset: CookingExchange, BananaDetection
    • ➕ Add new NumPy like operators: full, sign
    • 👉 Make prepare() method in Dataset optional
    • ➕ Add new Image augmentation APIs where you can add to Pipeline to enrich your image dataset
    • ➕ Add new handy fromNDArray to Image API for converting NDArray to Image object quickly
    • ➕ Add interpolation option for Image Resize operator
    • 👌 Support archive file for s3 repository
    • Import new SSD model from TensorFlow Hub into DJL model zoo
    • Import new Sentiment Analysis model from HuggingFace into DJL model zoo

    💥 Breaking changes

    • ⬇️ Drop CUDA 9.2 support for all the platforms including linux, windows
    • ✅ The arguments of several blocks are changed to align with the signature of other widely used Deep Learning frameworks, please refer to our Java doc site
    • FastText is no longer a full Engine, it becomes a part of NLP utilities in favor of FastTextWorkEmbedding
    • 🚚 Move the WarmUp out from existing Tracking and introduce new WarmUpTracker
    • 0️⃣ MxPredictor now doesn’t copy parameters by default, please make sure to use NaiveEngine when you run inference in multi-threading environment

    🐛 Bug Fixes

    • 🛠 Fixing Validation Epoch Result bug
    • 🛠 Fix multiple process downloading the same model bug
    • 🛠 Fix potential concurrent write bug while downloading metadata.json
    • 🛠 Fix URI parsing error on Windows
    • 🛠 Fix multi-gpu training crash when the number of the batch size is smaller than number of devices
    • 🛠 Fix not setting number of inter-op threads for PyTorch engine

  • v0.6.0 Changes

    June 25, 2020

    👍 DJL 0.6.0 brings stable Android support, ONNX Runtime experimental inference support, experimental training support for PyTorch.

    Key Features

    • 👍 Stable Android inference support for PyTorch models
      • Provide abstraction for Image processing using ImageFactory
    • 👍 Experimental support for inference on ONNX models
    • 🎉 Initial experimental training and imperative inference support for PyTorch engine
    • 👍 Experimental support for using multi-engine
    • 👌 Improved usage for NDIndex - support for ellipsis notation, arguments
    • 👌 Improvements to AbstractBlock to simplify custom block creation
    • ➕ Added new datasets

    📚 Documentation and examples

    💥 Breaking changes

    • 🔧 ModelZoo Configuration changes
    • ImageFactory changes
    • ✅ Please refer to javadocs for minor API changes

    Known issues

    • Issue with training with MXNet in multi-gpu instances

  • v0.5.0 Changes

    May 12, 2020

    🚀 DJL 0.5.0 release brings TensorFlow engine inference, initial NLP support and experimental Android inference with PyTorch engine.

    Key Features

    • 👍 TensorFlow engine support with TensorFlow 2.1.0
      • Support NDArray operations, TensorFlow model zoo, multi-threaded inference
    • PyTorch engine improvement with PyTorch 1.5.0
    • 👍 Experimental Android Support with PyTorch engine
    • MXNet engine improvement with MXNet 1.7.0
    • 🎉 Initial NLP support with MXNet engine
      • Training LSTM models
      • Support various text/word embedding, Seq2Seq use cases
      • Added NLP datasets
    • 🆕 New AWS-AI toolkit to integrate with AWS technologies
      • Load model from s3 buckets directly
    • 👌 Improved model-zoo with more models

    📚 Documentation and examples

    💥 Breaking changes

    • 🚚 We moved our repository module under api module. There will be no 0.5.0 version for ai.djl.repository, use ai.djl.api instead.
    • ✅ Please refer to DJL Java Doc for some minor API changes.

    Know issues:

  • v0.4.1 Changes

    April 06, 2020

    🚀 DJL 0.4.1 release includes an important performance Improvement on MXNet engine:

    🐎 Performance Improvement:

    • Cached MXNet features. This will avoid MxNDManager.newSubManager() to repeatedly calling getFeature() which will make JNA calls to native code.

    Known Issues:

    🚀 Same as v0.4.0 release:

    • 🚀 PyTorch engine doesn't fully support multithreaded inference. You may see random crashes. Single-threaded inference is not impacted. We expect to fix this issue in a future release.
    • 💻 We saw random crash on mac for “transfer Learning on CIFAR-10 Dataset” example on Jupyter Notebook. Command line all works.

  • v0.4.0 Changes

    March 30, 2020

    👍 DJL 0.4.0 brings PyTorch and TensorFlow 2.0 inference support. Now you can use these engines directly from DJL with minimum code changes.

    🚀 Note: TensorFlow 2.0 currently is in PoC stage, users will have to build from source to use it. We expect TF Engine finish in the future releases.

    Key Features

    • Training improvement
      • Add InputStreamTranslator
    • Model Zoo improvement
      • Add LocalZooProvider
      • Add ListModels API
    • 👍 PyTorch Engine support
      • Use the new ai.djl.pytorch:pytorch-native-auto dependency for automatic engine selection and a simpler build/installation process
      • 60+ methods supported
    • 👍 PyTorch ModelZoo support
      • Image Classification models: ResNet18 and ResNet50
      • Object Detection model: SSD_ResNet50
    • 👍 TensorFlow 2.0 Engine support
      • Support on Eager Execution for imperative mode
      • 30+ methods support
    • 👍 TensorFlow ModelZoo support
      • Image Classification models: ResNet50, MobileNetV2

    💥 Breaking Changes

    ⚡️ There are a few changes in API and ModelZoo packages to adapt to multi-engine support. Please follow our latest examples to update your code base from 0.3.0 to 0.4.0.

    Known Issues

    🚀 1. PyTorch engine doesn't fully support multithreaded inference. You may see random crashes. Single-threaded inference is not impacted. We expect to fix this issue in a future release. 💻 2. We saw random crash on mac for “transfer Learning on CIFAR-10 Dataset” example on Jupyter Notebook. Command line all works.

  • v0.3.0 Changes

    February 24, 2020

    🚀 This is the v0.3.0 release of DJL

    Key Features

    • 🏗 Use the new ai.djl.mxnet:mxnet-native-auto dependency for automatic engine selection and a simpler build/installation process
    • 🆕 New Jupyter Notebook based tutorial for DJL
    • 🆕 New Engine Support for:
      • FastText Engine
      • Started implementation on a PyTorch Engine
    • Simplified training experience featuring:
      • TrainingListeners to easily provide full featured training
      • DefaultTrainingConfig now contains a default optimizer and initializer
      • Easier to transfer from examples to your own code
    • 👀 Specify the random seed for reproducible training
    • 0️⃣ Run with multiple engines and specify the default using the "DJL_DEFAULT_ENGINE" environment variable or "ai.djl.default_engine" system property
    • ⚡️ Updated ModelZoo design to support unified loading with Criteria
    • Simple random Hyperparameter optimization

    💥 Breaking Changes

    🚀 DJL is working to further improve the ease of use and correctness of our API. To that end, we have made a number of breaking changes for this release. Here are a few of the areas that had breaking changes:

    • 📇 Renamed TrainingMetrics to Evaluator
    • CompositeLoss replaced with AbstractCompositeLoss and SimpleCompositeLoss
    • Modified MLP class
    • ✂ Remove Matrix class
    • ⚡️ Updates to NDArray class

    Known Issues

    🏁 1. RNN operators do not working with GPU on Windows. 🏁 2. Only CUDA_ARCH 37, 70 are supported for Windows GPU machine.

  • v0.2.1 Changes

    December 18, 2019

    🚀 This is the v0.2.1 release of DJL

    Key Features

    🏁 1. Added support for Windows 10. 🐧 2. CUDA 9.2 support for all supported Operating systems (Linux, Windows)

    Known Issues

    🏁 1. RNN operators do not working with GPU on Windows. 🏁 2. Only CUDA_ARCH 37, 70 are supported for Windows GPU machine.

  • v0.2.0 Changes

    November 29, 2019

    🚀 This is the v0.2.0 release for DJL
    Key Features

    1. Deep learning engine agnostic High-level API for Training and Prediction.
    2. Dataset API, to create objects based out of different dataset formats, that work with training batchifier.
    3. MXNet-Model-Zoo with pre-trained models for Image Classification, Object Detection, Segmentation and more. 📄 4. Jupyter Notebooks and Examples to help get started with Training and predicting models with DJL

    👍 Engines currently supported

    1.Apache MXNet

    Javadocs

    The javadocs are available here

  • v0.1.0

    November 01, 2019