« Changelog History


DKPro Core v1.11.0 Release Notes

Release Date: 2019-07-05 // almost 5 years ago

  • 🚀 We are pleased to announce the release of

    DKPro Core 1.11.0

    a collection of interoperable software components for natural language processing (NLP) based on the Apache UIMA framework.

    https://dkpro.github.io/dkpro-core

    🚀 This is a feature release.

    ⬆️ Important upgrade notice

    • 🔄 Changed groupIds and artifactIds. The group ID is now org.dkpro.core and the artifact IDs are dkpro-core-...-(asl/gpl)
    • 🔄 Changed package names. The packages are now all starting with org.dkpro.core... - except the packages of UIMA types which remain unchanged for data compatibility.

    Notable changes since DKPro Core 1.10.0

    • 🔄 Changed parts of the brat data conversion code such that it can be more easily used outside a UIMA component
    • 🔄 Changed type mapping such that out-of-tagset types map to the generic type (e.g. an unknown POS tag maps to POS, not to POS_X)
    • 🔄 Changed name of NYTCollectionReader to NitfReader
    • ➕ Added types to encode XML document structure in CAS
    • ➕ Added new XmlDocumentReader/Writer components using these types
    • ➕ Added basic reader for Annotated Gigaword corpus (only reads text so far) (thanks @az79nefy)
    • ➕ Added basic support for PubAnnotation JSON format
    • ➕ Added Maui component for keyword assignment
    • ➕ Added parameter to SfstAnnotator to enable lower-case lookup of first word in a sentence (thanks @rziai)
    • ➕ Added "order" feature to Token type
    • ➕ Added support for CoNLL-U document and paragraph IDs (thanks @manuelciosici)
    • ➕ Added support for CoNLL-U sentence IDs and text
    • ➕ Added standardized parameter to disable type mapping
    • ➕ Added support for TCF orthography layer using SofaChangeAnnotations
    • ➕ Added segmenter for Chinese using jieba (thanks @Horsmann)
    • ➕ Added MyStem for Russian
    • ➕ Added links to OpenMinTeD categories in type system documentation
    • ➕ Added support for the reading/writing the CoreNLP CoNLL flavor
    • ➕ Added parameter to configure the Tika buffer size (useful for large documents)
    • ⚡️ Updated to OpenNLP 1.9.1
    • ⚡️ Updated to CoreNLP 3.9.2
    • ⚡️ Updated to ICU4J 64.2
    • ⚡️ Updated to Tika 1.19.1
    • ⚡️ Updated to LanguageTool 4.3
    • ⚡️ Updated to PDFBox 2.0.12
    • ⚡️ Updated IllinoisNLP components
    • ⚡️ Updated TreeTagger models/binaries in build.xml script (thanks @tilmanbeck)
    • ⚡️ Updated LIF dependencies
    • ⚡️ Updated dataset descriptions
    • ⚡️ Updated various general dependencies (e.g. Apache Commons etc.)
    • 👌 Improved robustness of checksum verification for text files used in datasets (e.g. license files)
    • 👌 Improved error messages in WebAnno TSV3 module
    • 🛠 Fixed crash in WebannoTsv3XWriter when annotations do not start/end at token boundaries
    • 🛠 Fixed bug in WebAnno TSV3 support causing span annotations with slot features to disappear
    • 🛠 Fixed trimming of whitespace in TeiReader
    • 🛠 Fixed bug in NifWriter causing named entity identifier not to be written
    • 🛠 Fixed crash in BratReader with reading discontinuous segments
    • 🛠 Fixed problem in BratWriter when dealing with slot features
    • 🛠 Fixed metadata of CoNLL2012Writer
    • 🛠 Fixed potential problem of datasets being written outside their target directory
    • ⬇️ Dropped the GrAF I/O module since the upstream libraries are outdated and no longer maintained

    🚀 A more detailed overview of the changes in this release can be found here.

    Thanks for contributions go to: @az79nefy, @ramonziai, @manuelciosici, @Horsmann, @tilmanbeck

    ⬆️ When upgrading, please mind that you should not mix different versions of DKPro Core components in your projects - they may not be compatible with each other.