Release Notes

This document lists highlights, important fixes and necessary migration steps for the versions.

IGUASU 3.1

Releasedatum: 27.11.2024

Highlights

  • πŸ†• AI Assistant (Technology Preview) - questions about IGUASU can be asked, the answers are based on the documentation

  • πŸ†• Use of GitHub repositories as IGUASU flow repositories in our cloud installations

  • Memory leaks in the UI have been fixed

  • The maximum time a Processor can spend in Retry with the set Retry configurations is calculated and displayed

  • New Processors and Services

    • CopyS3Object, GetS3ObjectMetadata - get metadata from S3 and copy files between buckets

    • DeleteSFTP - allows files to be deleted on an SFTP server

    • HttpRecordSink - allows record sinks to be sent to any HTTPS address

  • Upgrade to IGUASU NiFi 2.0

Cloud

  • πŸ†• UI updates can be executed without user interaction

  • πŸ†• Several different networks and VPNs can be connected

Migration

  • DistributedMapCacheServer has been renamed to MapCacheServer

  • DistributedSetCacheServer has been renamed to SetCacheServer

  • DistributedMapCacheClientService has been renamed to MapCacheClientService

  • DistributedSetCacheClientService has been renamed to SetCacheClientService

IGUASU 3.0

Releasedatum: 09.09.2024

Highlights

User Interface

  • πŸ†• Diagram innovations

    • The diagram can be moved by holding down the middle mouse button

    • The diagram can be zoomed by Control + scrolling the middle mouse button (the same applies to pinch/zoom on trackpads)

    • Zooming via the toolbar is now possible at a finer granularity

    • Success and failure ports can now be selected and Failure Ports can now be connected directly from the Processors

    • The Ports have tooltips with descriptions

    • New Processors can be created directly when creating outgoing connections

    • Connections from and to Process Groups now show the name and status of the Port

    • Revised display of the icons in the Process Groups modules

  • πŸ†• Management

    • New, integrated display of the various central settings and services (no longer distributed in the menu)

    • Endpoint Management - Endpoints can be shared externally and mapped internally to Ports and thus Processors and Services. These endpoints can be viewed, extended and managed.

    • Database drivers, certificates and own Processors/Services can be exported and imported

  • πŸ†• Visual tree representations and editors for JSON and XML in all places where data can occur in these types

    • Complete editing of the data in the model as well as XPath or JSONata queries

  • πŸ†• New view of Services as part of the Diagram (no longer in the Process Groups Settings)

    • The Services now have individual icons like the Processors

  • πŸ†• New , graphical das hboards

    • for central metrics in System Information (memory, threads, hard disk, etc.) to Processors and Processes.)

    • to Processors and Process groups with information about the executions

  • πŸ†• Support of rules for analyzing flows

    • In the first step, there is the possibility to prohibit the use of individual Processors or to warn when using them

  • Redesigned view of Connections with division of the areas for configuration and the displays of the queue during runtime

    • πŸ†• Relationships can now be added and removed directly in the configuration

    • πŸ†• The data in the queue can also be displayed by date of receipt

  • Improved Processor configuration

    • Dynamic properties now have their own area and can be added directly, without dialog and thus also in bulk, and renamed directly inline

    • πŸ†• New use case descriptions on various Processors, also in interaction with other Processors

    • πŸ†• Associated Processors are displayed and can be dragged directly from here into the Diagram (for example, the associated HandleHttpResponse is displayed for a HandleHttpRequest)

  • πŸ†• New interface element for multiple selection

    • Selected prioritizers on Connections

    • Relationships on Connections

    • Permissions - e.g. on process groups πŸ†• New use case descriptions on various Processors.E.g. on process groups

    • Selection of multiple values for filters in monitoring

  • πŸ†• Display of the number of Bulletins on the icon when the Bulletins view is inactive

  • Monitoring

    • The selection and display of times in the monitoring filters has been simplified and visually improved

    • πŸ†• It is now also possible to filter on a component in the audit log and the provenance events. The component can be taken from the selection in the Diagram or the currently selected Row

    • The flowed data can be loaded directly from the general Provenance Events - the execution view can also be activated in the Diagram

  • Further news in the UI

    • πŸ†• Avatar images from federated IDMs such as Google are now supported.Avatar images from federated IDMs such as Google are now supported

    • Revision of the central toolbar, as well as access to hidden elements

    • Orange is now consistently used as a marker on action buttons and menus to make it clear that the action has/can have a direct influence on flow executions.

    • The dialog for adding new Processors is now very easy to use with the keyboard via the arrows and the tab

    • The items in the Services and Flow trees have tooltips so that you can read the entries, if the tree is too narrow

    • Messages about the content limits of fields now only appear when they are exceeded

    • The mouse pointer makes the possible actions on buttons and elements in the diagram even clearer

    • The evaluation of the expression language on the properties shows the usable scope

    • The language support 'nifi' for using the expression language suggestions is no longer explicitly available in the text editor. These can now be used directly in 'text' mode

    • The text editor now also supports Parameters in the properties

Virtimo Portfolio

  • An even better integration between IGUASU and the BPC:

    • πŸ†• From the execution information of a flow in IGUASU (Provenance) you can jump directly to the entry in the BPC

    • πŸ†• From an entry of a monitor in the BPC, which was created by a flow in IGUASU, you can jump directly to the execution instance in IGUASU

  • πŸ†• New Processors FetchBPCProcessLog and DeleteBPCProcessLog

Execution

  • πŸ†• [BETA] New stateless execution model on process groups

  • πŸ†• New Processors

    • DeleteFile, SpliExel, PackageFlowFile, EncryptContentAge, DecryptContentAge, ListenSlack, ConsumeSlack, ListenOTLP, CalculateParquetOffsets, CalculateParquetRowGroupOffsets, FilterAttribute, PublishSlack, PutMongoBulk, PutAzureDataExplorer, PutZendeskTicket, SplitPCAP, SplitExcel

  • πŸ†• New Services

    • BPCRecordSink, YamlTreeReader, StandardKustoIngestService, ZendeskRecordSink, ProtobufReader

  • πŸ†• New Schema Registries

    • AmazonGlueSchemaRegistry, StandardJsonSchemaRegistry, ApicurioSchemaRegistry, DatabaseTableSchemaRegistryService

  • πŸ†• New Parameter Provider

    • OnePasswordParameterProvider

  • πŸ†• [BETA] Support for Python as the language for developing Processors. First new Processors for the implementation of Retrieval-Augmented Generation in the AI environment (RAG):

    • PromptChatGPT - send queries to OpenAI ChatGPT

    • QueryChroma, PutChroma - use of the Chroma vector database

    • QueryPinecone, PutPinecone - use of the Pinecone vector database

    • QueryOpensearchVector, PutOpenSearchVector - use of OpenSearch as a vector database

    • QueryQdrant, PutQdrant - use of the vector database Qdrant

    • ChunkDocument - splits documents for use as embeddings

    • ParseDocument - parsing of unstructured text documents, as well as OCR on PDF and images in "json-lines" (data and metadata) for use as embeddings

Upgrades

  • Our Processors and Services for communication with INUBIT and the BPC now use Jetty 12

  • Upgrade to IGUASU NiFi 2.*0. *0M4

Cloud

  • Updates from IGUASU can now be installed by the user and time-controlled (for 3.0 final)

  • There is th e new standard group viewer - users in this group cannot change/start etc. anything in the system but can only view it There is a new standard group viewer - users in this group cannot change/start etc. but can only view it. but only view

  • There is an area in the file system that can be used for Services/Processors that require this and also ends up in the backup

  • GitHub can now be used directly as a repository

Migration

  • Many outdated or functionally duplicate components have been removed. The complete list can be found here. These include possible alternatives

    • Base64EncodeContentEncodeContent

    • ConvertAvroToJSONConvertRecord

    • ConvertExcelToCSVProcessorExcelReader

    • CryptographicHashAttributeUpdateAttribute

    • EncryptContentEncryptContentAge/EncryptContentPGP

    • FetchElasticsearchHttp -→ GetElasticsearch

    • GetHTTP, PostHTTPInvokeHTTP

    • GetTwitterConsumeTwitter

    • HashAttributeCryptographicHashAttribute

    • HashContentCryptographicHashContent

    • PostSlackPublishSlack

    • PutElasticsearchHttpPutElasticsearchJson

    • PutElasticsearchHttpRecordPutElasticsearchRecord

    • PutSlackPublishSlack

Documentation

  • If a Processor or a Service is described in more detail in the User Guide or in a tutorial, this is now linked directly to the component

  • Restructured and supplemented with new features and customizations

IGUASU 2.8

Releasedatum: 05.02.2024

Highlights

  • πŸ†• Records can be easily written to Zendesk via ZendeskRecordSink

  • πŸ†• New Processors for working with Parquet: CalculateParquetOffsets, CalculateParquetRowGroupOffsets

  • πŸ†• FilterAttribute - new Processor for filtering attributes

  • πŸ†• PublishSlack - new Processor for publishing to Slack

  • πŸ†• PutZendeskTicket - new Processor for working with Zendesk

  • Handling improvements for versioning Diagrams

  • Small UI improvements:

    • Global search can be operated completely via shortcuts

    • Emptying queues no longer requires the dialog to be closed

    • If the "Enter" key is pressed in a single-line property, the display is immediately displayed in multiple lines

    • Some icons adjusted

  • Upgrade to IGUASU NiFi 1.25.0

Cloud

  • Backup of all relevant data via own operator

Documentation

  • New shortcuts added

  • Use of the NiFi expression language explained

  • Tutorial on the use of DynamoDB

  • Extension of the description for reuse

IGUASU 2.7

Releasedatum: 08.12.2023

Highlights

  • πŸ†• Ability to see which Diagram other users are currently editing

  • πŸ†• Upload your own bundles to easily extend the functionality or use a bundle in multiple versions

  • πŸ†• Display of the version of a bundle (in the case of multiple versions of a bundle)

  • Improved version of the hybrid cloud connection

    • Clustering on the client side is supported

    • Better error handling and error messages; consistent behavior; version check for future adjustments; etc.

  • Expression language support significantly expanded

    • Button to start active use

    • Clear display of functions and system variables

    • Display of attributes, e.g. if they are from previous versions are present in the data panel

  • πŸ†• ListenOTLP Processor for processing OpenTelemetry

  • πŸ†• EncryptContentAge and DecryptContentAge Processors to support the age-encryption.org specification

  • πŸ†• YamlTreeReader for processing YAML as records

  • πŸ†• PackageFlowFile Processor

  • Switch to Java 21

  • Upgrade to IGUASU NiFi 1.*24. *0

  • Saxon Update 12.2

Cloud

  • Use of the operator code base for the BPC project enabled; expansion of the deployment variants (e.g. in relation to the registry)

  • Logging adapted for use in Loki

  • Use of further own NARs or NARs in several versions enabled

Migration

  • Java 21 necessary

IGUASU 2.6

Releasedatum: 12.09.2023

Highlights

  • πŸ†• Many tables can be exported as HTML/PDF/CSV. For example, this applies to the list of licenses or Processors, but also to the audit log

  • The certificate management is now no longer only available for admins, but also for normal users. Editing, downloading and deleting is reserved for the admin

  • The results of the global search can be further restricted to provide clearer results. Processor colors and icons are displayed in the results for further clarity

  • Loading very large files in the Editor component and inserting or writing very large amounts of data in other components is prevented. This protects the system and the models, some of which would otherwise this protects the system and the models that would otherwise hold the data

  • Elements of the diagram can be dragged over the edges when creating/editing, whereby the diagram is then expanded in this direction

  • If changes have been made in the background in a module that is currently open, this is displayed when saving and you can decide whether to discard your own changes or overwrite the existing ones

  • πŸ†• There is a new Record Reader for reading Excel XLSX files

  • The Provenance table in Monitoring continues to show information in a file view

  • Saxon EE 12 now runs in TransformXml (XSLT) *.*2. When creating a new Processor, an initial XSLT is provided

Cloud

  • The certificate creation and distribution between IGUASU and the BPC is automated via (K8s) operators

Documentation

  • Extension of the hybrid cloud tutorial

    • Explanation of the technical background and the supported use cases

IGUASU 2.5

Releasedatum: 17.07.2023

Highlights

  • πŸ†• Collaboration

    • Display which other users are also currently using IGUASU

    • Display which other users are currently viewing or editing a process group

  • πŸ†• User settings

    • The layout, settings for display (e.g. help texts on/off) Help texts on/off) and preferences are saved and restored across logins

    • The last working position is restored

  • πŸ†• The JSONataTransformJSON editor now includes error marking and code completion

  • Minor improvements

    • When creating a relation, a detailed description of the relation is now displayed

    • Clearer configuration of the source of the XSLT in TransformXml and provision of a typical XSLT template at the start

    • Improved attribute creation and editing in the Data Panel

    • Improved handling when switching views in Processors with special editors (TransformXml, JSONataTransformJSON, ExecuteGroovyScript, …​ )

    • Adjustments to the content view in a queue are now retained when switching to another entry

    • RUN ONCE also works for Processors that are disabled

  • Processors

    • PutDatabaseRecord now supports upserts

    • πŸ†• GetAzureQueueStorage/PutAzureQueueStorage for Azure Queue Storage with the Azure SDK 12

    • πŸ†• ModifyCompression changes the compression of data without placing a heavy load on the Processor.

Cloud

  • SSL endpoints terminated in IGUASU can be configured by the IGUASU operator

  • High memory requirements of IGUASU no longer cause the application to restart

Migration

  • TransformXml - if a file or a lookup service was used as the source for the XSLT, this basic setting must now be selected once on the TransformXml

  • ListenCloud - the relation failure has been removed. Existing failure relations should be removed

  • In existing InvokeInubit/InvokeOnPrem and InvokeCloud Processors, the no longer supported property for asynchronous processing must be removed

Documentation

  • Description of the creation and use of certificates for hybrid cloud communication with INUBIT

IGUASU 2.4

Releasedatum: 23.05.2023

Highlights

  • πŸ†• The editor of the JSONataTransformJSON now supports JSONATA with syntax highlighting (error display and code completion are still open)

  • TransformXml outputs errors in XSLT as Bulletins

  • Speed optimizations in the UI

  • πŸ†• New MergeMetro Processor (in addition to GetMetro)

    • This not only takes over the content that is before the PutMetro Processor, but also merges it with the current content - this can, for exampleB. for XML or JSON

  • You can now search/filter in the BOM/list of licenses

  • You can now search for multiple terms in the list of Processors/Services when adding them

  • πŸ†• The Hybrid-Cloud Processors are now fully tested with INUBIT

    • ListenInubit, RespondInubit, InvokeInubit

  • Small improvements

    • Tooltips also on deactive buttons

    • The event table always selects the active event

    • Improved layout for user management/display

    • Dynamic properties can only be added if the Processor supports this, wenn der Processor dies auch unterstΓΌtzt

    • Die TestausfΓΌhrung von Processors ist auf die Processors eingeschrΓ€nkt, bei denen das Sinn macht

    • Geghostete Elemente, auf die man keine Rechte hat, werden beim Editieren berΓΌcksichtigt (sind erst gar nicht editierbar, kopierbar, etc)

    • Queues beliebiger Grâße werden jetzt in einem Rutsch komplett gelΓΆscht

Cloud

  • Registries anderer Bereiche kΓΆnnen nun auch in AWS verwendet werden (z.E.g. shared.virtimo.cloud)

Documentation

  • The necessary migration steps for local upgrades are fully described

IGUASU 2.3

Releasedatum: 12.04.2023

Highlights

  • πŸ†• Certificate management

    • Certificates can be uploaded for use in Services and Processors

    • Certificates can be generated and downloaded

  • Improvements in the UI

    • πŸ†• Support for the Expression Language as well as Parameters in the form of code completion, syntax highlighting and inline documentation

    • Filter option in the global search

    • Elements for which the user has no rights are now displayed ghosted and no longer completely hidden

    • Server-side copy & paste on the general text component

    • Tooltips are displayed earlier and rendered better

    • πŸ†• The Monaco Editor is supported and used in some cases Spaces at the end of the text component are no longer displayed.Partly used

    • Spaces at the beginning and end of a property are highlighted to avoid incorrect entries

    • The UI for Parameter Providers supports verification

    • The properties view adapts to smaller resolutions

    • Adaptation of some Processor icons

  • πŸ†• New Processors and Services

    • Processor for writing notifications to the BPC

    • Retrieving data from Asana

    • Interaction with Amazon Web Services: Polly, Textract, Translate and Transcribe

    • Sending data to Salesforce

    • Writing data to Apache IoTDB

    • Writing data to Google Drive

    • Writing data to Box

    • New Processors for encrypting and decrypting

    • Generating test data with the support of Records

Cloud

  • πŸ†• Support for Amazon EKS

    • The IGUASU Services (e.g. the Playground) on the Virtimo Cloud now all run on Amazon EKS

  • πŸ†• Kubernetes deployment of IGUASU via its own K8s operator

Migration

  • Some properties on the Processors and Services to the BPC have been renamed

Documentation

  • The ValidateJSON Processor is described in the JSON Tutorial

  • The NiFi documentation (e.g. for the description of the ExpressionE.g. for the description of the Expression Langauge) is deployed on https://docs.virtimo.net

IGUASU 2.2

Releasedatum: 08.12.2022

Highlights

  • πŸ†• New Processors and Services

    • List and retrieve data via SMB

    • Query data from Airtable

    • Use Azure Event Hub as a data sink via AzureEventHubRecordSink

    • List and retrieve data from Dropbox

    • List and retrieve data from Box

    • Retrieve data from HubSpot

    • Collect data from Workday

    • Retrieve data from Zendesk

    • Ingest data into Apache Iceberg

    • Ingest data into Snowflake using Snowpipe-Ingest data into Snowflake

    • UpdateDatabaseTable, which is very helpful when the schema of the data evolves and the tables being written to require DDL changes

    • Publish to MQTT using the Record mechanism, which is much more efficient and flexible

  • πŸ†• Pre-release of Hybrid Cloud Processors and Services for connecting INUBIT to the IGUASU Cloud(not yet ready for production!)

  • πŸ†• Use of various registry clients enabled

  • πŸ†• The full run of queues is now displayed directly in the diagram

  • πŸ†• New information on the Processor

    • Which attributes does the Processor read or write?

    • Can the Processor only be used in special roles (e.g. Admin) ("restricted")?

    • Which dynamic properties are expected and what do they do?

    • Does the Processor have a state?

    • Can the Processor have incoming connections or does it need them?

    • Does the Processor make particularly heavy use of certain system resources, e.g. MEMORY?

  • Registry

    • πŸ†• Use of our Bitbucket (Git) as a backend for versioning in the registry

    • πŸ†• Import and export of flows directly from the registry

  • Documentation

    • General revision

    • πŸ†• New tutorial for collaboration between IGUASU and the BPC

    • πŸ†• New tutorial for working with JSON

    • πŸ†• New how-to for the Metro Processors

    • The documentation is installed as before - but is also available together with the other documentation of the Virtimo portfolio at https://docs.virtimo.net/

Migration

  • Our own JSLT Processor has been removed, as there is now one with NiFi

IGUASU 2.1

Releasedatum: 16.08.2022

Highlights

  • πŸ†• Metro Processors added

    • Feature 1: Use of FlowFiles from previous steps in the flow

      • Example: The content of the FlowFile is the result of an external system, but you actually still need the result of three steps before. Otherwise, or in INUBIT, this can be solved by caching the content in variables or using a bypass

      • β†’ Using the metro from the previous Processor to the current one

    • Feature 2: Common error handling

      • There are no scopes in IGUASU (as in INUBIT, for example). If you want to solve errors on Processors directly via a "common thread", you have to draw many chaotic connections between the Processors

      • β†’ Use of the metro for common error processing

  • πŸ†• Audit Log - available in the Monitoring tab

    • Shows all changes to the configuration such as editing a Processor property, as well as the time and person

  • Parameters Support extended

    • Controller Services can be assigned to parameters (currently using the ID) and then used normally on properties. This allows Controller Services (e.g. access to databases via DB pool services) to be decoupled even better

    • The scheduling (when and how often a Processor is executed) can be set via Parameters. This means that, for example, scheduling can be slowed down or increased for a group of specific Processors

  • Upgrade to IGUASU NiFi 1.17.0

  • Dynamic properties can now also contain sensitive values (e.g. passwords) if the Processor supports this (e.g. header values to InvokeHT). Header values to InvokeHTTP)

  • Detailed metrics for CPU consumption at Processor level

  • πŸ†• New Processor allows queries on data coming from Salesforce

  • πŸ†• New ConsumeTwitter Processor replaces the previous GetTwitter and uses the current Twitter API

  • πŸ†• New Processor to access files on Google Drive

  • HTTP/2 support (ListenHTTP, HandleHttpRequest)

Cloud

  • Java 17

  • AWS/EKS Support

IGUASU 2.0

Releasedatum: 22.06.2022

Highlights

  • πŸ†• New display for Bulletins/Errors

    • The icon for the Bulletins has been moved to the header

    • There is a new central panel that is displayed prominently as soon as Bulletins are available

    • Bulletins for Processors, Services and Reporting Tasks as well as System Bulletins are displayed

    • Services and Reporting Tasks with errors are also highlighted in red

    • Bulletins and the error status ("red") are displayed. the error status ("red Processor") is no longer necessarily displayed for 5 minutes, but can be deleted by the user

  • πŸ†• There is a new central tree view of all Process Groups

  • πŸ†• The available Processors or Services are displayed in the system information

  • πŸ†• A configurable retry on the outgoing relations is now supported on the Processors

  • πŸ†• Selected elements can now be moved directly to Process Groups using the mouse. They can also be moved to any Process Group via the context menu

  • πŸ†• A list of the software components used with their licenses is now offered

  • Properties that configure Services can now be created directly. The Process Group on which the Service is to be created can be selected

  • If Parameter Contexts are changed on Process Groups, this is now done via a dialog that displays the necessary operations such as stop/start etc. and the result

  • πŸ†• Processors can now also be verified - this is used, for example, to check whether a configured system is accessible

  • The documentation is now displayed in the same way as on docs.virtimo.net; it can also be searched

  • JSONataTransformJSON can now also write the output completely to an attribute

  • πŸ†• PutBPCAuditLog Processor

    • For easy writing of entries in the BPC audit log

  • PutBPCProcessLog Extensions

    • After configuring the associated BPC, the BPC logger can be selected directly from a list of available loggers

    • If there are already entries in the log, the first entry can be queried as a template for creation

  • ListenBPCFlowStarter Extensions

    • You can now configure the name and description, which can then be seen in the selection in the BPC

    • The BPC session (complete JSON) can optionally be loaded into an attribute for further use in the flow, be loaded into an attribute

  • With a corresponding UUID, you can jump to execution instances within IGUASU - this is used from the BPC, for example

  • Extensions to XmlMerge

    • All attributes can now be taken from all branches

    • It is now possible to prevent additional root tags from being added if they already exist

  • Apache NiFi raised to 1.16.3

  • JSONataTransformJSON can now also be executed on attribute values or an empty JSON

Migration

The functions provided by IGUASU in the JSONataTransformJSON Processor have been renamed to distinguish them from existing or custom functions.

  • $uuid()$nfUuid()

  • $el(<el>)$nfEl(<el>)

  • $attribute(<name>)$nfGetAttribute(<name>)

  • $attribute(<name>, <value>)$nfSetAttribute(<name>, <value>)

  • $lookup$nfLookup(<key>)

IGUASU 1.7

Releasedatum: 09.02.2022

Highlights

  • πŸ†• New Virtimo theme (coordinated with BPC 4 and inubit 8)

    • Basically, the use of different themes was made possible

  • πŸ†• New, optional table view for attributes in all corresponding places in Flow

  • Filter option for attribute views

  • πŸ†• Extensions to parameters and Parameter Contexts

    • Inherited Parameter Contexts are supported

    • New parameters can be created directly from existing properties

    • Parameter Contexts can be protected via rights

    • All Process Groups that use a Parameter Context can be viewed

    • The parameters of a context can be edited directly in the Process Group

    • Import and export of Parameter Contexts

  • Comments to Controller Services are supported

  • πŸ†• JSONataTransformJSON now supports lookups

  • The rights to Process Groups can be explicitly inherited or overwritten

  • The descriptions of the flows are now available everywhere during versioning

  • πŸ†• Use of the Virtimo Keycloak in the cloud (currently on dev.virtimo.cloud)

    • The registry now also uses Keycloak

  • Display of version information on IGUASU in the system diagnostics

  • Consistent read-only mode in production mode

    • This means that change operations must always be carried out explicitly

  • πŸ†• Deep links are supported across logins

    • A unique link can be retrieved for each Processor

  • New keyboard shortcuts for the global search and overview

  • New variant of the TextEditor (no more memory leaks)

  • πŸ†• New how-to section in the documentation

    • Display and descriptions of frequently required functions in the flows

    • Provision of importable Process Groups for clarification and testing

  • πŸ†• Drivers, such as JDBC database drivers, can now be uploaded and selected directly where necessary

Migration

  • In the TransformXml Processor, the JSON is now additionally surrounded by a CDATA tag when using 'Surround input with <xml> tag' so that entity references such as '&' do not cause any problems.Such as '&' do not cause any problems. If the CDATA has already been added manually, it must be removed again.

IGUASU 1.6

Releasedatum: 6. Dezember 2021

Highlights

New/extended Virtimo Processors

  • πŸ†• Processor PutBPCProcessLog, for logging process data to a Virtimo Business Process Center

    • BPCController Service for reusable configuration of the BPC endpoint

  • πŸ†• Processor, to easily call flows from the Business Process Center: ListenBPCFlowStarter

    • BPCListenerController Service for defining the central endpoint for various Listener Processors

    • ListenBPCResponder Processor for controlled response

  • πŸ†• Processor for mapping/transforming JSON based on JSONata: JSONataTransformJSON

    • Use of the Expression Language is supported

    • Reading and writing of attributes is supported

    • Possibility of a live editor - every change is directly visible

  • πŸ†• Saxon EE is included for the TransformXml Processor

  • πŸ†• New ModifyPDF Processor to fill form fields in PDFs

  • πŸ†• New Minifier Processor to automatically provide the YAML of a Process Group for the Remote Flow. This allows a remote flow to automatically obtain new versions of its configuration

General update

  • UI update with a lighter appearance

  • πŸ†• Central Provenance, in which the past executions of all flows are visible

  • πŸ†• Central monitoring of all components used

  • πŸ†• Global search

    • Free text search in all available components, as well as jump to the component

  • Extension of the Services user interface:

    • Links to Processors and other Services in both directions

    • Activate/deactivate all Services of a group, as well as the subgroups

    • Display of the affected, linked components, as well as the success of the action for each component

  • πŸ†• Save/load and copy/paste input data+attributes in the Content Panel and Queue

    • This allows any previously flowed data to be easily used for the test execution of other Processors

  • Selected modules can now also be moved in the Diagram using the cursor keys (together with Shift pixel by pixel)

  • To create modules, they can now be dragged and dropped directly from the toolbar into the Diagram

  • All relations of a new Processor are now auto-terminated by default. Already connected relations can no longer be selected here. When creating a new relation, you can see which relations already have connections

  • πŸ†• * Replaying* an event ("Replay") is now supported

  • In the documentation, all existing documentation is now always displayed as an overview (User Guide, Admin Guide, etc.).)

  • Process Groups can be released for individual user groups

  • A hanging Processor that can be terminated now makes this clear directly in the UI

  • πŸ†• Display of the server’s system diagnostics (JVM, hard disk, etc.)

  • πŸ†• Process Groups can now be downloaded as JSON. This JSON can then be used when creating new Process Groups

    • Templates are no longer supported, as this feature is available via the JSON and the use of the registry/versioning

  • πŸ†• A Process Group can be downloaded as YAML for use in Remote Flow

  • πŸ†• the registry users can be imported from the current IGUASU

  • πŸ†• Backpressure-Default can be configured specifically for individual Process Groups

  • πŸ†• Run Once to start a Processor/Flow once

  • Parameters can also be used on sensitive properties (passwords)

Operation

  • πŸ†• IGUASU now always runs securely (initially in single-user mode)

  • Optimization of the start scripts (e.g. through new iguasu-env.sh, which contains the Java used, for example)

  • Upgrade guide added to the administration manual

Components

  • πŸ†• NiFi Server 1.15.0 integrated (previously 1.13.x)

Cloud

  • πŸ†• Client/server authentications are now supported for HTTPS with the cloud

Migration

  • Since IGUASU now initially runs in single-user mode, the user must be set with his password before the first start (see Setting up single user authentication)

  • As templates are no longer supported, all templates that are not available as process groups in the IGUASU to be migrated should be imported before the migration. After the migration, they can then be exported as JSON and removed again if necessary

  • Starting, stopping etc. the Processors (or entire Process Groups) is now only possible via the context menu - the buttons in the toolbar have been removed

IGUASU 1.5

Releasedatum: 19. Juli 2021

Highlights

Versioning

Provision and support of the * πŸ’₯IGUASU registry πŸ’₯*

  • πŸ†• Versioning of flows (at process group level)

    • Start/stop versioning of a flow

    • List and check in/check out versions

    • Create a new instance of a versioned flow

  • πŸ†• Reuse (of functions encapsulated in process groups) by using versioning

  • πŸ†• Display of local changes

    • Marking in the diagram

    • List of changes with jump to the component

    • Display of changes in sub-groups

  • πŸ†• Use of any number of different registries and buckets in the flows

  • πŸ†• Management of registries including users, groups and buckets

Cloud

  • πŸ†• Provision of Prometheus-based monitoring in the cloud

  • πŸ†• Optimized liveness/readiness probes for IGUASU in Kubernetes

  • Storage configurations

General

  • improved clipboard operations (cut and arbitrary paste)

  • Better synchronization of diagram and module editor during changes

  • Display of the executions of a Processor extended

    • Complex execution lines are only loaded in parts

    • It is also possible to load only the data of the events of a single Processor (without the complete execution of the flow)

  • XmlTransformer (XSLT): Resolving external references (e.g. DTDs) disabled.E.g. DTDs) can be switched off

  • Documentation: Tips for operation and optimization of flows added