Release Notes

This document lists highlights, important fixes and necessary migration steps for the versions.

IGUASU 4.0

Release date: 01.12.2025

Highlights

  • 🆕 Public release of the Rio AI Assistant

    • Rio is familiar with IGUASU and answers questions about the product or the implementation of solutions. The answers contain specific source links to the documentation.

    • Examples of this would be "How can I version a process group?" or*"How can I split a JSON and then send these parts to a REST Service?"*

  • 🆕 Generation of flows by Rio

    • Rio generates complete flows from the description of a scenario

    • A simple example of this would be "Create a REST endpoint that returns 'Hello world'". Within this description, configurations or requests for mappings can be integrated from one JSON to another, for example.

  • 🆕 New AI Processors in the flows

    • PromptVertexAI - using Vertex AI, to process requests via the many LLMs provided there

    • CreateVertexAIEmbeddings - Use of Vertex AI to create text embeddings for texts via the embedding models provided

    • SearchQdrant/UpsertQdrant - Interaction with the vector database Qdrant for the implementation of RAG solutions

    • ListenLLMTool/RespondLLMTool - Provision of tools for LLMs, which are called up via PromptVertexAI

  • 🆕 New Security Cockpit

    • Traffic light status for the system’s security-relevant configurations directly in the header

    • Based on Flow Analysis Rules and system up-to-dateness (pending updates)

    • Easily expandable with additional rules

  • 🆕 When importing an existing Parameter Context, a new dialog compares the parameters in the existing/imported parameter context and lets the user decide which parameters should be adopted

  • 🆕 Overview of all versioned flows in the Monitoring Process Groups. This is an extension of the previous view and provides filter options via the versioning status, the registry, the branch, the bucket and the name and description

  • 🆕 Endpoint management allows bulk operations. Several endpoints can be edited, deleted or created - the changes are then carried out together

  • 🆕 The system information now also contains the Management Services, Reporting Tasks and Flow Analysis Rules in addition to the available Processors and Services. For all these components, you can see which are used on the current system and how often.

  • 🆕 The metro processors have been reimplemented with a special focus on throughput and low latency

    • From the provenance events, you can now jump in both directions to the associated execution line or execution event. the execution event

  • 🆕 If you have processors in different versions (e.g. via correspondingly uploaded NARs), you can set the versions of individual Processors or even entire Process Groups to the new or old version.

    • This can be used in particular to test new versions on a development system while you still have the option of continuing development on other flows with the old version for the production system

  • 🆕 Certificate management now also supports PEM files

  • Minor UI improvements

    • A visual grid is now available in the editing mode of the flows

    • The shortcuts in IGUASU in general and in the text editor component have been revised and simplified - basically with Control (Windows/Linux) or Command (Mac) and an additional button

    • The Preview of the Expression Language Evaluations of properties can now be easily transferred to the clipboard

    • The metrics at Processor/Process Group are rendered with a suitable layout and information in thousands (K) even with large values

    • Rendering*and wrapping* of element names in the diagrams improved

    • Further setting options are saved per user, such as the view of attributes as a table or tags

    • Parameters can now be set even more conveniently*on properties* using the keyboard and either set completely or inserted in place of the cursor

    • The view of local changes is even clearer and long texts can be selectively wrapped

    • In the Provenance view in Monitoring, filtering by events has been improved

    • If you switch to the IGUASU tab, the view of the diagram is updated, the Diagram view is updated

    • The last search is remembered

    • The view of certificates, drivers and custom NARs supports filters

    • When changing versions, the paths to the Process Groups (especially the other instances) are displayed

    • The welcome tour has been updated

    • In the Diagram, you can now use the keyboard to select two grid steps, move one grid step or one pixel

    • The settings of the Retries on Processors are dependent on the settings on the relations and are therefore often more compact

Breaking Changes & Migration

  • MergeMetro has been removed; the functionality can be achieved via MergeContent with more options and more flexibility

  • The defaults of the Metro processors in relation to Run Duration and Penalty Duration have partially changed. It may be useful to check the new defaults for existing processors.

IGUASU 3.7

Release date: 01.10.2025

Highlights

  • 🆕 New UploadTestFile processor: Flows can be started directly with a file that is uploaded to the processor. This makes testing and developing flows even easier.

  • PutMetro allows you to set a "Run Duration" and also transfers the attributes set via Dynamic Properties to the output. This allows the use for e.g. logging - even under heavier load.

  • Attributes in the Data Panel: It is shown more clearly which attributes came from the input, which were added and which were changed. The copying and saving of data consistently distinguishes between input and output.

  • ArrivalGate improvements:

    • A "Run Duration" can be set to process more FlowFiles under high load

    • The outputs from Process Groups, Input Ports and Funnels are displayed more clearly and the relations are visible/invisible accordingly

  • When creating a new Process Group from the registry, the flows can be filtered

  • 🆕 Process Groups that are not versioned can now be set to an already versioned Process Group. If this Process Group has already come from this versioning before, references of existing components are used correctly, otherwise all changes are local.

  • Git based repositories support new strategies for storing Parameters

  • Parameter Contexts improvements:

    • Parameter Contexts can be hidden

    • It becomes clear, when Parameters are overwritten and the overwritten values can be easily removed

  • Minor enhancements in the UI

    • The preference for the display in the editor component - i.e. whether JSON/XML should be displayed as a tree or as text - is now remembered

    • Users can set a different favicon (icon in the browser tab) for each instance - this makes it easier to distinguish between different IGUASU instances

    • The editor component allows the editor to be maximized in all places, to be able to edit longer texts comfortably

    • All icons of the product are now kept in a consistent style

    • The layout of the commit dialog has been improved and optimized for the Git-based repositories

    • Parameters can also be created from sensitive properties (then only the name is set)

    • Deprecated Processors are now already marked accordingly in the selection dialog and also in the settings

    • Versioning display: The registry view is remembered; overlong commit messages are shortened

    • If the Services have WARN/ERROR messages, this is also displayed in color directly on the Services

    • From the JSON tree, the node can be dragged into the JSONata editor to get the absolute JSONata path; from the XML tree, the node can be dragged into the XSLT editor to get the absolute XPath

  • New metrics for the Processors in the status history (e.g. for CPU usage)New metrics for the Processors in the status history (e.g. for CPU usage).E.g. for CPU usage)

  • BPC*5* is supported

  • New JSONata function for reading all attributes (e.g. to iterate over them) : iterate over them): $nfGetAttributes()

  • ListenWebSocket can read the HTTP-Request-Headers of the connection setup as attributes in the flow

  • ExecuteGroovyScript now also supports sensitive dynamic properties

  • The ExcelReader now supports binary XLS

  • The Kafka processors now support now support SASL/OAUTHBEARER

  • Refactored SFTP Processors from SSHJ to Apache MINA SSHD

Cloud

  • Pre-installed Parameters Contexts for using the IGUASU NiFi REST API

  • The file size limits in the editors - z.E.g. in the input/output panel or the queues have been increased - so larger files are displayed in full

Fixes

  • The Git-based registry now supports paging - previously you could only see the first 10 flows

Breaking Changes

  • The format of the downloaded ZIPs from the Data Panel has changed

Known issues

  • Invalid Processors that try to start cannot be stopped individually. Workaround: Stop the entire Process Group.

IGUASU 3.6

Release date: 07.07.2025

Highlights

  • 🆕 Versioning: Operations on all instances used

    • When committing a version, as well as when changing versions, the system checks where this flow is still instantiated on the system. These flows can then also be set to the desired version

  • 🆕 Bulk replay

    • In the Provenance of the monitoring, you now have the option of having any number of processor events executed again (previously this was only possible directly on an event in the Provenance, which is displayed directly on the processor)

    • It can be filtered and/or selected directly

    • The events can be executed individually or all at once

  • 🆕 Linked metro executions

    • From the execution eventsof a GetMetro, ExitMetro or MergeMetro, you can* jumpto the corresponding event* of the associated PutMetro. This makes it possible to track the executions across the use of the metro

  • If you jump to the processor via the link on a Bulletin, the associated execution is displayed with the provenance data if all the necessary information is available in the Bulletin

  • The AI Assistant can now also "think" for longer, to solve more complex tasks

  • The endpoints in the management are now fully editable with all fields

  • The versioning UI has been optimized for the use of BitBucket (with regard to requests that sometimes take much longer)

  • Minor changes in the UI

    • The IGUASU updates are now sorted in the selection box as well as in the history with the most recent at the top the most recent at the top

    • Additional details and use cases from the processors now always link to the general documentation

    • The ArrivalGate settings can be sorted and the links are clearer

    • Attributes in the execution data display are now specifically differentiated into incoming and changed/deleted attributes

    • On the processors, have restrictions, a corresponding icon is displayed both in the Diagram and in the settings Icon is displayed both in the diagram and in the settings

    • Slightly revised theme in light and dark

  • The WebSocket processors now allow an idle timeout to be set, and a ping on the server side as well as closing sessions via PutWebSocket

Fixes

  • MergeMetro had no output relations

  • JSONataTransformJSON no longer displayed syntax errors

  • The debug/test execution of the JSONataTransformJSON failed under certain conditions

IGUASU 3.5

Release date: 21.05.2025

Highlights

  • 🆕 There is a new*'Dark Theme*' - this allows you to choose between light, dark and the system/browser setting

  • 🆕 Bitbucket repositories can be used as IGUASU registries

  • 🆕 New Flow Analysis Rules

    • PropertyNeedsParameter - enforces the use of parameters on defined properties. In staging scenarios, this can prevent errors that can occur if the configuration is forgotten via Parameter contexts for the various stages

    • RestrictBackpressureSettings - prevents unwanted backpressure settings that do not match the desired system behavior

  • 🆕 Open execution sequences from queue - Starting from a FlowFile in a queue, you can view the provenance across the Diagram. If you open a queue for an active execution sequence, the associated FlowFiles are marked

  • FetchBPCProcessLog and DeleteBPCProcesslog now also support complex queries

  • Improvements to status changes

    • Disable/Enable all Services in process groups is now tidier and faster

    • If groups with subgroups are changed, you are now prompted and can choose whether the subgroups should also be adjusted

  • The recording of a larger number of parameters is now possible larger number of Parameters is now easier and faster

  • The order/prioritizer of the queue is displayed directly on the queue

  • The local/test execution is now also active for admins on productive systems

  • TransformXml can now also transfer its own temporary attributes from the content when using the EL

  • IAM authentication is supported for AWS MSK (Kafka)

  • 🆕 New OAuth 2.0 Controller Service to support the JWT Bearer Flow

  • Upgrade to IGUASU NiFi 2.4

Cloud

  • The restart of the IGUASU server component has been greatly optimized. This further reduces the short downtime during the update

  • Use of different networks or VPNs configurable via the operator

  • The IGUASU gateway can now also use a proxy server for hybrid connections to the cloud

IGUASU 3.4

Release date: 08.04.2025

Highlights

  • 🆕 IGUASU Gateway

    • The IGUASU Gateway artifact (as a connection component to the on-prem world if no INUBIT is available) is now generated with every new version of IGUASU

    • The GatewayFlowProvider Service allows any flows from IGUASU to be provided for an IGUASU Gateway. This provides the gateway with an auto-update mechanism for the flow running on it. This allows developments or changes to be brought to the gateway or tested in a very user-friendly and secure way.

  • 🆕 The new ArrivalGate processor is used to create connections (to it) that are only visible in the Diagram if it or the source processor is selected. This allows aspects to be mapped that do not follow the original flow of this process. At the same time, processing via the queues etc. remains the same as always. This can be useful , for example, for joint error processing of processors at very different points in a flow.

  • Extended versioning area in the UI

    • The panel is now located at the bottom of the Diagram and is wider

    • 🆕 If you select a version, you can see directly what has changed in this version compared to the previous one

    • 🆕 The changes from version comparisons are shown with a purple border in the Diagram and are therefore visible together with the local changes

    • 🆕 Version comparison changes can now be navigated in the same way as local changes - subgroups are also taken into account

    • The display of changes has been optimized

    • Changes that relate to Parameters are highlighted

  • Diagram extensions

    • 🆕 Copy-and-paste in the diagram now works via the browser clipboard and thus also across stages, for example 🆕 Copy-and-paste in the diagram now works via the browser clipboard and thus also across stages. For example, across stages

    • 🆕 It is now possible to use the lasso for selections within Labels that are used as frames

    • 🆕 Vertices can now also be selected and removed individually. (double-click or menu)

    • Enlarged workspace in edit mode allows faster downward/rightward expansion of the flow

  • Extensions for updating in the cloud

    • 🆕 The version history of the installed versions is displayed (starting with this version)

    • 🆕 The available updates show which components are affected and where there will be downtimes during the update

  • JSONata*extensions*

    • 🆕 New, optimized implementation as a new default - a 1:1 implementation of the JavaScript reference implementation

    • The transformation can be applied directly to a string - this is converted into the value of a simple JSON structure

    • When a string is output as the result of the transformation, the surrounding quotation marks can be removed

  • It is now possible to disable/enable all Services in a process group and all others in the hierarchically lower ones directly and with much better performance

  • Direct navigation from the BPC processors to the log services in the BPC (in addition to the option of navigating from an execution event to the log service ), jump from an execution event to the entry in a monitor)

  • Improved keyboard operation (tab) in the properties/settings

  • The browser’s forward button is now consistently supported

  • 🆕 New processors for communication with the box.com cloud service: ConsumeBoxEvents, FetchBoxFileRepresentation, ConsumeBoxEnterpriseEvents, FetchBoxFileInfo, GetBoxFileCollaborators, GetBoxGroupMembers

  • Extension of the ConsumeGCPubSub with Record and Dermarcator

  • 🆕 New GetS3ObjectTags processor to get S3 object tags

  • The Elasticsearch processors allow the use of JWT Auth

  • Upgrade to IGUASU NiFi 2.3

Migration

  • Some components have changed or extended properties - this is migrated automatically, but leads to local changes if the associated flow is versioned. This applies to the JSONata processor, for example, as well as to the Hybrid Cloud and BPC Services.

IGUASU 3.3

Release date: 03.02.2025

Highlights

  • Parameters can now be changed much more easily in production mode without having to stop components manually

  • 🆕 All elements show when the last change was made and by whom. From there, you can also jump to the audit log for this component, where you can view further changes.

  • Auto-layouting enhancements

    • The positions of the connections remain stable during the layouting of selections

    • Greatly improved layouting of elements that do not belong to a graph

    • Improved layouting through higher evaluation of longer branches

  • You can jump directly from the execution event of a BPC Processor to the corresponding entry in the BPC Monitor

  • 🆕 New Flow Analysis Rules: SystemSafeguard, which prevents misconfiguration of the InvokeHTTP processor, which could lead to a load on the system, and RestrictBackpressureSettings, which checks the backpressure settings

  • 🆕 Bulletins can be downloaded directly from the tables

  • In the text editors, the option to search, undo and redo is now also offered via buttons in the toolbar

  • Parameter Contexts can be filtered

  • The IDs of the components in the management area are now also displayed

  • 🆕 With the PEMEncodedSSLContextProvider, PEM encoded keys and certificates are supported

  • 🆕 There is the new StandardDatabaseDialectService for even better work with different SQL databases

  • Upgrade to IGUASU NiFi 2.2

Documentation

  • 🆕 The documentation now contains all existing processors, Services, tasks, etc. with their descriptions, setting options, etc. with their descriptions, setting options, notes and restrictions

  • 🆕 The documentation now also contains direct references to the Expression Language and Record Path

Important fixes

  • The bug that a keystore always had to be specified in SSLContextService has been fixed

  • Outgoing success connections from the PutMetro can be created again

  • If the management window is exited, settings are no longer lost if they were not explicitly saved

IGUASU 3.2

Release date: 11.12.2024

Highlights

  • 🆕 The documentation is now also available in English (automatically translated with DeepL)

  • 🆕 Multiple ingresses are now supported in the cloud, so that external addresses can be switched via different paths and VPNs. This is fully supported by the UI

  • For processors that are uploaded via NARs or created as new Python processors, the full description is now also displayed

  • Parameters can be filtered

  • If a new process group is created, the Parameter Contexts of the parent group is set directly and can also be adjusted directly here

  • JSON*Lines* (https://jsonlines.org/) are supported in the displays

  • The AI Assistant allows feedback on the answer as well as longer questions

  • The auto-layout of selections retains the position of the processors in relation to the top left corner and can also be accessed via the context menu

  • Labels now also have a "Send to back" to set Z-position in relation to other labels

IGUASU 3.1

Release date: 27.11.2024

Highlights

  • 🆕 AI Assistant (Technology Preview) - questions about IGUASU can be asked, the answers are based on the documentation

  • 🆕 Use of GitHub repositories as IGUASU flow repositories in our cloud installations

  • Memory leaks in the UI have been fixed

  • The maximum time a Processor can spend in Retry with the set Retry configurations is calculated and displayed

  • New Processors and Services

    • CopyS3Object, GetS3ObjectMetadata - get metadata from S3 and copy files between buckets

    • DeleteSFTP - allows files to be deleted on an SFTP server

    • HttpRecordSink - allows record sinks to be sent to any HTTPS address

  • Upgrade to IGUASU NiFi 2.0

Cloud

  • 🆕 UI updates can be executed without user interaction

  • 🆕 Several different networks and VPNs can be connected

Migration

  • DistributedMapCacheServer has been renamed to MapCacheServer

  • DistributedSetCacheServer has been renamed to SetCacheServer

  • DistributedMapCacheClientService has been renamed to MapCacheClientService

  • DistributedSetCacheClientService has been renamed to SetCacheClientService

IGUASU 3.0

Release date: 09.09.2024

Highlights

User interface

  • 🆕 Diagram innovations

    • The diagram can be moved by holding down the middle mouse button

    • The diagram can be zoomed by Control + scrolling the middle mouse button (the same applies to pinch/zoom on trackpads)

    • Zooming via the toolbar is now possible at a finer granularity

    • Success and failure*ports* can now*be selected and Failure Ports* can now be connected directly from the Processors

    • The Ports have tooltips with descriptions

    • New Processors can be created directly when creating outgoing connections

    • Connections from and in Process Groups now show the name and status of the Port

    • Revised display of the icons in the Process Groups modules

  • 🆕 Management

    • New, integrated display of the various central settings and services (no longer distributed in the menu)

    • Endpoint Management - Endpoints can be shared externally and mapped internally to Ports and thus Processors and Services. These endpoints can be viewed, extended and managed.

    • Database drivers, certificates and own Processors/Services can be exported and imported

  • 🆕 Visual tree representations and editors for JSON and XML in all places where data can occur in these types

    • Complete editing of the data in the model as well as XPath or JSONata queries JSONata queries

  • 🆕 New view of Services as part of the Diagram (no longer in the Process Groups Settings)

    • The Services now have individual icons like the Processors

  • 🆕 New, graphical dashboards

    • for central metrics in System Information (memory, threads, hard disk, etc.) to Processors and Processes.)

    • to Processors and Process groups with information about the executions

  • 🆕 Support of rules for analyzing flows

    • In the first step, there is the possibility to prohibit the use of individual Processors or to warn during use

  • Redesigned view of the Connections with division of the areas for configuration and the displays of the queue during runtime

    • 🆕 Relations can now be added and removed directly in the configuration

    • 🆕 The data in the queue can also be displayed by date of receipt

  • Improved Processor configuration

    • Dynamic properties now have their own area and can be added directly, without dialog and thus also in bulk, and renamed directly inline

    • 🆕 New use case descriptions on various Processors, also in interaction with other Processors

    • 🆕 Associated Processors are displayed and can be dragged directly from here into the Diagram (for example, the associated HandleHttpResponse is displayed for a HandleHttpRequest)

  • 🆕 New interface element for multiple selection

    • Selected prioritizers on Connections

    • Relationships on Connections

    • Permissions - e.g. on process groups 🆕 New use case descriptions on various Processors.E.g. on process groups

    • Selection of multiple values for filters in monitoring

  • 🆕 Display of the number of Bulletins on the icon when the Bulletins view is inactive

  • Monitoring

    • The selection and display of times in the monitoring filters has been simplified and visually improved

    • 🆕 It is now also possible to filter on a component in the audit log and the provenance events. The component can be taken from the selection in the Diagram or the currently selected Row

    • The flowed data can be loaded directly from the general Provenance Events - the execution view can also be activated in the Diagram

  • Further news in the UI

    • 🆕 Avatar images from federated IDMs such as Google are now supported.Avatar images from federated IDMs such as Google are now supported

    • Revision of the central toolbar, as well as access to hidden elements

    • Orange is now consistently used as a marker on action buttons and menus to make it clear that the action has/can have a direct influence on flow executions.

    • The dialog for adding new Processors is now very easy to use with the keyboard via the arrows and the tab

    • The items in the Services and Flow trees have tooltips so that you can read the entries, if the tree is too narrow

    • Messages about the content limits of fields now only appear when they are exceeded

    • The mouse pointer makes the possible actions on buttons and elements in the diagram even clearer

    • The evaluation of the expression language on the properties shows the usable scope

    • The language support 'nifi' for using the expression language suggestions is no longer explicitly available in the text editor. These can now be used directly in 'text' mode

    • The text editor now also supports Parameters in the properties

Virtimo Portfolio

  • An even better integration between IGUASU and the BPC:

    • 🆕 From the execution information of a flow in IGUASU (Provenance) you can jump directly to the entry in the BPC

    • 🆕 From an entry of a monitor in the BPC, which was created by a flow in IGUASU, you can jump directly to the execution instance in IGUASU

  • 🆕 New Processors FetchBPCProcessLog and DeleteBPCProcessLog

Execution

  • 🆕 [BETA] New stateless execution model on process groups

  • 🆕 New Processors

    • DeleteFile, SpliExel, PackageFlowFile, EncryptContentAge, DecryptContentAge, ListenSlack, ConsumeSlack, ListenOTLP, CalculateParquetOffsets, CalculateParquetRowGroupOffsets, FilterAttribute, PublishSlack, PutMongoBulk, PutAzureDataExplorer, PutZendeskTicket, SplitPCAP, SplitExcel

  • 🆕 New Services

    • BPCRecordSink, YamlTreeReader, StandardKustoIngestService, ZendeskRecordSink, ProtobufReader

  • 🆕 New Schema Registries

    • AmazonGlueSchemaRegistry, StandardJsonSchemaRegistry, ApicurioSchemaRegistry, DatabaseTableSchemaRegistryService

  • 🆕 New Parameter Provider

    • OnePasswordParameterProvider

  • 🆕 [BETA] Support for Python as the language for developing Processors. First new Processors for the implementation of Retrieval-Augmented Generation in the AI environment (RAG):

    • PromptChatGPT - send queries to OpenAI ChatGPT

    • QueryChroma, PutChroma - use of the Chroma vector database

    • QueryPinecone, PutPinecone - use of the Pinecone vector database

    • QueryOpensearchVector, PutOpenSearchVector - use of OpenSearch as a vector database

    • QueryQdrant, PutQdrant - use of the vector database Qdrant

    • ChunkDocument - splits documents for use as embeddings

    • ParseDocument - parsing of unstructured text documents, as well as OCR on PDF and images in "json-lines" (data and metadata) for use as embeddings

Upgrades

  • Our Processors and Services for communication with INUBIT and the BPC now use Jetty 12

  • Upgrade to IGUASU NiFi 2.*0. *0M4

Cloud

  • Updates from IGUASU can now be installed by the user and time-controlled (for 3.0 final)

  • There is the new standard group viewer - users in this group cannot change/start etc. anything in the system but can only view it There is the new standard group viewer - users in this group cannot change/start etc. but can only view it. but only view

  • There is an area in the file system that can be used for Services/Processors that require this and also ends up in the backup

  • GitHub can now be used directly as a repository

Migration

  • Many outdated or functionally duplicate components have been removed. The complete list can be found here. These include possible alternatives

    • Base64EncodeContent → EncodeContent

    • ConvertAvroToJSON → ConvertRecord

    • ConvertExcelToCSVProcessor → ExcelReader

    • CryptographicHashAttribute → UpdateAttribute

    • EncryptContent → EncryptContentAge/EncryptContentPGP

    • FetchElasticsearchHttp -→ GetElasticsearch

    • GetHTTP, PostHTTP → InvokeHTTP

    • GetTwitter → ConsumeTwitter

    • HashAttribute → CryptographicHashAttribute

    • HashContent → CryptographicHashContent

    • PostSlack → PublishSlack

    • PutElasticsearchHttp → PutElasticsearchJson

    • PutElasticsearchHttpRecord → PutElasticsearchRecord

    • PutSlack → PublishSlack

Documentation

  • If a Processor or a Service is described in more detail in the User Guide or in a tutorial, this is now linked directly to the component

  • Restructured and supplemented with new features and adjustments

IGUASU 2.8

Release date: 05.02.2024

Highlights

  • 🆕 Records can be easily written to Zendesk via ZendeskRecordSink

  • 🆕 New Processors for working with Parquet: CalculateParquetOffsets, CalculateParquetRowGroupOffsets

  • 🆕 FilterAttribute - new Processor for filtering attributes

  • 🆕 PublishSlack - new Processor for publishing to Slack

  • 🆕 PutZendeskTicket - new Processor for working with Zendesk

  • Handling improvements for versioning Diagrams

  • Small UI improvements:

    • Global search can be operated entirely via shortcuts

    • Emptying queues no longer requires the dialog to be closed

    • If the "Enter" key is pressed in a single-line property, the display is immediately displayed in multiple lines

    • Some icons adjusted

  • Upgrade to IGUASU NiFi 1.25.0

Cloud

  • Backup of all relevant data via own operator

Documentation

  • New shortcuts added

  • Use of the NiFi expression language explained

  • Tutorial on the use of DynamoDB

  • Extension of the description for reuse

IGUASU 2.7

Release date: 08.12.2023

Highlights

  • 🆕 Ability to see which Diagram other users are currently editing

  • 🆕 Upload your own bundles to easily extend the functionality or use a bundle in multiple versions

  • 🆕 Display of the version of a bundle (in the case of multiple versions of a bundle)

  • Improved version of the hybrid cloud connection

    • Clustering on the client side is supported

    • Better error handling and error messages; consistent behavior; version check for future adjustments; etc.

  • Expression language support significantly expanded

    • Button to start active use

    • Clear display of functions and system variables

    • Display of attributes, e.g. if these are taken from previousE.g. from previous versions in the data panel

  • 🆕 ListenOTLP Processor for processing OpenTelemetry

  • 🆕 EncryptContentAge and DecryptContentAge Processors to support the age-encryption.org specification

  • 🆕 YamlTreeReader for processing YAML as records

  • 🆕 PackageFlowFile Processor

  • Switch to Java 21

  • Upgrade to IGUASU NiFi 1.24.0

  • Saxon Update 12.2

Cloud

  • Use of the operator code base for the BPC project enabled; extension of the deployment variants (e.g. in relation to the registry)

  • Logging adapted for use in Loki

  • Use of further own NARs or NARs in several versions enabled

Migration

  • Java 21 necessary

IGUASU 2.6

Release date: 12.09.2023

Highlights

  • 🆕 Many tables can be exported as HTML/PDF/CSV. For example, this applies to the list of licenses or Processors, but also e.g. for the audit log

  • Certificate management is now no longer only available for admins, but also for normal users. Editing, downloading and deleting is reserved for the admin

  • The results of the global search can be further restricted to provide clearer results. Processor colors and icons are displayed in the results for further clarity

  • Loading very large files in the Editor component and inserting or writing very large amounts of data in other components is prevented. This protects the system and the models, some of which would otherwise this protects the system and the models that would otherwise hold the data

  • Elements of the diagram can be dragged over the edges when creating/editing, whereby the diagram is then expanded in this direction

  • If changes have been made in the background in a module that is currently open, this is displayed when saving and you can decide whether to discard your own changes or overwrite the existing ones

  • 🆕 There is a new Record Reader for reading Excel XLSX files

  • The Provenance table in Monitoring continues to show information in a file view

  • Saxon EE 12 now runs in TransformXml (XSLT) *.*2. When creating a new Processor, an initial XSLT is provided

Cloud

  • The certificate creation and distribution between IGUASU and the BPC is automated via (K8s) operators

Documentation

  • Extension of the hybrid cloud tutorial

    • Explanation of the technical background and the supported use cases

IGUASU 2.5

Release date: 17.07.2023

Highlights

  • 🆕 Collaboration

    • Display which other users are also currently using IGUASU

    • Display which other users are currently viewing or editing a process group

  • 🆕 User settings

    • The layout, settings for display (e.g. help texts on/off) Help texts on/off) and preferences are saved and restored across logins

    • The last working position is restored

  • 🆕 The JSONataTransformJSON editor now includes error marking and code completion

  • Minor improvements

    • When creating a relation, a detailed description of the relation is now displayed

    • Clearer configuration of the source of the XSLT in TransformXml and provision of a typical XSLT template at the start

    • Improved attribute creation and editing in the Data Panel

    • Improved handling when switching views in Processors with special editors (TransformXml, JSONataTransformJSON, ExecuteGroovyScript, …​ )

    • Adjustments to the content view in a queue are now retained when switching to another entry

    • RUN ONCE also works for Processors that are disabled

  • Processors

    • PutDatabaseRecord now supports upserts

    • 🆕 GetAzureQueueStorage/PutAzureQueueStorage for Azure Queue Storage with the Azure SDK 12

    • 🆕 ModifyCompression changes the compression of data without placing a heavy load on the Processor.

Cloud

  • SSL endpoints terminated in IGUASU can be configured by the IGUASU operator

  • High memory requirements of IGUASU no longer cause the application to restart

Migration

  • TransformXml - if a file or a lookup service was used as the source for the XSLT, this basic setting must now be selected once on the TransformXml

  • ListenCloud - the relation failure has been removed. Existing failure relations should be removed

  • In existing InvokeInubit/InvokeOnPrem and InvokeCloud Processors, the no longer supported property for asynchronous processing must be removed

Documentation

  • Description of the creation and use of certificates for hybrid cloud communication with INUBIT

IGUASU 2.4

Release date: 23.05.2023

Highlights

  • 🆕 The editor of the JSONataTransformJSON now supports JSONATA with syntax highlighting (error display and code completion are still open)

  • TransformXml outputs errors in XSLT as Bulletins

  • Speed optimizations in the UI

  • 🆕 New MergeMetro Processor (in addition to GetMetro)

    • This not only takes over the content that is before the PutMetro Processor, but also merges it with the current content - this can, for exampleB. for XML or JSON

  • You can now search/filter in the BOM/list of licenses

  • You can now search for multiple terms in the list of Processors/Services when adding them

  • 🆕 The Hybrid-Cloud Processors are now fully tested with INUBIT

    • ListenInubit, RespondInubit, InvokeInubit

  • Small improvements

    • Tooltips also on deactive buttons

    • The event table always selects the active event

    • Improved layout for user management/display

    • Dynamic properties can now only be added if the Processor supports this, wenn der Processor dies auch unterstützt

    • Die Testausführung von Processors ist auf die Processors eingeschränkt, bei denen das Sinn macht

    • Geghostete Elemente, auf die man keine Rechte hat, werden beim Editieren berücksichtigt (sind erst gar nicht editierbar, kopierbar, etc)

    • Queues beliebiger Größe werden jetzt in einem Rutsch komplett gelöscht

Cloud

  • Registries anderer Bereiche können nun auch in AWS verwendet werden (z.E.g. shared.virtimo.cloud)

Documentation

  • The necessary migration steps for local upgrades are fully described

IGUASU 2.3

Release date: 12.04.2023

Highlights

  • 🆕 Certificate management

    • Certificates can be uploaded for use in Services and Processors

    • Certificates can be generated and downloaded

  • Improvements in the UI

    • 🆕 Support for the Expression Language as well as Parameters in the form of code completion, syntax highlighting and inline documentation

    • Filter option in the global search

    • Elements for which the user has no rights are now displayed ghosted and no longer completely hidden

    • Server-side copy & paste on the general text component

    • Tooltips are displayed earlier and rendered better

    • 🆕 The Monaco Editor is supported and used in some cases Spaces at the end of the text component are no longer displayed.Partly used

    • Spaces at the beginning and end of a property are highlighted to avoid incorrect entries

    • The UI for Parameter Providers supports verification

    • The properties view adapts to smaller resolutions

    • Adaptation of some Processor icons

  • 🆕 New Processors and Services

    • Processor for writing notifications to the BPC

    • Retrieving data from Asana

    • Interaction with Amazon Web Services: Polly, Textract, Translate and Transcribe

    • Sending data to Salesforce

    • Writing data to Apache IoTDB

    • Writing data to Google Drive

    • Writing data to Box

    • New Processors for encrypting and decrypting

    • Generating test data with the support of Records

Cloud

  • 🆕 Support for Amazon EKS

    • The IGUASU Services (e.g. the Playground) on the Virtimo Cloud now all run on Amazon EKS

  • 🆕 Kubernetes deployment of IGUASU via its own K8s operator

Migration

  • Some properties on the Processors and Services to the BPC have been renamed

Documentation

  • The ValidateJSON-Processor is described in the JSON Tutorial

  • The NiFi documentation (e.g. for the description of the *Expression*E.g. for the description of the Expression Langauge) is deployed on https://docs.virtimo.net

IGUASU 2.2

Release date: 08.12.2022

Highlights

  • 🆕 New Processors and Services

    • Listing and retrieving data via SMB

    • Querying data from Airtable

    • Using*Azure Event Hub* as a data sink via AzureEventHubRecordSink

    • Listing and retrieving data from Dropbox List and retrieve data from Dropbox

    • List and retrieve data from Box

    • Retrieve data from HubSpot

    • Collect data from Workday

    • Retrieve data from Zendesk

    • Ingest data into Apache Iceberg

    • Ingest data into Snowflake using Snowpipe-Ingest data into Snowflake

    • UpdateDatabaseTable, which is very helpful when the schema of the data evolves and the tables being written to require DDL changes

    • Publish to MQTT using the Record mechanism, which is much more efficient and flexible

  • 🆕 Pre-release of Hybrid Cloud Processors and Services for connecting INUBIT to the IGUASU Cloud(not yet ready for production!)

  • 🆕 Use of various registry clients enabled

  • 🆕 The full run of queues is now displayed directly in the diagram

  • 🆕 New information on the Processor

    • Which attributes does the Processor read or write?

    • Can the Processor only be used in special roles (e.g. admin)? Admin) ("restricted")?

    • Which dynamic properties are expected and what do they do?

    • Does the Processor have a state?

    • Can the Processor have incoming connections or does it need them?

    • Does the Processor make particularly heavy use of certain system resources, such as MEMORY?

  • Registry

    • 🆕 Use of our Bitbucket (Git) as a backend for versioning in the registry

    • 🆕 Import and export of flows directly from the registry

  • Documentation

    • General revision

    • 🆕 New tutorial for collaboration between IGUASU and the BPC

    • 🆕 New tutorial for working with JSON

    • 🆕 New how-to for the Metro Processors

    • The documentation is installed as before - but is also available together with the other documentation of the Virtimo portfolio at https://docs.virtimo.net/

Migration

  • Our own JSLT Processor has been removed, as there is now one with NiFi

IGUASU 2.1

Release date: 16.08.2022

Highlights

  • 🆕 Metro Processors added

    • Feature 1: Use of FlowFiles from previous steps in the flow

      • Example: The content of the FlowFile is the result of an external system, but you actually still need the result of three steps before. Otherwise, or in INUBIT, this can be solved by caching the content in variables or using a bypass

      • → Using the metro from the previous Processor to the current one

    • Feature 2: Common error handling

      • There are no scopes in IGUASU (as in INUBIT, for example). If you want to solve errors on Processors directly via a "common thread", you have to draw many chaotic connections between the Processors

      • → Use of the metro for common error processing

  • 🆕 Audit Log - available in the Monitoring tab

    • Shows all changes to the configuration such as editing a Processor property, as well as the time and person

  • Parameters Support extended

    • Controller Services can be assigned to parameters (currently using the ID) and then used normally on properties. This allows Controller Services (e.g. access to databases via DB pool services) to be decoupled even better

    • The scheduling (when and how often a Processor is executed) can be set via Parameters. This means that, for example, scheduling can be slowed down or increased for a group of specific Processors

  • Upgrade to IGUASU NiFi 1.17.0

  • Dynamic properties can now also contain sensitive values (e.g. passwords) if the Processor supports this (e.g. header values to InvokeHT). Header values to InvokeHTTP)

  • Detailed metrics for CPU consumption at Processor level

  • 🆕 New Processor allows queries on data coming from Salesforce

  • 🆕 New ConsumeTwitter Processor replaces the previous GetTwitter and uses the current Twitter API

  • 🆕 New Processor to access files on Google Drive

  • HTTP/2 support (ListenHTTP, HandleHttpRequest)

Cloud

  • Java 17

  • AWS/EKS Support

IGUASU 2.0

Release date: 22.06.2022

Highlights

  • 🆕 New display for Bulletins/Errors

    • The icon for the Bulletins has been moved to the header

    • There is a new central panel that is displayed prominently as soon as Bulletins are available

    • Bulletins for Processors, Services and Reporting Tasks as well as System Bulletins are displayed

    • Services and Reporting Tasks with errors are also highlighted in red

    • Bulletins and the error status ("red") are displayed. the error status ("red Processor") is no longer necessarily displayed for 5 minutes, but can be deleted by the user

  • 🆕 There is a new central tree view of all Process Groups

  • 🆕 The available Processors or Services are displayed in the system information

  • 🆕 A configurable retry on the outgoing relations is now supported on the Processors

  • 🆕 Selected elements can now be moved directly to Process Groups using the mouse. They can also be moved to any Process Group via the context menu

  • 🆕 A list of the software components used with their licenses is now offered

  • Properties that configure Services can now be created directly. The Process Group on which the Service is to be created can be selected

  • If Parameter Contexts are changed on Process Groups, this is now done via a dialog that displays the necessary operations such as stop/start etc. and the result

  • 🆕 Processors can now also be verified - this is used, for example, to check whether a configured system is accessible

  • The documentation is now displayed in the same way as on docs.virtimo.net; it can also be searched

  • JSONataTransformJSON can now also write the output completely to an attribute

  • 🆕 PutBPCAuditLog Processor

    • For easy writing of entries in the BPC audit log

  • PutBPCProcessLog Extensions

    • After configuring the associated BPC, the BPC logger can be selected directly from a list of available loggers

    • If there are already entries in the log, the first entry can be used as a template for the audit log, the first entry can be queried as a template for the creation

  • ListenBPCFlowStarter extensions

    • You can now configure the name and description, which can then be seen in the BPC in the selection

    • The BPC session (complete JSON) can optionally, loaded into an attribute for further use in the flow

  • With a corresponding UUID, you can jump to execution instances within IGUASU - this is used, for example, from the BPC

  • Extensions to XmlMerge

    • All attributes from all branches can now be taken

    • It is now possible to prevent the addition of additional root tags if they already exist

  • Apache NiFi raised to 1.16.3

  • JSONataTransformJSON can now also be executed on attribute values or an empty JSON

Migration

The functions provided by IGUASU in the JSONataTransformJSON Processor have been renamed to distinguish them from existing or custom functions.

  • $uuid() → $nfUuid()

  • $el(<el>) → $nfEl(<el>)

  • $attribute(<name>) → $nfGetAttribute(<name>)

  • $attribute(<name>, <value>) → $nfSetAttribute(<name>, <value>)

  • $lookup → $nfLookup(<key>)

IGUASU 1.7

Release date: 09.02.2022

Highlights

  • 🆕 New Virtimo theme (coordinated with BPC 4 and inubit 8)

    • Basically, the use of different themes has been made possible

  • 🆕 New, optional table view for attributes in all corresponding places in Flow

  • Filter option for attribute views

  • 🆕 Extensions to parameters and Parameter Contexts

    • Inherited Parameter Contexts are supported

    • New parameters can be created directly from existing properties

    • Parameter Contexts can be protected via rights

    • All Process Groups that use a Parameter Context can be viewed

    • The parameters of a context can be edited directly in the Process Group

    • Import and export of Parameter Contexts

  • Comments to Controller Services are supported

  • 🆕 JSONataTransformJSON now supports lookups

  • The rights to Process Groups can be explicitly inherited or overwritten

  • The descriptions of the flows are now available everywhere during versioning

  • 🆕 Use of the Virtimo Keycloak in the cloud (currently on dev.virtimo.cloud)

    • The registry now also uses Keycloak

  • Display of version information on IGUASU in the system diagnostics

  • Consistent read-only mode in production mode

    • This means that change operations must always be carried out explicitly

  • 🆕 Deep links are supported across logins

    • A unique link can be retrieved for each Processor

  • New keyboard shortcuts for the global search and overview

  • New variant of the TextEditor (no more memory leaks)

  • 🆕 New how-to section in the documentation

    • Display and descriptions of frequently required functions in the flows

    • Provision of importable Process Groups for clarification and testing

  • 🆕 Drivers, such as JDBC database drivers, can now be uploaded and selected directly where necessary

Migration

  • In the TransformXml Processor, the JSON is now additionally surrounded by a CDATA tag when using 'Surround input with <xml> tag' so that entity references such as '&' do not cause any problems.'&' do not cause any problems. If the CDATA has already been added manually, this must be removed again.

IGUASU 1.6

Release date: December 6, 2021

Highlights

New/extended Virtimo Processors

  • 🆕 Processor PutBPCProcessLog, for logging process data to a Virtimo Business Process Center

    • BPCController Service for reusable configuration of the BPC endpoint

  • 🆕 Processor, to easily call flows from the Business Process Center: ListenBPCFlowStarter

    • BPCListenerController Service for defining the central endpoint for various Listener Processors

    • ListenBPCResponder Processor for controlled response

  • 🆕 Processor for mapping/transforming JSON based on JSONata: JSONataTransformJSON

    • Use of the Expression Language is supported

    • Reading and writing of attributes is supported

    • Possibility of a live editor - every change is directly visible

  • 🆕 Saxon EE is included for the TransformXml Processor

  • 🆕 New ModifyPDF Processor to fill form fields in PDFs

  • 🆕 New Minifier Processor to automatically provide the YAML of a Process Group for the Remote Flow. This allows a remote flow to automatically obtain new versions of its configuration

General update

  • UI update with a lighter appearance

  • 🆕 Central Provenance, in which the past executions of all flows are visible

  • 🆕 Central monitoring of all components used

  • 🆕 Global search

    • Free text search in all available components, as well as jump to the component

  • Extension of the Services user interface:

    • Links to Processors and other Services in both directions

    • Activate/deactivate all Services of a group, as well as the subgroups

    • Display of the affected, linked components as well as the success of the action for each component

  • 🆕 Save/load and copy/paste input data+attributes in the Content Panel and Queue

    • This allows any previously flowed data to be easily used for the test execution of other Processors

  • Selected modules can now also be moved in the Diagram using the cursor keys (together with Shift pixel by pixel)

  • To create modules, they can now be dragged and dropped directly from the toolbar into the Diagram

  • All relations of a new Processor are now auto-terminated by default. Already connected relations can no longer be selected here. When creating a new relation, you can see which relations already have connections

  • 🆕 * Replaying* an event ("Replay") is now supported

  • In the documentation, all existing documentation is now always displayed as an overview (User Guide, Admin Guide, etc.).)

  • Process Groups can be released for individual user groups

  • A hanging Processor that can be terminated now makes this clear directly in the UI

  • 🆕 Display of the server’s system diagnostics (JVM, hard disk, etc.)

  • 🆕 Process Groups can now be downloaded as JSON. This JSON can then be used when creating new Process Groups

    • Templates are no longer supported, as this feature is available via the JSON and the use of the registry/versioning

  • 🆕 A Process Group can be downloaded as YAML for use in Remote Flow

  • 🆕 the registry users can be imported from the current IGUASU

  • 🆕 Backpressure-Default can be configured specifically for individual Process Groups

  • 🆕 Run Once to start a Processor/Flow once

  • Parameters can also be used on sensitive properties (passwords)

Operation

  • 🆕 IGUASU now always runs securely (initially in single-user mode)

  • Optimization of the start scripts (e.g. through new iguasu-env.sh, which contains the Java used, for example)

  • Upgrade guide added to the administration manual

Components

  • 🆕 NiFi Server 1.15.0 integrated (previously 1.13.x)

Cloud

  • 🆕 Client/server authentications are now supported for HTTPS with the cloud

Migration

  • Since IGUASU now initially runs in single-user mode, the user must be set with his password before the first start (see Setting up single user authentication)

  • As templates are no longer supported, all templates that are not available as process groups in the IGUASU to be migrated should be imported before the migration. After the migration, they can then be exported as JSON and removed again if necessary

  • Starting, stopping etc. the Processors (or entire Process Groups) is now only possible via the context menu - the buttons in the toolbar have been removed

IGUASU 1.5

Release date: July 19, 2021

Highlights

Versioning

Provision and support of the * 💥IGUASU registry 💥*

  • 🆕 Versioning of flows (at process group level)

    • Start/stop versioning of a flow

    • List and check in/check out versions

    • Create new instance of a versioned flow

  • 🆕 Reuse (of functions encapsulated in process groups) by using versioning

  • 🆕 Display of local changes

    • Marking in the diagram

    • List of changes with jump to the component

    • Display of changes in sub-groups

  • 🆕 Use of any number of different registries and buckets in the flows

  • 🆕 Management of registries including users, groups and buckets

Cloud

  • 🆕 Provision of Prometheus-based monitoring in the cloud

  • 🆕 Optimized liveness/readiness probes for IGUASU in Kubernetes

  • Storage configurations

General

  • improved clipboard operations (cut and arbitrary paste)

  • Better synchronization of diagram and module editor during changes

  • Display of the executions of a Processor extended

    • Complex execution lines are only loaded in parts

    • It is also possible to load only the data of the events of a single Processor (without the complete execution of the flow)

  • XmlTransformer (XSLT): Resolving external references (e.g. DTDs) disabled.E.g. DTDs) can be switched off

  • Documentation: Tips for operation and optimization of flows added

Press Esc to exit full screen
Modal image placeholder
Press Esc to exit full screen