Release Notes

This document lists the highlights, important fixes, and necessary migration steps for each version.

IGUASU 4.4

Release Date: July 21, 2025

Highlights

  • 🆕 New HandleHttpStreamingResponse processor that allows writing multiple FlowFiles to a single request in conjunction with a HandleHttpRequest

  • Improvements to parallel requests via DuckDB; we also support a default S3 instance for every installation

  • Creating elements in the diagram using shortcuts is now supported

  • Connections are now more visible on colorful and similarly colored borders

  • When connecting a processor to itself, the system now asks whether this is intentional

  • A duplicate connection from one processor to another is no longer allowed

  • If the last connection to a processor—which can run without incoming connections—is removed, that processor is stopped to prevent unintended execution.

  • If a running component in production mode needs to be modified without manually stopping it, it can be temporarily set to that mode using the lock icon

  • Assets can be uploaded for existing Parameters that have no value

  • MonitorHybridConnections logs the reason for closing the connection

  • Improvements to loading versions and local changes

  • ListenBPCFlowStarter supports applying queryParameters into the flow

  • In the JSONataTransformJSON processor, variables can be set in JSONata using Dynamic Properties. This makes it possible to apply the NiFi Expression Language to attributes at this point—including through the use of Parameters

  • The list of Ports used by the processors now also displays the external URL of the endpoint

  • Endpoint management now displays which network is being used (Internal/Internet/…​)

  • ScheduleGenerateFlowFile – in addition to the schedule.timestamp attribute, there is now also schedule.scheduledTimestamp – both in UTC time format

Important Fixes

  • The hybrid connection to INUBIT is now more stable during parallel, simultaneous use across multiple processors

  • JSONataTransformJSON could execute the script twice under certain conditions, which, for example, led to problems when attribute values were increased

  • TransformXml could retain old attribute values between executions when writing directly to attributes

  • ScheduleGenerateFlowFile now correctly writes fewer expired FlowFiles

Cloud & Operator

  • The new K8s Gateway API is supported

Migration

  • The schedule.Timestamp attribute is now written in UTC time rather than milliseconds.

IGUASU 4.3

Release Date: May 28, 2025

  • 🆕 New asset management via Parameters

    • Assets—that is, any files—can now be uploaded and referenced directly via Parameters

    • This applies, for example, to JARs and certificates

    • The certificate creation process has been enhanced with improved dialogs

    • The previous sections for certificates and database drivers are deprecated and will be removed in one of the upcoming releases

  • 🆕 New ExecuteDuckDBSQL Processor, which extends IGUASU with powerful data analysis capabilities; it offers direct, high-performance querying of Parquet files stored in S3 buckets

  • 🆕 New Processors in the hybrid cloud context: MonitorCloudConnection, MonitorInubitConnection, and MonitorOnPremConnection —monitor the connection status to the remote end and become active when connections are established or terminated

  • For the hybrid WebSocket services (connection to INUBIT or the IGUASU gateway) you can view the Connection status in the UI under the “State” tab

  • Diagram Extensions

    • If the Diagram does not fill the entire panel, it is now initially centered

    • When elements are moved to the sides, the Diagram scrolls smoothly along with them and expands the area

    • If a Connection deviates from the default settings, this is indicated by an icon

    • If a retry is configured for a relation, this is indicated by an icon on the Connection

    • There is a new context menu entry to move the selection directly into the parent Process Group

    • When moving Connections using the arrow keys, vertices are inserted as needed

    • Connections are color-coordinated with the frames/Labels they are located in, ensuring they are always clearly visible

  • Endpoint Management

    • When navigating from a Port to Endpoint Management, that Port is selected there immediately

    • If Ports are already assigned, this is clearly indicated for the endpoints

    • The routes (e.g., Internet/Internal) that can or must be configured for external access are now available in a drop-down list, so you no longer need to know the exact name

    • It is no longer necessary to restart the server component when making changes

  • A Processor’s provenance events can now be viewed not only individually, but all of them or a selected set can be downloaded as a ZIP file

  • Enhancements to text editors

    • Search and Replace are now easily accessible as toolbar functions

    • You can switch between using tabs and spaces

    • Views that previously used only the text editor for large amounts of content now have a new view that allows you to scroll through the content regardless of the data size

  • Additional UI improvements

    • Local changes, including the blue stars as markers, are now only loaded and displayed when you open the version panel

    • Services now always display their type in the list

    • The left pane in the Diagram (e.g., the Services) now retains the width assigned to it by the user

    • When importing process groups from the registry, all elements are more clearly visible

    • The log services in the selection for PutBPCProcessLog are now sorted alphabetically

    • Services can now also be enabled ordisabled via the context menu

    • There is now a shortcut for creating dynamic properties

    • In the Parameter Context, you can see who last made a change, and you can jump from there to the audit log with the appropriate filter

    • The results of the various relations during a test or debug run remain open when the run is repeated

Migration

  • The certificates and database drivers must be transferred to Parameter Contexts in Assets

IGUASU 4.2

Release Date: April 21, 2025

Highlights

  • 🆕 Clustering

    • IGUASU can be operated with multiple nodes in a cluster. To the user, the cluster largely appears as a single instance of IGUASU. The various nodes and their information can be viewed in a new monitoring view. Various operations can also be performed here. The fact that clustering is active is also immediately visible in the header via a corresponding icon and the number of nodes

    • Clustering is used for horizontal scaling and high availability

    • In addition to the aggregated view*,* the status history can also be accessed for each*individual* node

  • Diagram Extensions

    • In Editmode, the diagram is no longer automatically realigned to the left or top whenever changes are made, allowing for greater freedom when adjusting and extending it

    • Creating Connections to other Processors (or to themselves) has been improved

    • When moving multiple elements at once—especially using the keyboard —the process is smooth and lag-free

    • Connections can now be moved directly to other targets without having to be selected first

    • The Process Group you are currently in can now also be copied directly to the clipboard

    • If a Processor is configured to run only on the primary node of a cluster, this is indicated by an icon (a crown) next to that Processor in the Diagram

    • If load balancing is configured for a Connection, this is indicated by an icon

  • 🆕 Overview of Ports in Use

    • When configuring ports on the processors, the assigned/open ports are displayed

    • From the endpoint mappings*,* you can navigate directly to their use in the processors/Services

  • Standardized Interfaces for Components

    • The interfaces for the settings and properties of the various components (Processors, Services, Reporting Tasks, Analysis Rules, Parameter Providers, and Registries) have been designed to match those of the Processors

    • Other components, such as Services, can now have a state that can be viewed and cleared in the interface

  • Processors

    • 🆕 New ScheduleGenerateFlowFile Processor—Uses a CRON expression at specific times to determine whether it should actually start. It ensures that a flow is started (slightly later) even if the Processor was not active at the exact start time—for example, because the server was briefly down. This Processor can also take local time into account.

    • 🆕 The ListenBPCFlowStarter Processor now also supports GET operations and is now compatible with BPC 5 when the "Load the BPC Session" setting is enabled

    • 🆕 New Couchbase Processors and Services for Lookup and MapCaches have been added

    • The HybridWebSocket connection is more*resilient*

  • Versioning

    • The use of Bitbucket as a repository has been significantly optimized

    • Local changes are now loaded asynchronously, so the flow itself loads faster, (the local changes in the list and the blue markers may sometimes appear a little later)

    • The displayed changes are always up to date—this could not always be guaranteed previously due to caching

    • Local changes that apply only to the environment (e.g., due to a different NAR version) are explicitly displayed and can be hidden (they do not prevent version changes)

  • UI improvements

    • In the Data Panel, the link to an event—to access it later—can now be copied directly to the clipboard

    • Deprecated Services and Processors are displayed with a strike-through

    • Individual Processor states can also be selectively deleted for certain components (no longer just all of them at once)

    • Dynamic Properties now handle long attribute names better

    • Text fields now automatically switch to the multi-line editor when the text gets longer. This also applies to pasted text, and line breaks are no longer lost.

    • It is now clearer which elements—for example, in the toolbar—are intended to be dragged

    • Zooming in on an editor can now be enabled and disabled using the keyboard

    • The theme (light/dark) is also applied when viewing the documentation

  • 🆕 New functions in the Expression Language

    • The unique(delimiter) function, which returns unique values in a delimited list, as well as compactDelimitedList() and trimDelimitedList() to clean up such lists

    • New arithmetic operations with date/instant values—plusDuration(String duration), minusDuration(String duration), plusInstantDuration(String duration), minusInstantDuration(String duration), as well as the validation methods isValidDate() and isValidInstant()

Breaking Changes & Migration

  • Error handling has been improved for the InvokeCloud, InvokeOnPrem, and InvokeInubit, error handling has been improved.

    • Existing "unavailable" connections are automatically migrated and now also include "not found" connections

    • For Processors that previously used "Put Back in Queue" or "Route in failure relation" as routing options for unavailable destinations and did not have a connection for the "unavailable" connection, you should set up a new connection (or new connections) for the "unavailable" and "not found" connections (or add these relationships to an existing failure connection).

    • The framework’s standard mechanism should be used to retry the connections (for the “not found” and “unavailable” connections)

IGUASU 4.1

Release Date: February 23, 2025

Highlights

  • The hybrid cloud connection to INUBIT and the IGUASU Gateway is more resilient in the event of network issues

    • Server-side ping/heartbeat with controlled termination of the connection in case of problems (the connection is then reestablished by the client)

  • Improvements to Parameter Contexts

    • When importing Parameter Contexts, the comparison of old and new values is now complete and visible at a glance

    • You can filter by inheritance, and the view has been improved overall

  • Bulletins

    • Bulletins can be deleted per component or in bulk,

    • The existing feature to to hide Bulletins for the current UI user remains available

    • A stack trace display can now be enabled for many Bulletins

    • Individual Bulletins can be copied to the clipboard along with their stack trace

  • Diagram improvements

    • The sizes of the elements have been adjusted so that all elements now fit within the grid. When laying out (manually or automatically), all elements are always correctly aligned to the grid. This behavior is also applied by the Auto-Layouter and Partial-Layouter.

    • Lasso selection within frames is now also available in read-only mode

    • Element movements can now be exactly one step or 1 pixel—both with the keyboard and with the mouse

    • The context menus have been streamlined, clipboard actions are now always at the bottom and grouped

  • Minor UI improvements

    • It is now possible to tell when processes and Services are starting or stopping, and whether this is taking longer than expected or if they are stuck there

    • The table view of attributes in the Datapanel now offers better usability, especially for multi-line text

    • The information and examples in the AI Assistant can be hidden for a clearer overview

    • The headers in the attribute display always remain visible

    • The Expression Language preview for Parameters has been improved

  • The settings for the Git-based repository clients can now be verified

  • The TransformXML Processor now also allows all attributes to be passed as possible parameters to the XSLT script

  • Improvements regarding IGUASU updates with local versioning changes — changes to Processors/ Services no longer result in local changes —e.g., renaming or removing properties

  • The StandardOauth2AccessTokenProvider allows you to set custom form parameters via dynamic properties, which are then added as part of the payload

  • Enhanced protection of the UI against DOS (Denial-of-Service) and unnecessary resource consumption

  • New UpdateGauge Processor to capture metrics as concrete values (Counter and UpdateCounter already existed)

  • Update to Apache NiFi 2.8

Important Fixes

  • Processors that are*invalid but still running* can now be stopped directly (previously only possible by stopping the entire Process Group)

  • Inactive properties no longer hold references to Parameters

Breaking Changes & Migration

  • Many properties have been renamed, so there is no backward compatibility between IGUASU 4.1 and 4.0 models. You cannot run a version that was checked in on 4.1 on 4.0 or earlier.

  • The ability to download the lineage of an execution and upload it again later has been removed

  • The previous top-level predefined ` StandardRestrictedSSLContextService ` instances are deprecated. New instances of the StandardSSLContextService type are available instead. All relevant uses should be migrated, as the StandardRestrictedSSLContextService Service type will be removed in the future. The same applies to custom instances.

IGUASU 4.0

Release Date: December 1, 2025

Highlights

  • 🆕 Public release of the Rio AI Assistant

    • Rio is familiar with IGUASU and answers questions about the product or the implementation of solutions. The answers include specific links to sources in the documentation.

    • Examples include * “How can I version a process group?” or“How can I split a JSON and then send these parts to a REST Service?”*

  • 🆕 Generating Flows with Rio

    • Rio generates complete flows from a scenario description

    • A simple example would be * “Create a REST endpoint that returns ‘Hello World’.”* Within this description, configurations or requests for mappings—such as from one JSON to another—can be integrated.

  • 🆕 New AI Processors in the flows

    • PromptVertexAI - Using Vertex AI to process requests via the many LLMs available there

    • CreateVertexAIEmbeddings - Use Vertex AI to create text embeddings for texts using the provided embedding models

    • SearchQdrant/UpsertQdrant - Interact with the Qdrant vector database to implement RAG solutions

    • ListenLLMTool/RespondLLMTool – Providing tools for LLMs that can be accessed via PromptVertexAI

  • 🆕 New Security Cockpit

    • Traffic light status for the system’s security-related configurations directly in the header

    • Based on Flow Analysis Rules and the system’s up-to-date status (upcoming updates)

    • Easily expandable with additional rules

  • 🆕 When importing an existing Parameter Context, a new dialog compares the parameters in the existing and imported Parameter Contexts and lets the user decide which parameters should be adopted

  • 🆕 Overview of all versioned flows in the monitoring Process Groups. This is an extension of the previous view and provides filtering options based on versioning status, the registry, the branch, the bucket, as well as name and description

  • 🆕 Endpoint management now supports bulk operations. Multiple endpoints can be edited, deleted, or created—the changes are then applied collectively

  • 🆕 In addition to the available Processors and Services, the system information now also includes management services, Reporting Tasks, and Flow Analysis Rules. For all these components, you can view how often they are used on the current system.

  • 🆕 The Metro processors have been reimplemented with a special focus on throughput and low latency

    • From the provenance events, you can now navigate in both directions to the corresponding execution line or execution event

  • 🆕 If you have Processors in different versions (e.g., via uploaded NARs), you can set the versions of individual Processors or even entire Process Groups to the new or old version.

    • This can be used in particular to test new versions on a development system while still having the option to continue development on other flows using the old version for the production system

  • 🆕 Certificate management now also supports PEM files

  • Minor UI improvements

    • A visual grid is now available in the flow editing mode

    • The shortcuts in IGUASU in general, as well as in the text editor component, have been revised and simplified - generally using Control (Windows/Linux) or Command (Mac) plus another key

    • The preview of the Expression Language Evaluations of the properties can now be easily copied to the clipboard

    • The metrics for the Processor/Process Group are rendered with an appropriate layout and values in thousands (K), even for large values

    • Rendering and line breaks for element names in the Diagrams have been improved

    • Additional settings are now saved per user, such as displaying attributes as a table or tags

    • Parameters can now be set even more conveniently via the keyboard*in the Properties window*; they can either be entered in full or inserted at the cursor’s position

    • The view of local changes is now even clearer, and long texts can be selectively wrapped

    • In the Provenanceview in Monitoring, filtering by events has been improved

    • When switching to the IGUASU tab, the Diagram view is updated

    • The last search is remembered

    • The view of certificates, drivers, and custom NARs now supports filtering

    • When switching between versions, the paths to the Process Groups (especially those of other instances) are displayed

    • The Welcometour has been updated

    • In the diagram, you can now use the keyboard to move two grid steps, one grid step, or one pixel

    • The retry settings for Processors depend on the settings for the relations and are therefore often more compact

Breaking Changes & Migration

  • MergeMetro has been removed; this functionality can be achieved more flexibly and with more options using MergeContent

  • The default settings for Metro processors regarding Run Duration and Penalty Duration have changed in some cases. It may be advisable to review the new defaults for existing processors.

IGUASU 3.7

Release Date: October 1, 2025

Highlights

  • 🆕 New UploadTestFile processor: Flows can be started directly using a file uploaded to the processor. This makes testing and developing flows even easier.

  • PutMetro allows you to set a "Run Duration" and also outputs the attributes set via Dynamic Properties. This enables its use for logging, for example—even under heavy load.

  • Attributes in the Data Panel: It is now more clearly displayed which attributes came from the input, which were added, and which were modified. Copying and saving data consistently distinguishes between input and output.

  • ArrivalGate Improvements:

    • A “Run Duration” can be set to process more FlowFiles under high load

    • Outputs from Process Groups, Input Ports, and Funnels are displayed more clearly, and the relationships are shown or hidden accordingly

  • When creating a new Process Group from the Registry, you can filter by flows

  • 🆕 Non-versioned Process Groups can now be set to a versioned Process Group. If this Process Group was previously part of this versioning, references to existing components are used correctly; otherwise, all changes are local.

  • Git-based repositories support new strategies for storing parameters

  • Parameter Context improvements:

    • Parameters from the parent context can be hidden

    • It is clearly indicated when parameters are overwritten, and the overwritten values can be easily removed

  • Minor enhancements to the UI

    • The preference for display in the editor component—i.e., whether JSON/XML should be displayed as a tree or as text - is now saved

    • Users can set a different favicon (icon in the browser tab) for each instance —making it easier to distinguish between different IGUASU instances

    • The editor component now allows the editor to be maximized at any point, making it easier to edit longer texts

    • All icons in the product now follow a consistent style

    • The layout of the commit dialog has been improved and optimized for Git-based repositories

    • A Parameter can now be created even from sensitive properties (in which case only the name is set)

    • Deprecated Processors are now marked accordingly in both the selection dialog and the settings

    • Versioning display: The registry view is saved; excessively long commit messages are displayed in truncated form

    • If Services have WARN/ERROR messages, this is also indicated by color directly on the Services

    • From the JSON tree, a node can be dragged into the JSONata Editor to obtain the absolute JSONata path; from the XML tree, the node can be dragged into the XSLT Editor to obtain the absolute XPath

  • New metrics for the Processors in the Status History (e.g., for CPU usage)

  • BPC 5 is supported

  • New JSONata function for reading all attributes (e.g., to iterate over them): $nfGetAttributes()

  • ListenWebSocket can pass the HTTP request headers from the connection establishment as attributes to the flow

  • ExecuteGroovyScript now also supports sensitive dynamic properties

  • The ExcelReader now supports binary XLS

  • The Kafka processors now support SASL/OAUTHBEARER

  • SFTP Processors have been refactored from SSHJ to Apache MINA SSHD

Cloud

  • Pre-installed parameter contexts for using the IGUASU NiFi REST API

  • The file size limits in the editors—e.g., in the Input/Output Panel or the queues have been increased —so larger files are now displayed in their entirety

Fixes

  • The Git-based registry now supports paging — previously, only the first 10 flows were visible

Breaking Changes

  • The format of the ZIP files downloaded from the Data Panel has changed

Known Issues

  • Invalid Processors that attempt to start cannot be stopped individually. Workaround: Stop the entire Process Group.

IGUASU 3.6

Release Date: July 7, 2025

Highlights

  • 🆕 Versioning: Operations on all instances in use

    • When a version is committed or when a version change occurs, the system checks where this flow is still instantiated on the system. These flows can then also be set to the desired version

  • 🆕 Bulk Replay

    • In the monitoring provenance, you now have the option to re-execute any number of processor events (previously, this was only possible directly on an event in the provenance displayed directly at the processor)

    • You can filter and/or select events directly

    • Events can be executed individually or all at once

  • 🆕 Linked Metro Executions

    • From theexecution events of a GetMetro, ExitMetro, or MergeMetro, you can* jump*to the corresponding event of the associated PutMetro. This makes it possible to track executions even across Metro usage

  • If you jump to the processor via a link in a Bulletin, the associated execution is displayed along with the provenance data, provided all necessary information is available in the Bulletin

  • The AI assistant can now * “think”* for longer periods of time, to solve more complex tasks

  • Endpoints in Management are now fully editable, including all fields

  • The versioning UI has been optimized for use with BitBucket (to address requests that sometimes take significantly longer)

  • Minor changes to the UI

    • IGUASU updates are now sorted with the newest at the top in both the selection box and the history

    • Additional details and use cases from the processors now always link to the general documentation

    • In the ArrivalGate settings, you can sort the entries, and the links are clearer

    • Atttributes in the execution data view are now specifically distinguished between incoming and modified/deleted attributes

    • For processors that have restrictions, a corresponding icon

    • Slightly revised theme in light and dark modes

  • The WebSocket processors now allow setting an idle timeout, as well as a server-side ping and the closing of sessions via PutWebSocket

Fixes

  • MergeMetro had no output relations

  • JSONataTransformJSON no longer displays syntax errors

  • The debug/test execution of JSONataTransformJSON failed under certain conditions

IGUASU 3.5

Release Date: May 21, 2025

Highlights

  • 🆕 There is a new*'Dark Theme'*—you can now choose between light, dark, and the system/browser setting

  • 🆕 Bitbucket repositories can be used as IGUASU registries

  • 🆕 New Flow Analysis Rules

    • PropertyNeedsParameter —enforces the use of Parameters on defined properties. In staging scenarios, this can prevent errors that may arise if you forget to configure parameter contexts for the various stages

    • RestrictBackpressureSettings —prevents unintended backpressure settings that do not match the desired system behavior

  • 🆕 Open execution sequences from a queue —Starting from a FlowFile in a queue, you can view the provenance across the Diagram. When you open a queue associated with an active execution sequence, the corresponding FlowFiles are highlighted

  • FetchBPCProcessLog and DeleteBPCProcessLog now also support complex queries

  • Improvements to status changes

    • Disable/Enable of all Services in process groups is now cleaner and faster

    • When modifying groups with subgroups, a prompt now appears, allowing you to choose whether the subgroups should also be updated

  • The entry of a larger number of parameters is now easier and faster

  • The queue order/prioritizer is now displayed directly on the queue

  • Local/test execution is now also enabled for admins on production systems

  • * When using EL,*TransformXml can now also pass its own temporary attributes from the content

  • For AWS MSK (Kafka), IAM authentication is now supported

  • 🆕 New OAuth 2.0 Controller Service to support the JWT Bearer Flow

  • Upgrade to IGUASU NiFi 2.4

Cloud

  • The restart of the IGUASU server component has been significantly optimized. This further reduces the brief downtime during updates

  • Use of various networks or VPNs can be configured via the Operator

  • The IGUASU Gateway can now also use a proxy server for hybrid connections to the cloud

IGUASU 3.4

Release Date: April 8, 2025

Highlights

  • 🆕 IGUASU Gateway

    • The IGUASU Gateway artifact (used as a connection component to the on-prem environment when no INUBIT is available) is now generated with every new version of IGUASU

    • The GatewayFlowProvider Service allows any IGUASU flows to be made available to an IGUASU Gateway. This provides the Gateway with an auto-update mechanism for the flow running on it. This makes it possible to deploy or test new developments or changes on the gateway in a very user-friendly and secure manner.

  • 🆕 The new ArrivalGate processor is used to create connections (to it) that are only visible in the Diagram when it or the source processor is selected. This allows for the representation of aspects that do not follow the original flow of this process. At the same time, processing via the queues, etc., remains exactly the same as always. This can be useful, for example, for shared error handling by processors located at very different points in a flow.

  • Expanded versioning area in the UI

    • The panel is now located at the bottom of the Diagram and is wider

    • 🆕 When you select a version, the changes in that version compared to the previous one are displayed immediately

    • 🆕 Changes from version comparisons are displayed in the diagram with a purple border and are thus visible alongside local changes

    • 🆕 Version comparison changes can now be navigated just like local changes—subgroups are also taken into account

    • The display of changes has been optimized

    • Changes that relate to Parameters are highlighted

  • Diagram extensions

    • 🆕 Copy-and-paste within the diagram now uses the browser’s clipboard, allowing operations across stages, for example

    • 🆕 Within labels used as frames, you can now use the lasso tool for selections

    • 🆕 Vertices can now also be selected and removed individually. (Double-click or menu)

    • An enlarged workspace in Edit mode allows for faster expansion of the flow downward/to the right

  • Enhancements to cloud updates

    • 🆕 The version history of installed versions is displayed (starting with this version)

    • 🆕 The available updates show which components are affected and where downtime will occur during the update

  • JSONata extensions

    • 🆕 New, optimized implementation as the new default —a 1:1 implementation of the JavaScript reference implementation

    • The transformation can be applied directly to a string —the string is converted into the value of a simple JSON structure

    • When outputting a string as the result of the transformation, the surrounding quotation marks can be removed

  • Disabling/enable of all Services in a process group, as well as all others in the hierarchically subordinate groups, can now be performed directly and with significantly improved performance

  • Direct navigation from the BPC processors to the log services in BPC (in addition to the ability to jump from an execution event to the entry in a monitor)

  • Improved keyboard navigation (Tab) in Properties/Settings

  • The browser’s Forward button is now consistently supported

  • 🆕 New processors for communicating with the box.com cloud service: ConsumeBoxEvents, FetchBoxFileRepresentation, ConsumeBoxEnterpriseEvents, FetchBoxFileInfo, GetBoxFileCollaborators, GetBoxGroupMembers

  • Expansion of ConsumeGCPubSub to include Record and Dermarcator

  • 🆕 New GetS3ObjectTags processor to retrieve S3 object tags

  • The Elasticsearch processors now support JWT authentication

  • Upgrade to IGUASU NiFi 2.3

Migration

  • Some components have changed or expanded properties — these are migrated automatically, but result in local changes if the associated flow is versioned. This applies, for example, to the JSONata processor, as well as to the Hybrid Cloud and BPC Services.

IGUASU 3.3

Release Date: February 3, 2025

Highlights

  • Parameters can now be changed much more easily in production mode without having to stop components manually

  • 🆕 All elements now display when and by whom the last change was made. From there, you can also jump to the audit log for that component, where you can view further changes.

  • Auto-Layouting Enhancements

    • When laying out selections, the positions of the connections remain stable

    • Significantly improved layout of elements that do not belong to a graph

    • Improved layout by giving higher priority to longer branches

  • From the execution event of a BPCProcessors, you can jump directly to the corresponding entry in the BPC Monitor

  • 🆕 New Flow Analysis Rules: SystemSafeguard, which prevents misconfiguration of the InvokeHTTP processor that could lead to system overload, and RestrictBackpressureSettings, which checks the backpressure settings

  • 🆕 The Bulletins can be downloaded directly from the tables

  • The text editors now offer search, undo, and redo functions via buttons in the toolbar

  • Parameter Contexts can be filtered

  • The IDs of the components in the management area are now also displayed

  • 🆕 The PEMEncodedSSLContextProvider supports PEM-encoded keys and certificates

  • 🆕 The new StandardDatabaseDialectService is available for even better compatibility with various SQL databases

  • Upgrade to IGUASU NiFi 2.2

Documentation

  • 🆕 The documentation now lists all available processors, Services, tasks, etc., along with their descriptions, configuration options, notes, and limitations

  • 🆕 The documentation now also includes direct references to the Expression Language and Record Path

Important Fixes

  • The bug requiring a keystore to always be specified in SSLContextService has been fixed

  • Outgoing success connections from PutMetro can be reestablished

  • When exiting the management window, settings are no longer lost unless you have explicitly saved them

IGUASU 3.2

Release Date: December 11, 2024

Highlights

  • 🆕 The documentation is now also available in English (automatically translated using DeepL)

  • 🆕 Multiple ingresses are now supported in the cloud, allowing external addresses to be routed via different paths and VPNs. This is fully supported by the UI

  • For processors uploaded via NARs or created as new Python processors, the full description is now also displayed

  • Parameters can be filtered

  • When a new process group is created, the parent group’s “Parameter Context” is set immediately and can be adjusted right here

  • JSON Lines (https://jsonlines.org/) are supported in the views

  • The AI Assistant allows you to provide feedback on the response as well as ask longer questions

  • Auto-layout for selections preserves the position of the processors relative to the top-left corner and is also accessible via the Context

  • Labels now also have a "Send to Back" option to set their Z-position relative to other Labels

IGUASU 3.1

Release Date: November 27, 2024

Highlights

  • 🆕 AI Assistant (Technology Preview) – You can ask questions about IGUASU; the answers are based on the documentation

  • 🆕 Use of GitHub repositories as IGUASU flow repositories in our cloud installations

  • Memory leaks in the UI have been fixed

  • The maximum time a Processor can spend in the retry loop with the configured retry settings is calculated and displayed

  • New Processors and Services

    • CopyS3Object, GetS3ObjectMetadata – Retrieve metadata from S3 and copy files between buckets

    • DeleteSFTP – Allows deleting files on an SFTP server

    • HttpRecordSink – Allows Record Sinks to be sent to any HTTPS address

  • Upgrade to IGUASU NiFi 2.0

Cloud

  • 🆕 UI updates can be performed without user interaction

  • 🆕 Multiple different networks and VPNs can be connected

Migration

  • DistributedMapCacheServer has been renamed to MapCacheServer

  • DistributedSetCacheServer has been renamed to SetCacheServer

  • DistributedMapCacheClientService has been renamed to MapCacheClientService

  • DistributedSetCacheClientService has been renamed to SetCacheClientService

IGUASU 3.0

Release Date: September 9, 2024

Highlights

User Interface

  • 🆕 Diagram Improvements

    • The diagram can be moved by holding down the middle mouse button

    • The diagram can be zoomed by pressing Control + scrolling the middle mouse button (the same applies to pinch-to-zoom on trackpads)

    • Zooming via the toolbar now offers finer granularity

    • Success- and Failure ports can now be connected directly from the Processors

    • The ports have tooltips with descriptions

    • New Processors can be created directly when establishing outgoing connections

    • Connections to and from Process Groups now display the port’s name and status

    • Redesigned icon display in the Process Groups modules

  • 🆕 Management

    • New, integrated view of the various central settings and Services (no longer scattered throughout the menu)

    • Endpoint Management – Endpoints can be exposed externally and mapped internally to Ports, and thus to Processors and Services. These endpoints can be viewed, extended, and managed.

    • Database drivers, certificates, and custom Processors/Services can be exported and imported

  • 🆕 Visual tree views and editors for JSON and XML wherever data of these types may appear

    • Full editing of data in the model, as well as XPath and JSONata queries

  • 🆕 New view of Services as part of the Diagram (no longer in the process group settings)

    • Services now have individual icons, just like Processors

  • 🆕 New graphical dashboards

    • for key metrics in System Information (memory, threads, disk, etc.)

    • for Processors and process groups with information about their executions

  • 🆕 Support for rules to analyze flows

    • As a first step, you can use these rules to prohibit the use of individual Processors or to issue warnings when they are used

  • Redesigned view of Connections, with separate sections for configuration and runtime queue displays

    • 🆕 Relationships can now be added and removed directly in the configuration

    • 🆕 Data in the queue can also be displayed by date of receipt

  • Improved Processor configuration

    • Dynamic properties now have their own section and can be added directly—without a dialog box and thus in bulk—and renamed directly inline

    • 🆕 New use case descriptions for various Processors, including interactions with other Processors

    • 🆕 Related Processors are displayed and can be dragged directly from here into the Diagram (for example, the associated HandleHttpResponse is displayed next to a HandleHttpRequest)

  • 🆕 New interface element for multiple selection

    • Selected prioritizers on Connections

    • Relationships on Connections

    • Permissions—e.g., on process groups

    • Selection of multiple values for filters in monitoring

  • 🆕 Displaying the number of Bulletins next to the icon when the Bulletins view is inactive

  • Monitoring

    • Selecting and displaying times in the monitoring filters has been simplified and visually improved

    • 🆕 In the audit log and provenance events, you can now also filter by a component. The component can be selected from the selection in the Diagram or from the currently selected row

    • You can load the data that has flowed directly from the general provenance events —and the execution view in the Diagram can also be activated

  • More UI updates

    • 🆕 Avatar images are now retrieved from federated IDMs, such as Google, are supported

    • Redesign of the central toolbar, as well as access to hidden elements

    • Orange is now consistently used to highlight action buttons and menus to make it clear that the action has or can have a direct impact on flow executions.

    • The dialog for adding new Processors can now be easily navigated using the keyboard via the arrows and the Tab key

    • The items in the Services and Flow trees have tooltips so that you can read the entries even when the tree is too narrow

    • Messages regarding field content limits now only appear when the limit is exceeded

    • The mouse pointer makes the available actions on buttons and elements in the diagram even clearer

    • The evaluation of the Expression Language on properties shows the usable scope

    • The text editor now includes language support for 'nifi’ is no longer explicitly available for using Expression Language suggestions. These can now be used directly in ‘text’ mode

    • The text editor now also supports Parameters for properties

Virtimo Portfolio

  • Even better integration between IGUASU and the BPC:

    • 🆕 From the execution information of a flow in IGUASU (provenance), you can jump directly to the entry in the BPC

    • 🆕 From a monitor entry in BPC generated by a flow in IGUASU, you can jump directly to the execution instance in IGUASU

  • 🆕 New Processors: FetchBPCProcessLog and DeleteBPCProcessLog

Execution

  • 🆕 [BETA] New stateless execution model for process groups

  • 🆕 New Processors

    • , DeleteFile, SpliExel, PackageFlowFile, EncryptContentAge, DecryptContentAge, ListenSlack, ConsumeSlack, ListenOTLP, CalculateParquetOffsets, CalculateParquetRowGroupOffsets, FilterAttribute, PublishSlack, PutMongoBulk, PutAzureDataExplorer, PutZendeskTicket, SplitPCAP, SplitExcel

  • 🆕 New Services

    • BPCRecordSink, YamlTreeReader, StandardKustoIngestService, ZendeskRecordSink, ProtobufReader

  • 🆕 New Schema Registries

    • AmazonGlueSchemaRegistry, StandardJsonSchemaRegistry, ApicurioSchemaRegistry, DatabaseTableSchemaRegistryService

  • 🆕 New Parameter Provider

    • OnePasswordParameterProvider

  • 🆕 [BETA] Support for Python as a language for developing Processors. First new Processors for implementing Retrieval-Augmented Generation (RAG) in AI environments:

    • PromptChatGPT - Send requests to OpenAI ChatGPT

    • QueryChroma, PutChroma - Use of the Chroma vector database

    • QueryPinecone, PutPinecone – Using the Pinecone vector database

    • QueryOpensearchVector, PutOpenSearchVector – Using OpenSearch as a vector database

    • QueryQdrant, PutQdrant - Using the Qdrant vector database

    • ChunkDocument - splits documents for use as embeddings

    • ParseDocument - parses unstructured text documents, as well as performs OCR on PDFs and images into "json-lines" (data and metadata) for use as embeddings

Upgrades

  • Our Processors and Services for communicating with INUBIT and the BPC now use Jetty 12

  • Upgrade to IGUASU NiFi 2.0.0M4

Cloud

  • IGUASU updates can now be installed manually or on a scheduled basis (to 3.0 final)

  • There is a new default group called “viewer” —users in this group cannot change or start anything in the system, etc. but can only view data

  • There is a section in the file system that can be used for Services/Processors that require it and is also included in the backup

  • GitHub can now be used directly as a repository

Migration

  • Many components that were no longer up to date or functionally redundant have been removed. The complete list can be found here. Among others, these include the following with possible alternatives*:*

    • Base64EncodeContent → * EncodeContent*

    • ConvertAvroToJSON → ConvertRecord

    • ConvertExcelToCSVProcessor → ExcelReader

    • CryptographicHashAttribute → UpdateAttribute

    • EncryptContent →*EncryptContentAge/EncryptContentPGP*

    • FetchElasticsearchHttp -→ GetElasticsearch

    • GetHTTP, PostHTTP → InvokeHTTP

    • GetTwitter → ConsumeTwitter

    • HashAttribute → CryptographicHashAttribute

    • HashContent → CryptographicHashContent

    • PostSlack → PublishSlack

    • PutElasticsearchHttp → PutElasticsearchJson

    • PutElasticsearchHttpRecord → PutElasticsearchRecord

    • PutSlack → PublishSlack

Documentation

  • If a Processor or Service is described in more detail in the User Guide or in a tutorial, it is now linked directly to the component

  • Restructured and updated with new features and adjustments

IGUASU 2.8

Release Date: February 5, 2024

Highlights

  • 🆕 Records can be easily written to Zendesk using ZendeskRecordSink

  • 🆕 New Processors for working with Parquet: CalculateParquetOffsets, CalculateParquetRowGroupOffsets

  • 🆕 FilterAttribute —new Processor for filtering attributes

  • 🆕 PublishSlack —new Processor for publishing to Slack

  • 🆕 PutZendeskTicket - new Processor for working with Zendesk

  • Improvements to how Diagram versioning is handled

  • Minor UI improvements:

    • Global search can now be operated entirely via shortcuts

    • Clearing queues no longer requires closing the dialog

    • Pressing the "Enter" key in a single-line property immediately switches the display to multi-line mode

    • Some icons have been updated

  • Upgrade to IGUASU NiFi 1.25.0

Cloud

  • Backup of all relevant data via a dedicated operator

Documentation

  • New shortcuts added

  • Explanation of how to use the NiFi Expression Language

  • Tutorial on using DynamoDB

  • Expansion of the description regarding reuse

IGUASU 2.7

Release Date: December 8, 2023

Highlights

  • 🆕 Ability to see which Diagram other users are currently editing

  • 🆕 Upload your own bundles to easily extend functionality or use a bundle in multiple versions

  • 🆕 Display of a bundle’s version (in cases where multiple versions of a bundle exist)

  • Improved version of the hybrid cloud connection

    • Client-side clustering is supported

    • Improved error handling and error messages; consistent behavior; version checking for future customizations; etc.

  • * Significantly expanded*Expression Language support

    • Button to start active usage

    • Clear display of functions and system variables

    • Display of attributes if they are present in the Data Panel, e.g., from previous runs

  • 🆕 ListenOTLP Processor for processing OpenTelemetry

  • 🆕 EncryptContentAge and DecryptContentAge Processors to support the age-encryption.org specification

  • 🆕 YamlTreeReader for processing YAML as records

  • 🆕 PackageFlowFile Processor

  • Switch to Java 21

  • Upgrade to IGUASU NiFi 1.24.0

  • Saxon Update 12.2

Cloud

  • Enables use of the Operator codebase for the BPC project; Expansion of deployment options (e.g., regarding the registry)

  • Logging adapted for use in Loki

  • Enables the use of additional custom NARs or NARs in multiple versions

Migration

  • Java 21 required

IGUASU 2.6

Release Date: September 12, 2023

Highlights

  • 🆕 Many tables can be exported as HTML/PDF/CSV. For example, this applies to the list of licenses or Processors, as well as the audit log

  • Certificate management is now available not only to admins but also to regular users. Editing, downloading, and deleting remain the exclusive privilege of the admin

  • The results of the global search can be further filtered to provide clearer results. For added clarity, Processor colors and icons are displayed in the results

  • Loading very large files into the editor component and inserting or writing very large amounts of data into other components is prevented. This protects the system and the models, some of which would otherwise store the data

  • Diagram elements can be dragged beyond the edges while creating or editing, causing the Diagram to expand in that direction

  • If changes were made in the background to a module that is currently open, these changes are displayed when saving, and you can choose whether to discard your own changes or overwrite the existing ones

  • 🆕 There is a new Record Reader for reading Excel XLSX files

  • The provenance table in Monitoring displays additional information in a file view

  • TransformXml (XSLT) now runs on Saxon EE 12.2. When creating a new Processor, an initial XSLT is provided

Cloud

  • Certificate creation and distribution between IGUASU and the BPC is now automated via (K8s) operators

Documentation

  • Expansion of the hybrid cloud tutorial

    • Explanation of the technical background and supported use cases

IGUASU 2.5

Release Date: July 17, 2023

Highlights

  • 🆕 Collaboration

    • Shows which other users are currently using IGUASU as well

    • Shows which other users are currently viewing or editing a process group

  • 🆕 User Settings

    • The layout, display settings (e.g., show/hide tooltips), and preferences are saved and restored across logins

    • The last working position is restored

  • 🆕 The JSONataTransformJSON editor now includes error highlighting and code completion

  • Minor improvements

    • When creating a relation, a detailed description of the relation is now displayed

    • Clearer configuration of the XSLT source in TransformXml, as well as the provision of a typical XSLT

    • Improved attribute creation and editing in the Data Panel

    • Improved handling when switching views for Processors with specialized editors (TransformXml, JSONataTransformJSON, ExecuteGroovyScript, …​ )

    • Changes to the content view in a queue are now preserved when switching to another entry

    • RUN ONCE now works for Processors that are disabled

  • Processors

    • PutDatabaseRecord now supports upserts

    • 🆕 GetAzureQueueStorage/PutAzureQueueStorage for Azure Queue Storage using the Azure SDK 12

    • 🆕 ModifyCompression changes the compression of data without placing a heavy load on the Processor.

Cloud

  • SSL endpoints terminated in IGUASU can be configured by the IGUASU operator

  • High memory usage by IGUASU no longer causes the application to restart

Migration

  • TransformXml - If a file or a lookup service was used as the source for the XSLT, this default setting must now be selected once in the TransformXml

  • ListenCloud - The "failure " relation has been removed. Existing “failure” relations should be removed

  • In existing InvokeInubit/InvokeOnPrem and InvokeCloud Processors, the property for asynchronous processing—which is no longer supported—must be removed

Documentation

  • Description of the creation and use of certificates for hybrid cloud communication with INUBIT

IGUASU 2.4

Release Date: May 23, 2023

Highlights

  • 🆕 The JSONataTransformJSON editor now supports JSONATA with syntax highlighting (error display and code completion are still pending)

  • TransformXml outputs errors in XSLT as Bulletins

  • Speed optimizations in the UI

  • 🆕 New MergeMetro Processor (in addition to GetMetro)

    • This not only takes the content preceding the PutMetro Processor but also merges it with the current content —this can be used, for example, for XML or JSON

  • You can now search and filter the BOM/list of licenses

  • When adding items to the list of Processors/Services, you can now search using multiple terms

  • 🆕 The hybrid cloud Processors have now been fully tested with INUBIT

    • ListenInubit, RespondInubit, InvokeInubit

  • Minor improvements

    • Tooltips now appear on inactive buttons as well

    • The event table always selects the active event

    • Improved layout for user management/Display

    • Dynamic Properties can now only be added if the Processor supports them

    • Test execution of Processors is limited to those Processors where it makes sense

    • Ghosted elements for which you do not have permissions are taken into account during editing (they cannot be edited, copied, etc.)

    • Queues of any size are now deleted completely in one go

Cloud

  • Registries from other regions can now also be used in AWS (e.g., shared.Virtimo.cloud)

Documentation

  • The necessary migration steps for local upgrades are described in full

IGUASU 2.3

Release Date: April 12, 2023

Highlights

  • 🆕 Certificate Management

    • Certificates can be uploaded for use in Services and Processors

    • Certificates can be generated and downloaded

  • UIImprovements

    • 🆕 Support for Expression Language and parameters in the form of code completion, syntax highlighting, and inline documentation

    • Filtering option in Global Search

    • Elements for which the user lacks permissions are now displayed as ghosted and are no longer completely hidden

    • Server-side copy and paste in the general text component

    • Tooltips are displayed earlier and rendered better

    • 🆕 The Monaco Editor is supported and used in some cases

    • Spaces at the beginning and end of a property are highlighted to prevent input errors

    • The UI for Parameter Providers supports validation

    • The Properties view adapts to smaller resolutions

    • Adjustments to some Processor icons

  • 🆕 New Processors and Services

    • Processor for writing notifications to BPC

    • Retrieving data from Asana

    • Interaction with Amazon Web Services: Polly, Textract, Translate, and Transcribe

    • Sending data to Salesforce

    • Writing data to Apache IoTDB

    • Writing data to Google Drive

    • Writing data to Box

    • New Processors for encryption and decryption

    • Generating test data with support for records

Cloud

  • 🆕 Support for Amazon EKS

    • The IGUASU Services (e.g., the Playground) on the Virtimo Cloud now all run on Amazon EKS

  • 🆕 Kubernetes deployment of IGUASU via a dedicated K8s operator

Migration

  • Some properties on the Processors and Services related to BPC have been renamed

Documentation

  • The ValidateJSON processor is described in the JSON tutorial

  • The NiFi documentation (e.g., for the description of the Expression Language) is available at https://docs.Virtimo.net

IGUASU 2.2

Release Date: December 8, 2022

Highlights

  • 🆕 New Processors and Services

    • Listing and retrieving data via SMB

    • Querying data from Airtable

    • * Using*Azure Event Hub as a data sink via AzureEventHubRecordSink

    • Listing and retrieving data from Dropbox

    • Listing and retrieving data from Box

    • Retrieving data from HubSpot

    • Collecting data from Workday

    • Retrieving data from Zendesk

    • Loading data into Apache Iceberg

    • Loading data into Snowflake using Snowpipe Ingest

    • UpdateDatabaseTable, which is very helpful when the data schema evolves and the tables being written to require DDL changes

    • Publishing to MQTT using the record mechanism, which is significantly more efficient and flexible

  • 🆕 Pre-release of Hybrid Cloud Processors and Services for connecting INUBIT to the IGUASU Cloud(not yet production-ready!)

  • 🆕 Support for various registry clients

  • 🆕 Queue overflow is now displayed directly in the diagram

  • 🆕 New information about the Processor

    • Which attributes does the Processor read or write?

    • Is the Processor only available in specific roles (e.g., Admin) (“restricted”)?

    • Which dynamic properties are expected, and what do they do?

    • Does the Processor have a state?

    • Can the Processor have incoming connections, or does it require them?

    • Does the Processor place a particularly heavy load on certain system resources, such as MEMORY?

  • Registry

    • 🆕 Using our Bitbucket (Git) as the backend for version control in the registry

    • 🆕 Importing and exporting flows directly from the registry

  • Documentation

    • General overhaul

    • 🆕 New tutorial on collaboration between IGUASU and the BPC

    • 🆕 New tutorial on working with JSON

    • 🆕 New How-To on Metro Processors

    • The documentation is still installed as before—but can also be found along with the other documentation in the Virtimo portfolio at https://docs.Virtimo.net/

Migration

  • Our own JSLT Processor has been removed, as NiFi now includes one

IGUASU 2.1

Release Date: August 16, 2022

Highlights

  • 🆕 Metro Processors added

    • Feature 1: Using FlowFiles from previous steps in the flow

      • Example: The content of the FlowFile is the result from an external system, but you actually still need the results from three steps earlier. Otherwise, or in INUBIT, this is often solved by temporarily storing the content in variables or using a bypass

      • → Using the Metro from the previous Processor to the current one

    • Feature 2: Shared error handling

      • In IGUASU, there are no scopes (as in INUBIT, for example). If you want to handle errors across Processors via a “shared path,” you have to create many chaotic connections between the Processors

      • → Using Metro for shared error handling

  • 🆕 Audit Log – available in the Monitoring tab

    • Displays all configuration changes, such as editing a Processor property, along with the time and the person*who made* the*change*

  • * Expanded*parameter support

    • Controller Services can be assigned to parameters (currently using the ID) and then used as normal with properties. This allows Controller Services (e.g., database access via DB pool services) to be decoupled even more effectively

    • Scheduling (when and how often a Processor runs) can be configured via Parameters. This means, for example, that the scheduling for a group of specific Processors could be slowed down or sped up

  • Upgrade to IGUASU NiFi 1.17.0

  • Dynamic properties can now also contain sensitive values (e.g., passwords) if the Processor supports this (e.g., header values in InvokeHTTP)

  • Detailed metrics on CPU usage at the Processor level

  • 🆕 New Processor allows queries on data coming from Salesforce

  • 🆕 New ConsumeTwitter Processor replaces the previous GetTwitter and uses the latest Twitter API

  • 🆕 New Processor for accessing files on Google Drive

  • HTTP/2 support (ListenHTTP, HandleHttpRequest)

Cloud

  • Java 17

  • AWS/EKS support

IGUASU 2.0

Release Date: June 22, 2022

Highlights

  • 🆕 New display for bulletins/errors

    • The icon for bulletins has been moved to the header

    • There is a new central panel that is prominently displayed as soon as bulletins are available

    • Bulletins for Processors, services, and Reporting Tasks, as well as system bulletins

    • Services and Reporting Tasks with errors are also highlighted in red

    • Bulletins or error statuses (“red Processor”) are no longer automatically displayed for 5 minutes; instead, users can clear them

  • 🆕 There is a new central tree view of all Process Groups

  • 🆕 The available Processors and Services are displayed in the system information

  • 🆕 The Processors now support a configurable retry for outgoing relations

  • 🆕 Selected items can now be moved directly into Process Groups using the mouse. They can also be moved to any Process Group via the context menu

  • 🆕 A list of the software components in use, along with their licenses, is now provided

  • These can now be created directly in Properties that configure Services.You can select the Process Group where the service is to be created

  • When changing Parameter Contexts for Process Groups, this is now done via a dialog that displays the necessary operations—such as stop/start, etc.—and the result

  • 🆕 Processors can now also be verified —this is used, for example, to check whether a configured system is reachable

  • The documentation layout now matches that on docs.Virtimo.net; you can also search within it

  • JSONataTransformJSON can now write the entire output to a single attribute

  • 🆕 PutBPCAuditLog Processor

    • For easily writing entries to the BPC audit log

  • PutBPCProcessLog Extensions

    • After configuring the associated BPC, the BPC logger can be selected directly from a list of available loggers

    • If there are already entries in the log, the first entry can be retrieved as a template for creation

  • ListenBPCFlowStarter Extensions

    • You can now configure the name and description, which will then be visible in the BPC selection

    • The BPC session (complete JSON) can optionally be loaded into an attribute for further use in the flow

  • With a corresponding UUID, you can navigate to execution instances within IGUASU —this is used, for example, from within the BPC

  • Extensions to XmlMerge

    • All attributes from all branches can now be included

    • It is now possible to prevent the addition of extra root tags if they already exist

  • Apache NiFi has been updated to version 1.16.3

  • JSONataTransformJSON can now also be applied to attribute values or an empty JSON

Migration

The functions provided by IGUASU in the JSONataTransformJSON Processor have been renamed to distinguish them from existing or custom functions.

  • $uuid() → $nfUuid()

  • $el(<el>) → $nfEl(<el>)

  • $attribute(<name>) → $nfGetAttribute(<name>)

  • $attribute(<name>, <value>) → $nfSetAttribute(<name>, <value>)

  • $lookup → $nfLookup(<key>)

IGUASU 1.7

Release Date: February 9, 2022

Highlights

  • 🆕 New Virtimo theme (compatible with BPC 4 and INUBIT 8)

    • The ability to use different themes has been enabled

  • 🆕 New, optional table view for attributes in all relevant places in Flow

  • Filtering option for attribute views

  • 🆕 Extensions to parameters and Parameter Contexts

    • Inherited Parameter Contexts are supported

    • New parameters can be created directly from existing properties

    • Parameter Contexts can be protected by permissions

    • You can view all Process Groups that that use it

    • A context’s parameters can be edited directly within the Process Group

    • Import and export of Parameter Contexts

  • Comments on Controller Services are supported

  • 🆕 JSONataTransformJSON now supports lookups

  • Permissions for Process Groups can now be explicitly inherited or overridden

  • Flow descriptions are now available everywhere during versioning

  • 🆕 Use of Virtimo Keycloak in the cloud (currently at dev.Virtimo.cloud)

    • The registry now also uses Keycloak

  • Display of version information for IGUASU in System Diagnostics

  • Consistent read-only mode in production mode

    • This means that modification operations must always be performed explicitly

  • 🆕 Deep links are supported across logins

    • A unique link can be retrieved for each Processor

  • New keyboard shortcuts for global search and the overview

  • New version of the text editor (no more memory leaks)

  • 🆕 New “How-to” section in the documentation

    • Visualizations and descriptions of frequently used functions in the flows

    • Provision of importable Process Groups for clarification and testing

  • 🆕 Drivers, such as JDBC database drivers, can now be uploaded and selected directly where needed

Migration

  • In the TransformXml Processor, when using 'Surround input with <xml> tag', the JSON is now additionally wrapped in a CDATA tag so that entity references such as '&' do not cause any issues. If the CDATA has already been added manually, it must be removed.

IGUASU 1.6

Release Date: December 6, 2021

Highlights

New/Enhanced Virtimo Processors

  • 🆕 PutBPCProcessLog Processor for logging process data to a Virtimo Business Process Center

    • BPCController Service for reusable configuration of the BPC endpoint

  • 🆕 Processor for easily invoking flows from the Business Process Center: ListenBPCFlowStarter

    • BPCListenerController Service for defining the central endpoint for various Listener Processors

    • ListenBPCResponder Processor for controlled responses

  • 🆕 Processor for mapping/transforming JSON based on JSONata: JSONataTransformJSON

    • Support for using the Expression Language

    • Support for reading and writing attributes

    • Live editor capability—every change is visible immediately

  • 🆕 Saxon EE is included with the TransformXml Processor

  • 🆕 New ModifyPDF Processor to populate form fields in PDFs

  • 🆕 New Minifier Processor to automatically provision a Process Group’s YAML for the remote flow. This allows a Remote Flow to automatically retrieve new versions of its configuration

General

  • UI update with a lighter look

  • 🆕 Centralized provenance showing past executions of all flows

  • 🆕 Centralized monitoring of all components in use

  • 🆕 Global Search

    • Free-text search across all available components, as well as navigation directly to the component

  • Expansion of the Services’ user interface:

    • Bidirectional links to Processors and other Services

    • Enable/disable all Services in a group, as well as its subgroups

    • Display of the affected, linked components and the success of the action for each component

  • 🆕 Save/Load and Copy/Paste input data and attributes in the Content Panel and the Queue

    • This allows any previously processed data to be easily reused for testing other Processors

  • Selected modules can now also be moved in the Diagram using the cursor keys (together with Shift for pixel-by-pixel movement)

  • To create modules, they can now be dragged directly from the toolbar into the diagram using drag-and-drop

  • All relations of a new Processor are now auto-terminated by default. Relations that are already connected can no longer be selected here either. When creating a new relation, you can see which relations already have connections

  • 🆕 Replaying an event (“Replay”) is now supported

  • The documentation now always displays an overview of all available documentation (User Guide, Admin Guide, etc.)

  • Process Groups can be shared with individual user groups

  • A hung Processor that can be terminated now clearly indicates this directly in the UI

  • 🆕 Display of the server’s system diagnostics (JVM, hard drive, etc.)

  • 🆕 Process Groups can now be downloaded as JSON. This JSON can then be used when creating new Process Groups

    • Templates are no longer supported, as this functionality is available via JSON and the use of the registry/versioning

  • 🆕 For use in Remote Flow, a Process Group can be downloaded as YAML

  • 🆕 Registry users can be imported from the current IGUASU

  • 🆕 The default backpressure can be configured specifically for individual Process Groups

  • 🆕 "Run Once" for a one-time execution of a Processor/flow

  • Parameters can also be applied to sensitive properties (passwords)

Operation

  • 🆕 IGUASU now always runs in a secure mode (initially in single-user mode)

  • Optimization of startup scripts (e.g., via a new ` iguasu-env.sh` file, which specifies the Java version used)

  • Administration manual updated to include an upgrade guide

Components

  • 🆕 NiFi Server 1.15.0 integrated (previously 1.13.x)

Cloud

  • 🆕 Client/server authentication over HTTPS with the cloud is now supported

Migration

  • Since IGUASU now runs in single-user mode by default, the user must be set with their password before the first startup (see Setting Up Single-User Authentication)

  • Since templates are no longer supported, all templates that do not exist as process groups in the IGUASU instance to be migrated should be imported before migration. After the migration, they can then be exported as JSON and removed if necessary

  • Starting, stopping, etc., of Processors (or entire Process Groups) is now only possible via the context menu—the buttons in the toolbar have been removed

IGUASU 1.5

Release Date: July 19, 2021

Highlights

Versioning

Deployment and support for the * 💥IGUASU Registry 💥*

  • 🆕 Versioning of Flows (at the process group level)

    • Start/stop versioning of a flow

    • List and check in/out versions

    • Create a new instance of a versioned flow

  • 🆕 Reuse (of functions encapsulated in process groups) through the use of versioning

  • 🆕 View local changes

    • Highlighting in the diagram

    • List of changes with a link to the component

    • Display of changes in subgroups

  • 🆕 Use any number of different registries and buckets in the flows

  • 🆕 Manage registries, including users, groups, and buckets

Cloud

  • 🆕 Provision of Prometheus-based monitoring in the cloud

  • 🆕 Liveness/readiness probes for IGUASU in Kubernetes

  • Storage configurations optimized

General

  • Improved clipboard operations (cut and paste anywhere)

  • Better synchronization between the diagram and module editor when changes are made

  • Expanded display of a Processor’s executions

    • Complex execution lines are loaded in parts only

    • It is also possible to load only the event data from a single Processor (without executing the entire flow)

  • XmlTransformer (XSLT): Resolution of external references (e.g., DTDs) can be disabled

  • Documentation: Tips on operating and optimizing flows have been added

Press Esc to exit full screen
Modal image placeholder
Press Esc to exit full screen