Inter-Cloud Data Monitor

This Universal Extension provides the capability to monitor objects (files/directories) on various major Cloud Providers including AWS, Google Cloud, Microsoft Azure and trigger Universal Events, which can be used for execution of tasks and workflows. It can be executed as a standalone UAC Task, however in order to benefit from the full functionality and scalability of UAC, it is suggested to be used in conjunction with Universal Monitor Triggers and Universal Monitor Tasks.

Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include:

• Amazon S3
• Google Cloud Storage
• Microsoft OneDrive Business, including Sharepoint
• Microsoft Azure Blob Storage
• Hadoop Distributed File Storage (HDFS)
• Local file system (Linux, Windows)
• HTTP(S) URL

Key Features:

This Universal Extension supports the following key features:

Features

• Monitor Object Creation, Change (based on modification time) and Deletion using advanced filtering capabilities
• Generates Universal Events for each entity the monitor has detected, which can be used to trigger other tasks and workflows.
• Large set of possible parameterization and coverage of remote storages.
• Plug & Play, easy installation without the need to install external dependencies.
• Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow.

• Enhanced observability with event metrics, providing users with detailed statistical insights into events processed across all task instances.

• Shared configuration with Cloud Data Transfer.

What's New v 2.0.1

Fixes

• Fixed an issue where an event produced by this integration caused a crash on certain extensions.

What's New v 2.0.0

Enhancements

• Installing external dependencies is no longer required.
• The extension can now automatically attempt to update and store short-lived OneDrive tokens without any extra configuration.
• It is now possible to detect whether an event involves a directory.
• Introduced observability features using event metrics.
• Added the option to skip SSL Verification when updating Credentials.
• Credential updates on the Universal Controller are performed only when necessary.
• Other user experience improvements.

Deprecations and Breaking Changes

• Event templates have been reduced to a single template.
• Changed extension prefix to ue_cloud, providing the capability to share the same configuration with Cloud Data Transfer.
• Refer to the documentation's migration guide if upgrading from version 1.

Fixes

• Action Monitor On Change error when a file was created.
• Events were not published in some cases when field Recursion Depth was set to a value greater than 1.
• Unchecking the Use Storage Modtime field resulted in task failure.
• Running the task with any local user is now supported with Agent versions where issue D-13034 is resolved.
• Update Credentials functionality is corrected to retain the existing Key Location value.
• Task will not fail when using Windows paths including whitespaces.