Snowflake: Schedule, Trigger, Monitor, and Orchestrate Operations
Snowflake is a cloud-based data warehousing platform that allows users to store, manage, and analyze large amounts of data. It offers high performance, scalability, and ease of use by separating storage and computer resources.
This Universal Task allows Stonebranch users to orchestrate, schedule, trigger, and monitor the Snowflake load and unload process from different data sources (cloud storage or local VMs) directly from the Universal Controller. It uses Python libraries to perform all functions listed in the following sections. Alternatively, you can also perform all these operations using the Snowflake JDBC driver which you can add to the Universal Controller libraries, and use SQL Task to perform any operations with Snowflake (Downloading / integrating the JDBC Driver | Snowflake Documentation ).
Key Features:
Users can orchestrate the following Snowflake functionalities:
Snowflake loading processes:
- Load data from AWS S3 to Snowflake.
- Load data from Azure storage to Snowflake.
- Load data from Google storage to Snowflake.
- Load internal stage file to Snowflake table.
- Copy from local server to internal staging.
Snowflake unloading processes:
- Unload Snowflake data to AWS S3.
- Unload Snowflake data to Azure storage.
- Unload Snowflake data to Google storage.
- Unload Snowflake data to internal staging.
- Unload from internal stage to local server.
Snowflake execute commands:
- Execute a Snowflake command.
What's New (v 1.2.0)
- Addition: Key pair Authentication
| Extension Name: | CS Snowflake |
|---|---|
| Product Component: | Universal Agent, Universal Controller |
| Version: | 1.2.0 |
| Vendor: | Snowflake |
| Type: | Free |
| Compatibility : | UC/UA 7.0 and above |
| Support: | Community Created |