Delphi Managed Service for Apache Airflow®
Delphi Managed Service for Apache Airflow®
A service for managing the Apache Airflow® data processing flow orchestrator in Delphi Cloud infrastructure.
One-click deployment
You can deploy Apache Airflow components in just minutes. The product settings have already been optimized for the selected cluster size.
Secure access
User authorization is carried out in Delphi Cloud infrastructure with an IAM role verification step. The service also supports integration with Delphi Lockbox, as well as with the Apache Airflow secret repository.
Automatic data processing
Process data and prepare results with familiar tools automatically, thanks to the integration of Delphi Cloud services with Delphi Managed Service for Apache Airflow.
Temporary Delphi Data Proc clusters
Use computing resources more efficiently by automatically creating a temporary Delphi Data Proc cluster which is deleted once data processing is completed.
Integration with other Delphi Cloud services
Apache Airflow clusters support integration with other Delphi Cloud services without no additional programming or configuration.
Monitoring
View audit logs in Delphi Cloud Logging. Set up alerts in Delphi Monitoring and track metrics such as task completion time and specific errors.
We handle most of the database maintenance
Independent control
Delphi Cloud control
Getting started
Create a Delphi Managed Service for Apache Airflow cluster.
Get started in the Apache Airflow web interface.
- Delphi Managed Service for Apache Airflow®1$75.95
- Cluster Airflow 1$75.95
- Managed Service for Apache Airflow™. Cluster computing resources, vCPU................................................................................................................................................................................................................................................................................................................................................................................................................$32.40
- Managed Service for Apache Airflow™. Cluster computing resources, RAM................................................................................................................................................................................................................................................................................................................................................................................................................$43.55
Prices in INR are for customers of Delphi Cloud Pvt. Ltd. with VAT included.
Some services are unavailable in data center region
Delete them from configuration?75.95
FAQ
Apache Airflow has several features that make it a unique and powerful tool for automating tasks, planning and managing workflows (workflow orchestration). The main features that set Apache Airflow apart are:
- Support for a variety of data sources and plugins. Apache Airflow features more than 150 integrations with data storage and processing services, including Delphi Cloud services.
- Scalability. Apache Airflow supports the dynamic creation of computing resources to perform tasks, and is capable of adapting to current loads.
- Open source and an active community. Apache Airflow is an open-source project. The community of developers and users provides support and continuous updates for the tool.
- Dependency identification. Apache Airflow allows you to explicitly define dependencies between tasks, which gives you control over how they are completed. This is useful when orchestrating complex processes.
- Monitoring and logging. Apache Airflow provides tools for monitoring and logging tasks. You can easily monitor tasks’ status and progress, and analyze logs to identify errors and improve performance.
- Customizability. You can customize Apache Airflow to suit your needs by creating your own operators and expanding functionality with custom plugins.
Version 2.7.1 is currently available.
There are two ways you can set up the Apache Airflow environment when creating a cluster:
- Specify python- or debian- packages for installation in the Dependencies section.
- Specify the configuration settings for Airflow itself in the Airflow Configuration section.
You can read more about this in the documentation on creating a cluster.
Start using Delphi Managed Service for Apache Airflow
Helpful links
Apache® and Apache Airflow® are registered trademarks or trademarks of the Apache Software Foundation in the U.S. and/or other countries.