Managed Apache Spark™ Service on Delphi Cloud

Fast processing of big data

Apache Spark^™ combines machine learning, analytics, and online data processing capabilities. It runs in RAM and provides fast calculations, helping to analyze information.

Automated and up-to-date

Instantaneous deployment of Apache Spark clusters and automatic installation of the latest versions. Specify the relevant version during setup, and your environment will always meet the latest requirements.

Flexible optimization

The service is optimized for important tasks: batch transformation, streaming, machine learning, and analytical queries. It is possible to connect external libraries to effectively work with data.

Intellectual scaling

Automatic resource management allows you to dynamically allocate additional CPU and memory as loads increase, and free up unused resources as loads decrease.

Easy administration

Built-in monitoring and logging automate routine processes, with no need to manually collect logs, process files from servers, and configure visualization.

Technical efficiency

The service supports automatic system deployment, version control, optimization for specific tasks, resource scaling, and continuous infrastructure monitoring.

The service can be used in combination with Apache Airflow^™ to create an effective ETL tool. The system scales automatically by transforming and uploading structured data from corporate storage.

ML specialists can use the service on big data for rapid prototyping and testing models. The service makes it easy to create clusters with individual configurations and experiment with versions of machine learning libraries.