DataOps Platform
Overview
Welcome to the Agentic Engine DataOps Platform. As an important part of the AE system, this platform provides enterprise data developers with efficient data development and governance solutions, helping enterprises fully unlock the value of their data and improve business performance.
Compared with traditional data development platforms, the core advantage of this platform is its deep integration with the AE system's matrix of modules. Through cross-module data interconnection, the results of data development can efficiently empower analytics, operations, and other business departments.
After you log in to the platform, you land on the Dashboard page. Dashboard is the AE Agent troubleshooting task page (BETA), which includes New task, Archived, and Alerts. For details, see Dashboard. Use the top navigation bar to switch between feature modules.
In this documentation series, you'll learn how to use each module of the DataOps Platform:
Integration module
Provides data integration capabilities, supporting fast and stable data sync between a wide range of heterogeneous data sources, such as MySQL, OSS, S3, Redis, and ClickHouse. You can use Offline Sync plans to sync data from source databases to target databases.
Catalog module
Makes full use of Trino Connector capabilities to directly access first-party data mounted to the AE internal warehouse without moving any data, so you can quickly put your enterprise's existing data systems to use. It's one of the signature features of the AE system.
Dev module
The core module of the DataOps Platform. It supports visual Flow orchestration that simplifies complex processes, helping developers quickly build secure and reliable end-to-end data pipelines, multiplying the efficiency of data teams, and strongly driving business innovation and growth.
Ops module
Intelligent full-lifecycle instance monitoring and management. It monitors and checks how Flows run, helping data developers troubleshoot online issues.
IDE module
Provides powerful data query capabilities, making it easy for data developers and administrators to validate data, check data quality, get the data they need, and more.
DataApp module
With the DataApp module, you can authorize data assets in a space, such as databases, tables, and views, to other projects or workspaces: authorized projects can use them in BI dashboards and Model-Mapping Configuration, and authorized spaces can carry out further development based on the authorized assets. The DataApp module currently provides the Data Authorization feature, which includes Resource Group, Auth Strategy, and Auth Tool.
Workspace Settings
The space management module of the DataOps Platform. Space admins can manage space-level preset parameters, members, roles, and more in this module.