Integration

Last updated 10/02/2026

The Integration module is a core component of the AE DataOps Platform and handles data import and export.

If you need to bring external data into the platform, you can import it quickly with the Integration module. If you need to export data to your own data lakehouse to support data applications, the Integration module handles that efficiently too.

To create a data source and an integration plan:

1. Go to Integration > Data Sources and click + Data Sources in the upper-right corner.

2. Select a data source type (for example, MySQL) and click Next step in the upper-right corner.

3. Enter the data source name and connection information, then click Complete in the upper-right corner.

4. Click Offline Sync on the left, then click + Integration plan in the upper-right corner.

5. On the Create an integration plan page, select the Data Source and Data Target, click Generate field to configure field mapping, fill in the basic information, and then click Save in the upper-right corner.

Data import process

1. Prepare data

Make sure the external data to import is ready, and confirm where it's stored (such as OSS).

2. Create a data source

In the Data Sources module, create a data source that matches the external data storage type (such as OSS).

3. Configure an offline sync plan

• Go to the Offline Sync module and create an offline sync integration plan.
• Set the external data as the Data Source, and specify a target table in the workspace as the write target.

4. Run the data import

• One-time import: run it manually on the integration plan details page.

• Scheduled import:

  1. Mount the integration plan to a Flow.
  2. Configure the Flow's scheduling policy. The integration plan then runs automatically with the Flow.

Data export process

1. Prepare the data to export

Make sure the workspace data to export (Built-in Warehouse data) is ready.

2. Create a target data source

In the Data Sources module, create a data source that matches the target storage type (such as MySQL).

3. Configure an offline sync plan

• Go to the Offline Sync module and create a new offline sync task
• Data Source: select the workspace data to export (Built-in Warehouse)
• Write target: specify the corresponding table in the target data source

4. Run the data export

• Export now: run it manually on the plan details page.

• Scheduled export:

  1. Mount the integration plan to a Flow.
  2. Configure the Flow's scheduling policy. The integration plan then runs automatically with the Flow.