Create a Flow
Add a Flow
On the Flow list page, click + Flow in the upper-right corner to open a new tab for adding a Flow and start creating it. You can also open the page for adding a Flow from Create New Flow in the tab add menu, or from the Create New Flow button on the New Tab page.
First set the Flow Name and Owner. Then click Create to create the Flow and open its edit page.
Note: Flow names must be unique within a workspace and can't be changed.
Dual-environment modes of the Flow detail page
After a Flow is created, you can go to its detail page for further operations.
The Flow detail page has two modes: Dev Mode and Production Mode.
Dev Mode
Dev Mode shows the development environment Flow and lets you edit and debug it. The page looks like this:
The page layout has three sections: the tool area on the left, the DAG area on the right, and the navigation area at the top.
- Tool area
The tool area in Dev Mode has several tabs:
- Add Node tab
The Add Node tab shows all available node types. To add a task node, drag a node card onto the DAG.
After you drag a node onto the DAG, the Create node dialog appears. Set a name for the new node here (node names must be unique within a Flow). Click Create to create the task node, or click Create and edit to create it and immediately open its edit page so that you can edit it.
- Task Node tab
The Task Node tab shows all task nodes in the current Flow, with a separate section for the task nodes being edited. Click a task node's name to expand its detail panel. If the node is being edited, you can edit it directly. To exit a node's editing state, click the × button next to the task node under Editing Tasks. You can also click the + button on the right of the task node section to create a task node.
- Table Dictionary tab
The Table Dictionary tab shows the tables available in the current workspace as a directory tree, organized level by level as warehouse → catalog → database → table / view. The top of the tab has only a search box, a refresh button, and a + button. Enter a table name in the search box to locate the table you need more precisely.
When you hover over a table, a pop-up window shows the table's name and comment, along with three icons: Copy table full name, Copy SQL query, and Copy DDL.
When you click a table, its field list appears below the Table Dictionary area. You can view the fields of the selected table, select checkboxes to generate a query that contains the selected fields, and search for the fields you need. Click Open in a new tab in the upper-right corner of the field list to open the table's detail page and view more detailed information.
- Parameters tab
The Parameters tab shows the parameters available to the current Flow, in two sections: Workspace Params and Flow Params. ${bd} is one of the preset workspace parameters and represents the base date for data settlement (format yyyy-MM-dd, offset -1). Other parameters include ${btz}, ${env}, ${st}, and ${ws_prod_db}. For more information, see Flow parameter settings and Parameter management.
Production Mode
If your Flow has been released, clicking the Flow name on the Workflow Management page takes you directly to the detail page in Production Mode. You can also switch the detail page to Production Mode in Dev Mode by selecting Production Mode from the mode drop-down at the top (this option is grayed out if the Flow hasn't been released). Production Mode looks like this:
The page layout has three sections: the basic information area on the left, the Flow display area on the right, and the navigation area at the top.
- Basic information area
The basic information area shows the basic information of the current Flow, with two tabs below it: Scheduling configuration and Operating history.
- Flow display area
The Flow display area has two views: DAG and List.
The DAG view is similar to Dev Mode: you can view the Flow's DAG, and if the Flow has already run in production, you can view the instance's execution status directly on the DAG. The upper-left corner of the DAG view has a Show latest instance toggle.
The List view shows the task nodes in the Flow's production environment as a list, along with their basic information.
In the DAG view or List view, click a node to open its detail panel. In this panel, you can view the node's main content, configuration, and dependencies. If the node has run in production, click View instances to go to the Ops module and view the node's instance information. You can also click Dev in the panel to quickly switch to Dev Mode and edit the node. The panel also has Execute node and Overwrite Dev Env buttons.
- Navigation area
Finally, the navigation area provides a set of operations available in Production Mode:
- Edit basic info
- Execute
- Offline: deletes the Flow's production environment. After it goes offline, the Flow can't run until you release it again
- Add My Subscription
- Refresh: refreshes the current page
DAG layout
The DAG layout is optimized with a cubic Bézier algorithm. It supports horizontal and vertical layouts, optimizes the layout automatically, and improves how multiple nodes are displayed