Pipeline Builder
The Pipeline Builder is a visual tool allowing you to create and edit data processing pipelines with ease. It provides a drag-and-drop interface to design the flow of data through various components.
Interface Overview
When you enter the Pipeline Builder, you'll see:
- Pipeline Status: Indicated at the top, showing whether the pipeline is running, paused or not configured yet (draft).
- Component Nodes: Visual representations of each component in your pipeline.
- Connections: Lines that connect the nodes, indicating the flow of data from one component to the next.
- Add Component Button: Located on the top-right, allowing you to introduce new components into your pipeline.
Each node represents a pipeline component with a brief description of its function, input, and output. Green indicators on the nodes denote readiness, while red signifies components that are not yet configured.
Adding Components
To add a new component to your pipeline:
-
Click the "Add Component" button, which will open a modal displaying available components.
-
In the modal, you'll see a list of components, each with:
- Icon and Name: A visual representation and the name of the component.
- Description: A short explanation of the component's functionality.
- Input/Output: Information about the expected input and the output of the component.
-
Select the component you want to add by clicking on it. You can then connect it to other components to define your pipeline's flow.
The Pipeline Builder's intuitive design simplifies the process of constructing complex data workflows, enabling you to create powerful pipelines that meet your specific data processing needs.