Pipeline Detail Page
Upon clicking a pipeline name from the Pipelines list, you will be taken to the detailed page for that specific pipeline. Here you'll find comprehensive information and controls for monitoring and managing the individual pipeline.
Pipeline Information
At the top of the page, the name of the pipeline is displayed along with its current status. You'll also see buttons for controlling the pipeline's run state, such as:
- Play/Pause: Start or pause the pipeline execution.
- Rename: Change the name of the pipeline.
- Open in Pipeline Builder: Open the pipeline in the Pipeline Builder for modifications.
- Delete: Remove the pipeline from your list.
Run List and Alerts
Two tabs are available for detailed metrics and history:
- Run List: Shows a log of all the runs associated with this pipeline.
- Alerts: Displays the number of alerts, allowing you to review any issues that have arisen.
Run List Tab
Under the Run List tab, you will see a table with the following columns:
- Run Id: Unique identifier for each run.
- Progress: How far along the run is.
- Status: Indicates whether the run was successful (green) or not (red).
- Start Time: When the run was initiated.
- Duration: How long the run took.
- Alerts: Number of alerts generated during the run.
You can select the timeframe for the runs displayed, such as the last 14 days, to help focus on recent activity.
Alerts Tab
The Alerts tab in the pipeline detail page provides a critical overview of the health and performance issues within a specific pipeline. It offers insights into the operational challenges that may require your attention.
Viewing Alerts
When you navigate to the Alerts tab, you're presented with a list of alerts that the system has generated for the pipeline. Here you'll find:
- Total Alerts: The total number of alerts generated for the selected timeframe, which you can adjust using the timeframe dropdown (e.g., Last 14 Days).
- Alert Severity: Each alert is categorized by severity level, such as CRITICAL or MEDIUM, which is visually represented by color-coded labels for easy identification.
Alert Details
For each listed alert, the following information is displayed:
- Alert: The nature of the alert and a brief description.
- Node Id: The identifier for the specific component within the pipeline that triggered the alert.
- Timestamp: When the alert was generated.
- Pipeline Name: The name of the affected pipeline, which also acts as a hyperlink to navigate back to the pipeline's detail page.
- Receivers: Indicates who has been notified about the alert and provides a "View Details" link for further investigation.
- Details: A brief summary of the alert and errors encountered during the pipeline run.
Responding to Alerts
The Alerts tab is designed to help you:
- Prioritize: Quickly address the most critical issues that could impact your data workflows.
- Troubleshoot: Follow the "View Details" link to get more context on the alert, which can aid in diagnosing and resolving issues promptly.
Utilize this feature to maintain the integrity and reliability of your pipelines, ensuring smooth and uninterrupted data processing operations.