Cron Scheduler
The Cron Scheduler is an essential component within DatErica's Pipeline Builder, allowing you to define precise timing for your data pipeline executions.
Overview
The Cron Scheduler provides the mechanism to schedule when a pipeline should run, from simple intervals like every 5 minutes to more complex schedules using custom cron expressions.
Configuration
Configuring the Cron Scheduler is straightforward:
-
Schedule: Choose how often your pipeline should be triggered. Options include predefined intervals such as:
- Every 5 minutes
- Every hour
- Daily at midnight
- You can specify a Custom cron expression for more granular control.
-
Timezone: Select the appropriate timezone for your schedule. This ensures that your pipeline runs exactly when it's supposed to, according to local time.
-
Save Config: Once you've configured your schedule and selected the timezone, simply click 'Save Config' to apply the settings.
Using Custom Cron Expressions
For specialized scheduling needs, the Cron Scheduler accepts custom cron expressions. This powerful feature allows you to create schedules that are not covered by the standard options.
- The expression follows the standard cron format of five fields: minute, hour, day (month), month, and day (week).
- For assistance with cron expressions, a link to resources or a help section is provided within the configuration modal.
By using the Cron Scheduler, you can ensure that your data workflows are executed consistently and reliably, in alignment with your operational requirements.