Creating Workflows
Workflows are YAML-defined multi-step pipelines that run as Kubernetes Jobs in the apps namespace.
Workflow Structure
Section titled “Workflow Structure”A workflow is defined in YAML with the following structure:
name: my-workflowdescription: Example data processing workflowsteps: - name: fetch-data image: python:3.12-slim command: ["python", "-c", "print('fetching data...')"] - name: process image: python:3.12-slim command: ["python", "/scripts/process.py"] env: - name: INPUT_PATH value: /data/input.csvCreating a Workflow
Section titled “Creating a Workflow”- Navigate to Workflows
- Click New Workflow
- Enter the workflow YAML or use the guided form
- Click Save
Running a Workflow
Section titled “Running a Workflow”From the Workflows list, click the Run button next to a workflow. A Job resource is created in the apps namespace and the steps execute sequentially.
You can monitor the run status in real time and view logs for each step.
Workflow Variables
Section titled “Workflow Variables”Use environment variables to parameterize your workflows:
steps: - name: process image: my-processor:latest env: - name: DATASET value: "{{ .Input.dataset }}"Pass variables when triggering the workflow from the Run dialog.
Scheduling
Section titled “Scheduling”Workflows can be scheduled to run automatically using cron syntax:
schedule: "0 2 * * *" # Run daily at 2amScheduled workflows appear in the Workflows list with a clock icon.