Struct PipelineConfig 

pub struct PipelineConfig {
    pub pipeline: PipelineSection,
    pub checkpoint: CheckpointSection,
    pub backpressure: BackpressureSection,
    pub metrics: MetricsSection,
    pub source: ComponentConfig,
    pub deserializer: Option<ComponentConfig>,
    pub sink: ComponentConfig,
}

Root of a pipeline’s configuration file.

One process runs one pipeline; one file configures one process.

Fields

pipeline: PipelineSection

Identity and thread budget.

checkpoint: CheckpointSection

Watermark commit policy.

backpressure: BackpressureSection

In-flight budget and pause/resume hysteresis.

metrics: MetricsSection

Exporter selection and observability knobs.

source: ComponentConfig

The source component (opaque body).

deserializer: Option<ComponentConfig>

Optional deserializer component (opaque body). Sources that emit ready-made records need none.

sink: ComponentConfig

The sink component (opaque body).

Implementations

impl PipelineConfig

pub fn from_str(text: &str) -> Result<PipelineConfig, ConfigError>

Load from YAML text: interpolate ${VAR} forms against the process environment, parse, and validate.

pub fn from_path(path: &Path) -> Result<PipelineConfig, ConfigError>

Load from a YAML file (read, interpolate, parse, validate).

pub fn validate(&self) -> Result<(), ConfigError>

Cross-field validation, run automatically by the loaders. Public so programmatically built configs (tests, etl-test) get the same checks.

Trait Implementations

impl Debug for PipelineConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for PipelineConfig

fn deserialize<__D>( __deserializer: __D, ) -> Result<PipelineConfig, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for PipelineConfig

fn eq(&self, other: &PipelineConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for PipelineConfig