Struct PipelineRuntime 

pub struct PipelineRuntime<S>
where
    S: Source,
{ /* private fields */ }

One pipeline process: source, per-thread chains, and a sink, assembled per docs/DESIGN.md § Process anatomy.

The caller creates the shared InflightBudget first and wires it into the chain terminals (which add on enqueue) and the sink workers (which sub on durable write or abandonment) before handing everything here.

Implementations

impl<S> PipelineRuntime<S>

where S: Source + 'static,

pub fn new( config: PipelineConfig, source: S, chains: impl FnMut(usize) -> Box<dyn RunnableChain> + Send + 'static, sink: SinkRuntime, budget: Arc<InflightBudget>, ) -> PipelineRuntime<S>

Assemble a runtime. chains builds one erased chain per pipeline thread (thread index in).

pub fn with_options(self, options: RuntimeOptions) -> PipelineRuntime<S>

Override runtime options (returns self for chaining).

pub fn with_io_runtime(self, io: Runtime) -> PipelineRuntime<S>

Use a caller-owned tokio runtime as the I/O runtime instead of building one inside run — for assemblies whose connectors needed a handle before the runtime existed (sink workers spawned at construction, schema-registry fetchers, async pre-flight validation). run shuts it down on exit exactly as it does the internally built one; connector tasks spawned on it earlier keep running until then. Without this, assemblies end up running a second runtime, doubling pipeline.io_threads.

pub fn shutdown_handle(&self) -> ShutdownHandle

A handle that triggers a graceful drain.

pub fn run(self) -> Result<ExitReport, StartError>

Run the pipeline to completion (blocking). Returns when the pipeline drained after a shutdown trigger/signal or failed.

Trait Implementations

impl<S> Debug for PipelineRuntime<S>

where S: Source,

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.