Road to alpha

[birdayz]

Config

• Config package with env var support (KSTREAMS_ prefix)
• Autodetect k8s and enable group instance id based on pod name.

Topology

• Add new type "builder", and use existing code as internal package
• Prevent infinite loops

Processor

• ctx.Forward should handle error if no downstream processor is registered
• ProcessorBuilder should be interface, with Stores() []StoreBuilder func

Testing

• Console sink

Benchmarking

Built-in processors#1

• Joins
• Windowing
• Calendar based aggregations (eg. calendar day, month, year, ..)
• Batch

State stores

• Windowed state store
• Object store implementations
• Cache (for use with object store, write-back cache probably?)

Examples

• IoT Use case: messages/h bytes/h
• IoT Use case: data enrichment
• OpenTelemetry, spans per processor, propagation of traceID

Other

• Batches?
• Store retention time
• Event time
• Record context, Metadata , Headers, Interceptors
• Error Handlers / Interceptors
• Better way to package store(s) + processor for pre-built processors likeAggregation,Join, ...
• State store snapshots from outside, by consuming from a changelog topic.

K8s / Cloud native

• Auto detect k8s and turn on settings like: static membership, pod name in group meta
• add simple to use aggregators for windowed aggs (?)

Error handling

• preserve error when exiting worker in error case

Config/Options

• SASL
• TLS

Deps

• Remove multierr, it just has too many deps to be worth it (yaml?!)