Rafael Aguiar
Rafael Aguiar has battle scars from building streaming engines, distributed systems, and real-time analytics in production.
When not at work, he’s probably hiking somewhere.
Company/Organisation:
Goldsky
Session
06-08
15:20
40min
Streamling: Lightweight, Extensible Streaming on DataFusion
Xiao Meng, Rafael Aguiar
Apache DataFusion is moving beyond batch into streaming. We built Streamling, a Rust streaming engine that uses DataFusion planning and Arrow RecordBatch streams for real-time SQL/WASM transforms. This talk covers how we built it, highlights key features (FFI plugins, WASM transforms, and dynamic tables), and shares production lessons.
Maschinenhaus