Datasette streams millions of rows straight into Arrow without a memory detour
The datasette-arrows 0.1a0 plugin adds Arrow IPC exports to Datasette and sends data one page at a time. It is a practical demonstration of the new streaming interface, though the alpha release still exposes seams between plugin and core.