Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Cool. Every database or data source (e.g. CRM) should produce Iceberg format for you.

Though a little sceptical of embedding DuckDB. It is easy and better to isolate Read/Write paths, and it has a lot of other benefits.



Iceberg for the win!

We actually separate Read/Write paths. BemiDB reads by levering DuckDB as a query engine. And it writes to Iceberg completely separately from DuckDB. I'm curious if that's what you imagined.


Ideally, I would love many places writing to the Iceberg catalogue and then using it as a data lake.

In the data lake, I would have a gateway provisioning DuckDB on demand for each user.


Oh, interesting, thanks for sharing it!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: