Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

They have their own implementation that is closed source (last time I checked), Photon [1], which is written with a C++ engine.

Databricks' terms prevent(ed?) publishing benchmarks, it would be interesting to see how Comet performs relative to it over time.

Photon comes at a higher cost, so one big advantage of Comet is being able to deploy it on a standard Databricks cluster that doesn't have Photon, at a lower running cost.

[1] https://www.databricks.com/product/photon



nice word play for two competing spark execution engines: Photon and Comet. C++ vs Rust, closed-source vs open-source




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: