Software Engineer, Write

at  InfluxData

InfluxData is the creator of InfluxDB, the leading time series platform used to collect, store, and analyze all time series data at any scale. Developers can query and analyze their time-stamped data in real-time to discover, interpret, and share new insights to gain a competitive edge. InfluxData is a remote-first company with a globally distributed workforce. For more information, visit www.influxdata.com.
InfluxDB 3.0 is a fast, columnar, and distributed time series database, written in Rust and incorporating open technologies like Apache Arrow, Arrow Flight, and DataFusion. We’ve found product-market fit, and our customer base is growing quickly.
The role will predominantly focus on the distributed systems aspect of the database, which operates in multi-tenant cloud environments, single tenant environments, and within customer data centers.
The team you will join are responsible for the development and operation of the write path: low-latency data ingestion, data reliability, data migration, lifecycle management, and data warehouse integration.
Being part of an on-call rotation is a requirement of this role.
The application window will be open until at least July 31, 2024. This opportunity will remain online based on business needs which may be before or after the specified date.

• Enable InfluxDB 3.0 customers to query InfluxDB via Apache Iceberg. Iceberg is a data warehouse table format that is being adopted at a very fast pace by many companies in the data warehouse industry. InfluxData is adopting Iceberg to become a zero-ETL data warehouse source for third-party tools like Snowflake, Trino, Pandas, and AWS Athena.
• Convert InfluxDB metadata to Apache Iceberg metadata. A prototype of this service has been implemented in Go. After iterating on the prototype, we have customers happily querying InfluxDB via Iceberg with this prototype. You will use the prototype as a guide to implement a production-quality service in Rust, and deliver the service to production.
• Provide access to Iceberg tables with a REST Catalog service. Now that the InfluxDB metadata has been converted to Iceberg metadata, customers need a better mechanism to discover it. You will implement the Iceberg REST Catalog API, which is specified with OpenAPI, in Rust, and deliver the service to production.
• After this initial project with Apache Iceberg, you will branch out to other parts of the InfluxDB write path. Our ongoing challenge is to correctly and quickly ingest new data, making it queryable immediately. This means improving performance and efficiency, designing and adding features, and fixing bugs.