Senior Backend Engineer - Data Ingestion (ClickPipes)
New Yesterday
Senior Backend Engineer - Data Ingestion Established in 2009, ClickHouse leads the industry with its open-source column-oriented database system, driven by the vision of becoming the fastest OLAP database globally. The company empowers users to generate real-time analytical reports through SQL queries, emphasizing speed in managing escalating data volumes. Enterprises globally, including Lyft, Sony, IBM, GitLab, Twilio, HubSpot, and many more, rely on ClickHouse Cloud. It is available through open-source or on AWS, GCP, Azure, and Alibaba.
About the Team The ClickPipes Platform plays a critical role in driving the growth of our company and ensuring the success of our clients by seamlessly onboarding and integrating data from diverse data sources into ClickHouse. Working at a petabyte scale and in high-velocity environments, this role offers an exceptional opportunity to solve challenging technical problems, operate with significant autonomy, and make a measurable impact.
We are looking for exceptional backend engineers who can work across a variety of technologies, with expertise in real-time data ingestion, change data capture (CDC), distributed systems, and cloud services. As a member of this team, you'll collaborate cross-functionally to build and maintain.
What will you do? Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores.
Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements.
Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience.
Participate in on-call rotations to ensure system reliability and respond to production incidents.
About you: 5+ years of relevant software development industry experience building data-intensive software solutions.
Strong knowledge of Golang and experience with its ecosystem. Experience with Java is a plus.
Experience with distributed systems and microservices architecture
The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently.
Understanding data replication methodologies like CDC.
Good knowledge of cloud-native architecture and practical experience with at least one major CSP.
You have excellent communication skills and the ability to work well within a team and across engineering teams.
You are a strong problem solver and have solid production debugging skills.
- Location:
- Washington, DC, United States
- Category:
- Computer And Mathematical Occupations