Infrastructure Engineer-Senior
New Yesterday
Hiring For: Infrastructure Engineer
Location : Fort Mill, SC (Hybrid – – Days Onsite Weekly)
Duration : months (Possible Extension)
Job Summary: We are seeking a highly skilled Kafka Engineer specializing in observability to join our dynamic team. The ideal candidate will have extensive experience in managing and optimizing Kafka clusters, with a strong focus on observability to ensure the reliability, performance, and scalability of our data streaming infrastructure.
Key Responsibilities:
• Implement and maintain observability solutions to monitor Kafka performance, availability, and reliability.
• Develop and maintain dashboards, alerts, and metrics to provide visibility into Kafka operations and health.
• Collaborate with cross-functional teams to ensure seamless integration of Kafka observability with other systems and applications.
• Troubleshoot and resolve issues related to Kafka performance, latency, and data integrity using deployed observability instrumentations
• Discover optimal Kafka configurations and tuning parameters to achieve optimal performance based on performance metrics
• Provide technical guidance and mentorship to junior engineers on Kafka and observability practices.
Qualifications:
• Bachelor's degree in Computer Science, Engineering, or a related field.
• + years of experience in managing Kafka clusters in a production environment.
• Strong understanding of Kafka architecture, including brokers, zookeepers, producers, and consumers.
• Experience with observability tools such as Prometheus, Grafana, ELK stack, or similar.
• Proficiency in scripting languages such as Python, Bash, or similar.
• Familiarity with containerization and orchestration tools like Docker and Kubernetes.
• Excellent problem-solving skills and the ability to work under pressure.
• Strong communication and collaboration skills.
Preferred Qualifications:
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Knowledge of other messaging systems like RabbitMQ, Pulsar, or similar.
• Experience with CI/CD pipelines and automation tools.
- Location:
- Fort Mill