Lead Data Engineer (Python, SQL, AWS) - Dealer Tech

3 Days Old

Are you passionate about technology and eager to tackle complex business challenges? Join us at Capital One, where innovation meets impact, and be part of a dynamic team of creators and problem solvers. We are looking for a Lead Data Engineer to help drive transformative projects within Capital One Dealer Tech, a pioneering division dedicated to cutting-edge auto loan technology. As a Lead Data Engineer, you will: Design and build a large-scale, low-latency streaming data platform for meaningful insights. Develop next-generation Distributed Streaming Data Pipelines using technologies like Flink and Spark Streaming. Work with big data tools (e.g., Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Redshift) to manage medium to large datasets. Collaborate in an agile environment focused on CI/CD and application resiliency. Stay ahead of the tech curve by experimenting with new technologies and mentoring fellow engineers. Engage with Agile teams to implement and support robust technical solutions. Work alongside experts in machine learning and full-stack systems to deliver impactful cloud-based solutions. Conduct thorough unit testing and code reviews to ensure high-quality performance in your code. Qualifications: Basic: Bachelor's Degree and a minimum of 3 years of application development experience (excluding internships). Preferred: 5+ years in application development with languages such as Python, SQL, Scala, or Java. 2+ years of experience with public cloud services (AWS, Microsoft Azure, Google Cloud). 3+ years with distributed data computing tools like Kafka or Spark. 2+ years working with real-time data and streaming applications. Experience with NoSQL implementations (DynamoDB, OpenSearch) and data warehousing (Redshift, Snowflake). 3+ years of UNIX/Linux experience, including proficiency with shell scripting. Understanding of Agile engineering practices. At Capital One, located in McLean, VA, the salary range for this role is $158,600 - $181,000, and in Plano, TX, it is $144,200 - $164,600. Additional performance-based incentives may be available. We offer a comprehensive benefits package to support your well-being. Capital One is committed to a diverse and inclusive workplace, and we welcome qualified applicants regardless of their background. Join us in making a tangible difference and applying today!
Location:
Mclean, VA, United States
Category:
Computer And Mathematical Occupations