Data Engineer

New Today

Design, build, and maintain scalable and reliable data pipelines and ETL processes. Implement data quality checks and monitoring to ensure data integrity and accuracy. Collaborate with the business team and analysts to understand data needs and deliver solutions. Optimize data warehousing solutions for performance and cost efficiency. Troubleshoot and resolve data-related issues in production environments and act as support for production issues. Work in a primarily Agile/Scrum product development process About you Requirements Typically requires a Bachelor’s degree and a minimum of 2 years of related experience; or an advanced degree without experience; or equivalent work experience. A driven data engineer that is motivated to build great products and a great codebase in a fast-paced environment Proficient in Python. Ability to work in other languages is desirable. Proficient in dbt for modeling, testing and transforming data Understand the principles of stream processing and how frameworks like Kafka and Flink fits into the stream processing ecosystem Knowledge of API best practices and industry standards Familiar with AWS cloud-based architectures, development, revision control, test, and deployment automation. Knowledge of event-driven architecture and design patterns. Ability to clearly document and communicate technical requirements.
Location:
Austin

We found some similar jobs based on your search