AWS Data Engineer
New Today
AWS Data Engineer needs 7+ years of experience in Amazon Web Services (AWS) Cloud Computing
AWS Data Engineer requires:
Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and processing using Python, Spark, and AWS services
AWS Data Engineer, Python, Spark, AWS Services, ETL, Glue, EMR, S3, Redshift, Airflow, Data Quality, CI/CD
ETL Development: Implement and manage ETL processes using AWS Glue and EMR for both batch and streaming data
Data Storage Solutions: Design and maintain storage solutions using Medallion Architecture in S3 and Redshift
Workflow Orchestration: Monitor and optimize data workflows using Airflow or other orchestration tools
Data Quality: Ensure accuracy, consistency, and integrity throughout the data lifecycle
CI/CD: Implement and understand CI/CD practices for automated data pipeline deployment
System Monitoring: Utilize CloudWatch and Datadog for performance monitoring and reliability
Collaboration: Work closely with cross-functional teams to gather requirements and deliver business-driven data solutions
Communication: Strong ability to communicate project updates and technical details to stakeholders.
- Location:
- San Francisco
We found some similar jobs based on your search
-
New Today
AWS Data Engineer
-
San Francisco
AWS Data Engineer needs 7+ years of experience in Amazon Web Services (AWS) Cloud Computing AWS Data Engineer requires: Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and processing using Python, Spa...
More Details -
-
40 Days Old
AWS Data Engineer Python, Dataiku
-
San Francisco, CA, United States
- IT & Technology
We are looking for an experienced AWS Data Engineer to design, develop, and maintain scalable data pipelines using AWS native technologies. This role involves working closely with technical analysts, stakeholders, data scientists, and other team memb...
More Details -