#LI-AS3 Technical/Functional Skills : Key Responsibilities: •Involve in the complete SDLC of project from analysis, design, implementation and deployment to testing phase •Writing Spark applications using Scala and Java code with IntelliJ IDEA (or equivalent). •Writing unit tests and automated test scripts using bash scripts and JUnit. •Optimize Spark jobs for performance and scalability. •Troubleshoot and debug Spark applications to ensure reliability and efficiency. •Integrate Spark applications with other AWS services such as S3, DynamoDB •Working with various AWS services like EC2, S3, IAM Roles, EKS, Cloud Formation and many other. •Set up monitoring and alerting for Spark applications and EKS infrastructure using tools like Prometheus, Grafana, and CloudWatch. •Deploying applications on Kubernetes and understanding Docker. •Experience working with Iceberg tables. •Write SQL or Spark SQL queries to analyze data stored in Iceberg tables.