Responsibilities

: - Design, implement, and maintain scalable data pipelines using Python, Spark, and SQL - Optimize performance and code quality following clean coding principles - Orchestrateplex workflows using tools like Airflow or Databricks Workflows - Support trading analysts with ad hoc data engineering needs and develop production-grade solutions - Implement CI/CD deployment processes using tools like GitHub Actions or equivalents - Design robust data models and handle both structured and unstructured data efficiently - Build and manage APIs for data integration and develop web scraping tools as needed - Ensure data quality through validation frameworks, monitoring, andernance processes - Optimize storage, retrieval, and processing of external data feeds with varying formats and velocities - Collaborate closely with global teams (including London-based data engineers) to align with internal standards and best practices - Proactively drive performance improvements, technology evaluations, and process innovation - Maintain strong documentation and contribute to a culture of continuous improvement - Ensure data security,pliance, and access control best practices are in place Candidate Profile: - Degree inputer Science, Mathematics, Engineering, or a related field - Strong hands-on experience with Python, Spark, and SQL, following clean coding standards - Solid understanding of dataernance, data lineage, and quality frameworks - Experience with data orchestration tools like Airflow - Familiarity with containerization technologies (Docker, Kubernetes) and CI/CD pipelines - Exposure to Microsoft Azure and Databricks is desirable - Experience withmodities or energy trading data is a plus - Strong problem-solving skills with excellent attention to detail - Proactive and entrepreneurial approach to day-to-day challenges - Excellentmunication skills and ability to collaborate across technical and business teams Why Join? - Work at the core of data engineering for a fast-paced, high-impact trading environment - Collaborate with global teams solving large-scale data challenges - Opportunity to work with modern cloud, big data, and open-source tools - Gain exposure tomodities and energy trading domains -petitivepensation with strong career development potential