We are seeking a highly motivated and technically proficient Integration Engineer to join our team. This role focuses on building and maintaining robust, scalable integrations between internal systems, third-party APIs, and Databricks. You’ll own production-grade API ingestion pipelines, monitor integration health, and evolve integration architecture for reliability, resilience, and scalability.
Key Responsibilities:
Design, build, and maintain API-based data ingestion pipelines using Databricks and cloud-native services, ensuring secure, scalable, and observable integrations across internal systems and third-party platforms.
Ensure data integrity, security, and observability throughout the lifecycle of API integrations, including monitoring and alerting for failures.
Follow SDLC best practices including version control, CI/CD, and code reviews.
Use AWS (or similar platforms like Azure or GCP) for compute, storage, and orchestration services.
Collaborate with Data Analysts and Engineering teams to understand data source schema changes and proactively update integrations.
Required Skills and Qualifications:
5+ years of experience in backend engineering , software development, or a related role.
Strong hands-on experience with: Databricks
SQL for integration validation and troubleshooting
Python (or similar) programming for REST API integrations, data ingestion, and transformation workflows
Experience developing and maintaining production-ready API clients and endpoints
Deep understanding of API consumption patterns ( REST , webhook , GraphQL ) and best practices for reliability, error handling, and observability
Familiarity with tools like Postman and Swagger for testing and documentation
Proficiency in working with AWS Cloud or similar platforms (S3, Lambda, AppFlow, etc.)
Strong problem-solving skills and ability to work in fast-paced environments
Excellent communication and collaboration skills
Preferred Qualifications:
Strong understanding of data pipelines , ETL/ELT , and data architecture principles
Familiarity with data governance , data cataloging , and access control mechanisms
Experience with GitHub , Jira , and Confluence for code management and team collaboration
Expertise in Scrum methodology and Agile team environments
Familiarity with data orchestration and transformation tools such as dbt or Airflow
Experience with event-driven architectures and real-time data (e.g., Kafka)
Certifications in Databricks , AWS , or other cloud platforms (a plus)
ABOUT EMERALD
Emerald’s talented and experienced teams grow our customers’ businesses 365 days a year with products that create connections, deliver content, and drive commerce. We produce over 140 annual events, create and deliver content through print and digital channels, and power commerce through our seamlessly integrated in-person and digital platforms and channels. For more information, please visit http://www.emeraldx.com.
At Emerald, we strive to foster a diverse and inclusive community. We actively recruit and champion candidates who bring new perspectives from varied professional backgrounds and experiences, and we are intentional about ensuring a positive hiring experience for everyone. Our job postings don’t contain experience inflation, and most don’t require college degrees. Instead, they’re crafted to focus on outcomes and transferable experiences that are assessed in a structured interview process carried out by trained hiring teams.
COMPENSATION & BENEFITS
Target Compensation: $110,000-130,000
Please note that this range reflects a reasonable estimate of the target compensation for this position. This range may ultimately vary based on a candidate’s qualifications and may be higher where required by applicable law.
We offer a competitive benefits package designed to strengthen our employees’ physical and mental health, including unlimited vacation for exempt employees, flexible working locations, 401(k) plan with a company match, medical/dental/vision coverage with inclusive provisions including transgender services and fertility benefits, parental and caregiver leave, dependent, commuter and FSA benefits, professional development programs like Toastmasters, and mental wellness tools such as weekly guided meditation programs.
If you need accommodation in our application process or have questions about our posted salary range, please email our Talent Acquisition team at Careers@EmeraldX. com.