The ideal candidate will have extensive experience with data integration, processing, and management, specifically utilizing Apache NiFi, RESTful APIs, Hadoop, Accumulo, and Elasticsearch.

Key Responsibilities:

Design, develop, and maintain data pipelines to support C2IE deployments. Utilize Apache NiFi for data ingestion, transformation, and routing. Develop and maintain RESTful APIs for seamless data exchange between systems. Implement and manage data storage solutions, including Hadoop, Accumulo, and Elasticsearch. Collaborate with cross-functional teams to understand data requirements and implement effective solutions. Ensure data quality, integrity, and security throughout the data lifecycle. Monitor and optimize data workflows to ensure high performance and reliability. Troubleshoot and resolve issues related to data integration and processing. Stay updated with the latest trends and technologies in data engineering and apply them to improve existing processes. Required Skills and Qualifications: Bachelor's degree in Computer Science, Information Technology, or related field. Proven experience as a Data Engineer or similar role, with a focus on supporting complex data environments. Strong proficiency in Apache NiFi for data integration and processing. Experience in developing and managing RESTful APIs. In-depth knowledge of data storage solutions, including Hadoop, Accumulo, and Elasticsearch. Proficiency in programming languages such as Python, Java, or Scala. Strong understanding of data security and compliance requirements. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. Preferred Qualifications: Experience with Elastic Search and the Elastic Stack Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) for data engineering. Knowledge of DevOps practices and tools like Jenkins, Docker, and Kubernetes. Experience with data visualization tools and techniques. Relevant certifications in data engineering or related fields.