VDOT - Lead Agentic Data Engineer

New Yesterday

Title/Role: VDOT - Lead Agentic Data Engineer Location: 1401 E Broad St.Richmond, VA 23219 Job Arrangement: Hybrid
Job Description Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. We are seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction between agents and data.
Responsibilities: • Guiding and mentoring AI engineers, helping them develop their skills and knowledge in the field. • Leading and managing AI projects, ensuring they stay on track, meet deadlines, and the findings are actionable and relevant. • Contributing to the creation and implementation of AI strategies that align with the organization's goals and objectives. • Designing and developing data pipelines for agentic systems, develop Robust data flows to handle complex interactions between AI agents and Data sources. • Ability to use advanced mathematical modeling, statistical analysis, and optimization techniques to gather and analyze data, identifying problems and developing solutions to improve efficiency in prompts. • Ability to train and fine tune large language models and Design and build the data architecture, including databases, data warehouses, and data lakes, to support various data engineering tasks. • Develop and manage Extract, Load, transform (ELT) processes to ensure data is accurately and efficiently moved from source systems to analytical platforms used in data science. • Implement data pipelines that facilitate feedback loops, allowing human input to improve system performance in human-in-the-loop systems. • Work with vector databases to store and retrieve embeddings efficiently. • Collaborate with data scientists and engineers to preprocess data, train models, and integrate AI into applications. • Optimize data storage and retrieval with high performance
Qualifications: • Strong Data engineering fundamentals • Utilize Big data frameworks like Spark/Databricks • Training LLMs with structed and unstructured data sets. • Understanding of Graph DB • Experience with Azure Blob Storage, Azure Data Lakes, Azure Databricks • Experience implementing Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI models, Azure Media Services, Azure AI Search • Determine effective data partitioning criteria • Utilize data storage system spark to implement partition schemes • Understanding core machine learning concepts and algorithms • Familiarity with Cloud computing skills • Strong programming skills in Python and experience with AI/ML frameworks. • Proficiency in vector databases and embedding models for retrieval tasks. • Expertise in integrating with AI agent frameworks. • Experience with cloud AI services (Azure AI). • Experience with GIS spatial data • Strong leadership, excellent problem-solving and communication skills • Proven experience in leading projects and teams, including the mentorship of AI engineers • The ability to engage in critical evaluation of information, hypothesis testing, and scenario analysis. • Flexibility in learning and adopting new technologies, methodologies, and tools to stay at the forefront of AI trends. • Experience with Department of Transportation Data Domains developing an AI Composite Agentic Solution designed to identify and analyze data models, connect & correlate information to validate hypotheses, forecast, predict and recommend potential strategies and conduct What-if analysis. • Bachelor's or master's degree in computer science, AI, Data Science, or a related field.
Thanks & Regards,
Swagatika Mohanty Account Manager M: (425)-224-5261 E: swagatika.mohanty@aloden.com | www.aloden.com Schedule a Meeting with ME
Location:
Richmond, VA, United States
Category:
Computer And Mathematical Occupations

We found some similar jobs based on your search