AI Prompt Engineer

New Yesterday

About the Opportunity . JOB SUMMARY The AI Prompt Engineer will be responsible for designing, optimizing, and maintaining the prompts and interactions that power the university's large language model (LLM) applications across service desk automation, administrative assistance, and other AI-driven services. This role is critical in ensuring AI systems communicate effectively, produce accurate outputs, and deliver consistent user experiences across all university stakeholders. The position requires expertise in natural language processing, LLM capabilities, domain-specific knowledge, and the ability to translate business requirements into effective AI interactions. *Applicants must be authorized to work in the United States. The University is unable to work sponsor for this role, now or in the future MINIMUM QUALIFICATIONS Knowledge and skills required for this position are normally obtained through a Bachelor's degree in Linguistics, Computational Linguistics, Computer Science, or related field; with a minimum of 2 years of experience working with large language models and prompt engineering, with demonstrated success in enterprise applications. Experience in higher education or similar complex organizational environments preferred. Other necessary skills: LLM Expertise:  Deep understanding of large language model capabilities, limitations, and optimal interaction patterns, with demonstrated experience designing effective prompts for enterprise applications. Prompt Engineering Skills:  Advanced proficiency in crafting, testing, and refining prompts that produce consistent, accurate, and appropriate AI outputs across diverse use cases and user types. Natural Language Processing:  Strong understanding of NLP concepts and techniques, including context management, semantic analysis, entity recognition, and conversational design. Systematic Testing:  Experience designing comprehensive test cases and evaluation frameworks to assess prompt effectiveness, identify edge cases, and ensure consistent AI system performance. Domain Adaptation:  Ability to adapt general AI models to specific domains through effective prompt strategies, content framing, and domain-specific terminology integration. Technical Understanding:  Sufficient technical knowledge to collaborate effectively with AI engineers and operations specialists on prompt implementation, optimization, and troubleshooting. Analytical Skills:  Strong analytical capabilities to evaluate prompt performance data, identify patterns in AI responses, and implement data-driven improvements to interaction designs. Creative Problem-Solving:  Creativity in developing novel prompt approaches to overcome model limitations and address complex use cases not easily handled by standard methods. Content Design:  Experience creating clear, structured content frameworks that guide AI systems to produce well-organized, user-friendly outputs in appropriate formats. User Experience Focus:  Strong user-centric mindset with the ability to design AI interactions that feel natural, helpful, and aligned with user expectations and needs. Documentation Skills:  Excellence in documenting prompt strategies, design patterns, and guidelines to ensure consistency across the organization and enable knowledge transfer. Cross-functional Collaboration:  Demonstrated ability to work effectively with diverse stakeholders, including technical teams, subject matter experts, and end-users to gather requirements and refine AI interactions. KEY RESPONSIBILITIES & ACCOUNTABILITIES Prompt Design and Optimization Design, develop, and continuously optimize prompts for university AI systems across service desk automation, administrative assistance, and other applications. Create prompt strategies that produce accurate, consistent, and contextually appropriate AI outputs aligned with business requirements and user expectations. Testing and Quality Assurance Develop and implement comprehensive testing frameworks to evaluate prompt effectiveness across diverse scenarios and edge cases. Systematically test AI responses to ensure accuracy, safety, appropriateness, and alignment with university policies and standards. Identify and address prompt vulnerabilities and failure modes. Domain-Specific Adaptation Collaborate with subject matter experts to adapt AI interactions for specific university domains, including IT support, administrative processes, and academic contexts. Incorporate domain-specific terminology, workflows, and knowledge into prompt designs to enhance relevance and effectiveness. Performance Analysis and Improvement Analyze AI system outputs and user feedback to identify patterns, issues, and opportunities for improvement. Implement data-driven refinements to prompts based on performance metrics and real-world usage patterns. Monitor for and address model drift or inconsistencies in AI responses over time. Documentation and Knowledge Sharing Create and maintain comprehensive documentation of prompt design patterns, strategies, and best practices. Develop prompt libraries, templates, and guidelines to ensure consistency across the organization. Share knowledge and insights with technical teams and stakeholders to advance organizational prompt engineering capabilities. Position Type Information Technology
Location:
Boston

We found some similar jobs based on your search