Lead Software Engineer (GenAI) - Long Term Project - Remote or Hybrid (LA, SF, SEA)

Title: Lead Software Engineer - GenAI

Location: Remote or Hybrid (LA, SF, SEA)

Duration: - Months - Long Term Project

Compensation: $$;

Work Requirements: US Citizen, GC Holders or Authorized to Work in the

Skillset / Experience: Responsibilities and Duties of the Role: Design and build reusable GenAI platform components, including: Prompt orchestration layers Secure gateway abstraction using tools like LiteLLM, Portkey, or Kong Embedding and retrieval infrastructure using vector databases like Pinecone, or FAISS Audit, logging, and trace analysis with tools like LangSmith Guardrails integration for output validation, safety checks, and policy enforcement Develop multi-turn LLM agents and tools using LangGraph and LangChain to automate operational workflows Build robust APIs, SDKs, and accelerator components that serve as initializers for internal product teams, bots, and platforms to rapidly integrate and adopt GenAI services Standardize approaches to context management, tool calling, fallback handling, and observability across agents Ensure platform components meet security, governance, and compliance standards Partner with infrastructure, data, security, and product teams to integrate GenAI workflows into existing systems YOU MUST… Bachelor's or Master's degree in Computer Science, Engineering, or a related field. + years of backend or platform engineering experience, with a track record of building scalable APIs Hands-on experience integrating with LLM APIs such as OpenAI, Claude, and Anthropic, and building LLM-powered workflows, agents, or AI assistants Proficient in Python; familiarity with LangChain, LangGraph, or similar LLM orchestration frameworks Familiarity with observability practices for LLM-based systems, including logging, latency tracking, and output monitoring Experience with LLM evaluation and testing frameworks to validate prompt behavior and agent reliability across iterations Strong understanding of cloud-native design patterns, secure AI API integration, and service scalability Working knowledge of vector databases such as Pinecone, FAISS, or Weaviate, along with retrieval-augmented generation (RAG) techniques Experience building modular, reusable GenAI components that support cross-functional adoption and internal accelerators Comfort working with CI/CD pipelines and collaborating with DevOps teams to deploy and monitor GenAI workflows PREFERRED EXPERIENCE/EDUCATION/SKILLS Experience with LangSmith, PromptLayer, or tracing tools for debugging and evaluation of LLM workflows. Knowledge of AI gateway patterns and usage throttling like Kong, LiteLLM, or Familiarity with guardrails, safety evals, prompt injection defense, and model governance frameworks. Previous experience building platforms or enablement tooling used across multiple engineering teams. Exposure to infrastructure or DevOps automation use cases is a plus.

Our benefits package includes: Comprehensive medical benefits Competitive pay, (k) Retirement plan …and much more!