Remote Senior Software Engineer (LLM) - 35501Remote Senior Software Engineer (LLM) - 355011 week ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.We are developing high-quality training and evaluation datasets to improve how Large Language Models (LLMs) perform on real software engineering problems. The core of this project involves identifying and curating verifiable coding tasks from public GitHub repositories, supported by a human-in-the-loop review process.As a contractor on this project, you will review code written by AI to solve real software tasks. Your feedback will help improve how future AI models learn to write and understand code.Key ResponsibilitiesReview and compare 3–4 model-generated code responses for each task using a structured ranking frameworkAssess code changes (diffs) for correctness, quality, readability, and performanceProvide clear, concise explanations for your ranking decisionsMaintain consistency and fairness across all evaluationsIdentify and document edge cases or unusual model behaviorCollaborate with the team to improve evaluation processes and identify improvement areasRequired QualificationsProfessional Experience5+ years of total experience as a software engineer (experience working as a data scientist will not be considered)Minimum 2 years of experience as a full-stack engineer at a leading tech product company (e.g., Google, Shopify, Microsoft, Snowflake, Meta, PayPal, etc.)Note: Experience from contractual or part-time roles will not be considered. Only full-time employment qualifies.Technical SkillsStrong understanding of software design, debugging, and engineering best practicesFamiliarity with code review processes and version control systemsAbility to analyze and compare real-world code changesExcellent written communication skills for clearly explaining technical evaluationsPreferred QualificationsDegree from a top-ranked university is preferred but not requiredExperience working with LLM-generated code or AI evaluation projectsBackground in developer tools or systems automationExposure to AI research or developer agentsType: Contract (no medical benefits or paid leave)Commitment: 10–20 hours/week, with flexible work hours (partial overlap with Pacific Time)Duration: 1 month (starting next week, with potential for extension)Compensation: $50–$150/hour, based on experience, geography, and skill levelAbout Turing:Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.If you have strong software engineering expertise and are interested in helping shape the next generation of AI-assisted development tools, we encourage you to apply.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeContractJob functionJob functionInformation Technology and EngineeringIndustriesSoftware DevelopmentReferrals increase your chances of interviewing at Turing by 2xSign in to set job alerts for “Software Engineer” roles.Palo Alto, CA $140,000.00-$185,000.00 2 weeks agoSoftware Engineer (L5) - Open Connect PlatformSoftware Engineer, HTML - AI Training (Freelance, Remote)San Francisco, CA $150,000.00-$180,000.00 2 weeks agoPalo Alto, CA $140,000.00-$185,000.00 2 weeks agoSoftware Engineer (Front End/Full Stack)San Francisco Bay Area $135,000.00-$165,000.00 3 weeks agoSan Francisco, CA $130,000.00-$165,000.00 1 month agoSan Francisco, CA $150,000.00-$175,000.00 2 months agoSan Francisco, CA $150,000.00-$190,000.00 2 months agoSoftware Engineer, Python - AI Training (Freelance, Remote)Software Engineer, Full-Stack Opening, USASoftware Engineer Internship (8 openings)San Francisco, CA $90,000.00-$110,000.00 4 months agoSoftware Engineer, SQL - AI Training (Freelance, Remote)Software Engineer, Node.js - AI Training (Freelance, Remote)Software Engineer - AI Training (Freelance, Remote)Santa Clara, CA $80,000.00-$155,000.00 3 months agoCoders - AI Training (Freelance, Remote)San Francisco, CA $40,000.00-$100,000.00 1 month agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr