On-site
Senior Software Engineer | $100-$150/hr
Codefeast
· CAContractor19 days ago
About the role
Senior Software Engineer – Python / TypeScript | AI Evaluation
Experience: 5+ Years
Job Type: Contractor
Location: Remote - Canada Preferred
Start Date: Immediate
Role Overview
We are looking for a Senior Software Engineer with strong expertise in Python, TypeScript, JavaScript, or Golang to support cutting-edge AI evaluation and preference-data projects.
The ideal candidate has experience working with large codebases, data pipelines, infrastructure, preference data, and rubric creation, along with strong technical judgment and communication skills.
Key Responsibilities
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label technical data while maintaining a high quality bar.
• Identify subtle quality issues in AI-generated or preference-based datasets.
• Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation.
Key Requirements
• 5+ years of professional software engineering experience.
• Strong proficiency in Python, particularly building or maintaining pipelines and infrastructure, OR strong experience with Typescript, Javascript.
• Strong written and verbal communication skills.
• Ability to explain technical decisions clearly and provide actionable feedback.
• Strong judgment when assessing technical quality and identifying subtle issues.
Candidate Preferences
• Candidates from Tier-1 technology companies or Tier-1 universities are preferred.
• A valid and updated LinkedIn profile is mandatory and must be included in the resume.
• Candidates currently working with Microsoft are not eligible for this requirement.
Experience: 5+ Years
Job Type: Contractor
Location: Remote - Canada Preferred
Start Date: Immediate
Role Overview
We are looking for a Senior Software Engineer with strong expertise in Python, TypeScript, JavaScript, or Golang to support cutting-edge AI evaluation and preference-data projects.
The ideal candidate has experience working with large codebases, data pipelines, infrastructure, preference data, and rubric creation, along with strong technical judgment and communication skills.
Key Responsibilities
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label technical data while maintaining a high quality bar.
• Identify subtle quality issues in AI-generated or preference-based datasets.
• Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation.
Key Requirements
• 5+ years of professional software engineering experience.
• Strong proficiency in Python, particularly building or maintaining pipelines and infrastructure, OR strong experience with Typescript, Javascript.
• Strong written and verbal communication skills.
• Ability to explain technical decisions clearly and provide actionable feedback.
• Strong judgment when assessing technical quality and identifying subtle issues.
Candidate Preferences
• Candidates from Tier-1 technology companies or Tier-1 universities are preferred.
• A valid and updated LinkedIn profile is mandatory and must be included in the resume.
• Candidates currently working with Microsoft are not eligible for this requirement.
What you'll do
- Responsibilities are not added
What we're looking for
- Qualifications are not added