Senior Software Engineer — AI Evaluation & Benchmarks | Remote Contract | $80–$100/hr
Budget: $80 – $100 USD
Project Overview
We are seeking highly experienced Senior Software Engineers to contribute to cutting-edge AI evaluation and benchmarking initiatives that help shape the future of intelligent software systems.
This opportunity is ideal for engineers who enjoy solving complex technical challenges, working with large-scale codebases, building scalable infrastructure, and creating rigorous evaluation systems for advanced AI models.
As part of this project, you will help design coding benchmarks, develop evaluation frameworks, analyze AI-generated software, and build data pipelines that measure how effectively AI systems reason, debug, and generate production-quality code.
This is a fully remote contract opportunity with competitive compensation and the potential for ongoing engagement.
Compensation
$80 – $100 USD per hour
Fully Remote
Flexible Work Environment
Full-Time Availability Preferred
Initial 3-Month Contract
Potential Contract Extensions
High-Impact AI Engineering Projects
Responsibilities
Design and implement coding benchmarks used to evaluate advanced AI models
Build and maintain scalable evaluation and data processing pipelines
Analyze AI-generated code for correctness, reliability, efficiency, and edge cases
Create structured technical assessments that test reasoning, debugging, and software engineering capabilities
Work with large code repositories and multi-language development environments
Develop evaluation frameworks that improve AI coding performance
Identify model failure patterns and provide actionable technical feedback
Collaborate with engineering and research teams on AI evaluation systems
Contribute to industry-leading benchmark design and methodology
Required Skills
Minimum 4+ years of professional software engineering experience
Expert-level Python development skills
Strong experience working with large codebases and software architecture
Experience designing coding benchmarks, technical assessments, or evaluation systems
Strong Git and version control workflow knowledge
Experience building scalable data pipelines and backend systems
Excellent debugging and analytical problem-solving skills
Strong written English communication abilities
Ability to work independently in a remote environment
Preferred Qualifications
Candidates with any of the following experience are strongly encouraged to apply:
Senior or Lead Software Engineering roles
AI/ML model evaluation or benchmarking
Large-scale backend systems
LLM evaluation frameworks
Continuous Integration / Continuous Deployment (CI/CD)
Automated testing frameworks
Open-source contributions
Security engineering experience
Distributed systems architecture
Cloud infrastructure (AWS, GCP, Azure)
Additional programming languages:
JavaScript / TypeScript
Go
C++
Java
Rust
Ideal Candidate
You may be an excellent fit if you:
Have built and maintained production-grade software systems
Enjoy analyzing complex engineering problems
Have experience reviewing large codebases
Understand software quality, testing, and reliability principles
Can identify subtle bugs and edge cases
Have worked in high-performance engineering environments
Are interested in helping improve the capabilities of advanced AI systems
Why Join This Opportunity?
Work directly on next-generation AI evaluation systems
Influence how leading AI models are measured and improved
Collaborate with world-class engineers and researchers
Fully remote work environment
Competitive hourly compensation
Meaningful engineering challenges with real-world impact
Potential for long-term project opportunities
Application Instructions
To be considered, please include:
Brief professional introduction
Years of software engineering experience
Python expertise and relevant project experience
Experience with large codebases, benchmarking, or evaluation systems
Experience with CI/CD, testing frameworks, or scalable infrastructure
GitHub, portfolio, LinkedIn, or project examples (if available)
Qualified candidates may be invited to complete a technical assessment as part of the evaluation process.
Applications are reviewed on a rolling basis.
We are seeking highly experienced Senior Software Engineers to contribute to cutting-edge AI evaluation and benchmarking initiatives that help shape the future of intelligent software systems.
This opportunity is ideal for engineers who enjoy solving complex technical challenges, working with large-scale codebases, building scalable infrastructure, and creating rigorous evaluation systems for advanced AI models.
As part of this project, you will help design coding benchmarks, develop evaluation frameworks, analyze AI-generated software, and build data pipelines that measure how effectively AI systems reason, debug, and generate production-quality code.
This is a fully remote contract opportunity with competitive compensation and the potential for ongoing engagement.
Compensation
$80 – $100 USD per hour
Fully Remote
Flexible Work Environment
Full-Time Availability Preferred
Initial 3-Month Contract
Potential Contract Extensions
High-Impact AI Engineering Projects
Responsibilities
Design and implement coding benchmarks used to evaluate advanced AI models
Build and maintain scalable evaluation and data processing pipelines
Analyze AI-generated code for correctness, reliability, efficiency, and edge cases
Create structured technical assessments that test reasoning, debugging, and software engineering capabilities
Work with large code repositories and multi-language development environments
Develop evaluation frameworks that improve AI coding performance
Identify model failure patterns and provide actionable technical feedback
Collaborate with engineering and research teams on AI evaluation systems
Contribute to industry-leading benchmark design and methodology
Required Skills
Minimum 4+ years of professional software engineering experience
Expert-level Python development skills
Strong experience working with large codebases and software architecture
Experience designing coding benchmarks, technical assessments, or evaluation systems
Strong Git and version control workflow knowledge
Experience building scalable data pipelines and backend systems
Excellent debugging and analytical problem-solving skills
Strong written English communication abilities
Ability to work independently in a remote environment
Preferred Qualifications
Candidates with any of the following experience are strongly encouraged to apply:
Senior or Lead Software Engineering roles
AI/ML model evaluation or benchmarking
Large-scale backend systems
LLM evaluation frameworks
Continuous Integration / Continuous Deployment (CI/CD)
Automated testing frameworks
Open-source contributions
Security engineering experience
Distributed systems architecture
Cloud infrastructure (AWS, GCP, Azure)
Additional programming languages:
JavaScript / TypeScript
Go
C++
Java
Rust
Ideal Candidate
You may be an excellent fit if you:
Have built and maintained production-grade software systems
Enjoy analyzing complex engineering problems
Have experience reviewing large codebases
Understand software quality, testing, and reliability principles
Can identify subtle bugs and edge cases
Have worked in high-performance engineering environments
Are interested in helping improve the capabilities of advanced AI systems
Why Join This Opportunity?
Work directly on next-generation AI evaluation systems
Influence how leading AI models are measured and improved
Collaborate with world-class engineers and researchers
Fully remote work environment
Competitive hourly compensation
Meaningful engineering challenges with real-world impact
Potential for long-term project opportunities
Application Instructions
To be considered, please include:
Brief professional introduction
Years of software engineering experience
Python expertise and relevant project experience
Experience with large codebases, benchmarking, or evaluation systems
Experience with CI/CD, testing frameworks, or scalable infrastructure
GitHub, portfolio, LinkedIn, or project examples (if available)
Qualified candidates may be invited to complete a technical assessment as part of the evaluation process.
Applications are reviewed on a rolling basis.