Back to feed

Software Engineer — AI Code Ranking

Remote Full-time Live

About The Role What if your years of software engineering experience could directly shape how AI writes code for millions of developers? We're looking for Software Engineers in New York to evaluate, rank, and refine AI-generated code — helping the next generation of coding assistants produce solutions that are correct, efficient, idiomatic, and production-ready. Your deep understanding of software architecture, design patterns, and real-world engineering trade-offs is exactly what AI models need to get better. This isn't about writing boilerplate — it's about applying expert judgment to push the boundaries of what AI can do with code. This is a fully remote, flexible contract role built for experienced developers who want meaningful, high-impact work on their own schedule.

  • Organization: Alignerr
  • Type: Hourly Contract
  • Location: Remote
  • Commitment: 10–40 hours/week

What You'll Do

  • Review and rank AI-generated code solutions across multiple programming languages and problem domains
  • Evaluate code for correctness, efficiency, readability, maintainability, and adherence to best practices
  • Identify bugs, anti-patterns, security issues, and performance bottlenecks in AI-generated outputs
  • Write detailed, structured feedback explaining why one solution is better than another
  • Refine and improve AI-generated code to meet production-level engineering standards
  • Provide preference rankings that help AI models learn what "good code" actually looks like
  • Work independently and asynchronously — fully on your own schedule

Who You Are

  • Software engineer with 3+ years of professional development experience
  • Proficient in one or more major programming languages (e.g., Python, JavaScript/TypeScript, Java, C++, Go, Rust)
  • Strong grasp of data structures, algorithms, and computational complexity
  • Deep understanding of software design principles, clean code practices, and engineering trade-offs
  • Experienced with code review — you know how to assess quality and articulate why something works or doesn't
  • Clear, concise written communicator who can explain technical decisions effectively
  • Self-motivated and reliable when working independently without supervision

Nice to Have

  • Experience across multiple languages, frameworks, or tech stacks
  • Background in systems design, distributed systems, or backend architecture
  • Familiarity with AI/ML concepts or experience using AI coding tools (Copilot, ChatGPT, etc.)
  • Prior experience with code evaluation, technical mentoring, or open-source contribution
  • Knowledge of security best practices and performance optimization
  • Experience in competitive programming or technical interviewing

Why Join Us

  • Work on cutting-edge AI projects alongside leading research labs
  • Directly influence how AI coding assistants learn to write better software
  • Fully remote and flexible — work when and where it suits you
  • Freelance autonomy with the structure of meaningful, task-based work
  • Leverage your hard-earned engineering expertise in a new, high-impact way
  • Potential for ongoing work and contract extension as new projects launch
  • Join a global community of top-tier engineers shaping the future of AI-assisted development

Apply tot his job Apply To this Job

On the same wavelength

AI & Automation Builder — People Team (Remote)

Remote Full-time

[Remote] AI Tutor - English

Remote Full-time

Fractional Chief AI Officer, AI Strategy Leader

Remote Full-time

Manager, AI Architecture

Remote Full-time

AI Data Specialist - Texas (US)

Remote Full-time

AI Data Annotation Intern

Remote Full-time

Post-Acute Care Coordinator

Remote Full-time

[Remote] AI Trainer - Advanced Python Developers - New York

Remote Full-time

[Remote] AI Trainer – Visual & Graphic Design Expert (Remote) - Boston

Remote Full-time

Remote | Automotive Mechanical Engineering WorkflowSpecialist — $50–$75/hour

Remote Full-time

Experienced Full Stack Data Entry Specialist – Entertainment Industry Remote Opportunity

Remote Full-time

Remote Data Entry Specialist – Pharmacy Operations & Patient Support – $75,000 Annual Salary – arenaflex

Remote Full-time

Experienced Customer Service Representative – Remote Careers at arenaflex

Remote Full-time

Account Executive, Business Team Sales - Berks & Lancaster Counties

Remote Full-time

Sales Director

Remote Full-time

Experienced Customer Service Representative – Specialty Mail Order Pharmacy at arenaflex

Remote Full-time

International Standards Verifier - International BTEC - Agriculture - UK Based

Remote Full-time

Experienced Full Stack Customer Support Professional – Public Records Management

Remote Full-time

Experienced Customer Support Specialist – Delivering Exceptional Service at arenaflex

Remote Full-time

Senior Director Business Operations & Annual Planning

Remote Full-time