Rust Software Engineer – LLM Evaluation & Tooling

At Elvis Eckardt Recruitment & Sales Solutions Limited, we're not just your average recruiters or HR professionals.

We're a team driven by passion, committed to revolutionizing the way you experience recruitment and HR.

With over a decade of hands-on experience, we've honed our craft and specialize in delivering exceptional Recruitment and HR Solutions to SMEs, Start-Ups, and even the industry giants like the Big Four.

Our journey started from the ground up, and that's what makes us stand out – we're a bootstrapped endeavour that's all about connecting with businesses and candidates alike on a personal level.

We understand that one size doesn't fit all. That's why our approach to recruitment goes beyond the mundane.

Our aim is simple, yet profound – to exceed your expectations and create tailor-made, practical, and memorable experiences for you, whether you're a client looking for the perfect addition to your team, a candidate seeking the next big opportunity, or a partner sharing our vision.

At the heart of our mission is the drive to add real value to your operations. We're not here to simply provide solutions; we're here to optimize your entire Recruitment and sales processes, helping you achieve your goals more effectively.

Whether you're curious and want to learn more, need help finding exceptional freelancers, require headhunting expertise, or are looking for executive search services, our comprehensive Service Portfolio is just a few clicks away here on our website.

Let's make this personal. Reach out to us today at hello@elvis-eckardt.com, and let's embark on this exciting journey together – where Recruitment and Sales Solutions meet a personal touch.

The Role Senior Software Engineer – Rust (LLM Evaluation & Repository Validation)

Location : Permanent Remote, Africa-Based

Contract Type : Contractor (no medical / paid leave)

Duration : 3 months (extensions possible)

Start Date : Immediate (within 1 week)

Commitment : 20–40 hours / week with some overlap with Pacific Standard Time (PST)

Experience Required : 3–8 years overall, with 2+ years in Rust

About the Project

We are building LLM evaluation and training datasets to train large language models (LLMs) to work on realistic software engineering problems. A key approach in this project involves creating verifiable SWE tasks from public repository histories in a synthetic, human-in-the-loop process. The goal is to expand dataset coverage across programming languages, complexity levels, and problem domains.

This role blends hands-on software engineering with AI-focused research, giving you a chance to work at the intersection of open-source software and cutting-edge AI systems.

Responsibilities :

Analyse and triage GitHub issues across trending open-source libraries.

Set up and configure repositories (including Dockerization and development environment setup).

Evaluate unit test coverage and quality across projects.

Run and modify codebases locally to assess LLM bug-fixing performance.

Collaborate with researchers to design / select repositories and tasks challenging for LLMs.

(Optional) Lead junior engineers collaborating on evaluation tasks.

Why Join :

Work remotely on impactful AI + software engineering projects.

Collaborate with researchers shaping the future of AI-assisted development.

Opportunity to contribute to real-world open-source challenges while influencing LLM training and evaluation.

Application Process : To apply, please submit your CV and a cover letter detailing your relevant experience and qualifications for the role. Applications will be reviewed on a rolling basis, so early submissions are encouraged.

Equal Opportunity Employer : We value diversity and are committed to creating an inclusive work environment. We encourage applicants from all backgrounds to apply.

Contact : Elvis Eckardt

Ideal Profile

Must-Have Skills :

3–8 years of professional software development experience.

Minimum 2+ years of experience with Rust in production environments.

Strong proficiency with Git, Docker, and software pipelines.

Ability to navigate and understand complex, real-world codebases.

Comfortable running, modifying, and testing repositories locally.

Nice-to-Have Skills :

Prior contributions to or evaluation of open-source projects.

Experience with developer tools, automation agents, or AI / LLM evaluation.

Exposure to LLM-related research or dataset generation.

What's on Offer?

Work within a company with a solid track record of success

Great work environment

Join a well known brand within IT Services

#J-18808-Ljbffr