AI Systems Engineer – LLM Execution

For over a decade now, OpenNebula Systems has been leading the development of the European open source technology that helps organizations around the world to manage their corporate data centers and build their Enterprise Clouds.

If you want to join an established leader in the cloud infrastructure industry and the global open source community, keep reading, because you can now join a team of exceptionally passionate and talented colleagues whose mission is to help the world's leading enterprises to implement their next-generation edge and cloud strategies. We are hiring!

Since 2019, and thanks to the support from the European Commission, OpenNebula Systems has been leading the edge computing innovation in Europe , investing heavily in research and open source development, and playing a key role in strategic EU initiatives such as the IPCEI-CIS and the “European Alliance for Industrial Data, Edge and Cloud”.

OpenNebula’s new AI Factory product line delivers sovereign, edge-to-cloud AI infrastructure—enabling enterprises and governments to deploy, orchestrate, and optimize next-generation AI workloads with full control. This role is key to building the execution layer powering that vision. We are currently looking for an AI Systems Engineer to come and join us in Europe as part of our new team developing the AI Factory product line.

Job Description

We are looking for a highly skilled AI Systems Engineer with hands-on experience in executing, tuning, and scaling Large Language Models (LLMs) across multi-GPU infrastructures. This role is central to the development of our new AI Factory product line, which enables open, sovereign, and disaggregated AI infrastructure across cloud and edge environments.

You will help design and optimize LLM execution pipelines, working at the intersection of inference engines, orchestration platforms, and LLM model catalogs. Your responsibilities will include communicating with users, addressing their needs, troubleshooting, and providing step by step solutions.

Responsibilities

• Design, implement, and optimize LLM inference pipelines for multi-GPU and multi-node environments.
• Integrate with cutting-edge inference engines (e.g., vLLM, TensorRT-LLM, DeepSpeed, etc.).
• Tune execution parameters for latency, throughput, and memory efficiency across heterogeneous infrastructures.
• Work closely with orchestration frameworks such as Ray, NVIDIA NeMo / Dynamo, and others to coordinate LLM serving at scale.
• Integrate with LLM catalogs and registries such as HuggingFace, NVIDIA NIM, and internal repositories.
• Collaborate with product and platform teams to shape a modular, portable AI Factory execution layer.
• Interact with users and use cases, providing systems support, system architecture definition, making recommendations based on user needs, implementation, testing, user training, and deployment of open source solutions.
• Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures.
• Deliver quality performance indicators within the scope of the assigned project, including project journals, status reports, and other standard documentation.
• Work with other companies in the cloud-edge ecosystem within international projects and open-source communities. Availability to occasional travel and participation in international events and meetings.
• Write and maintain software documentation and project reports.

Experience required

Academic Background and Certifications

Professional Experience

Technical Experience

Language Skills

Soft Skills & Collaboration

What's in it for me?

Some of our benefits and perks vary depending on location and employment type, but we are proud to provide employees with the following;