AI Lead Engineer

Location : Hybrid (Madrid)

We're building the

evaluation system that enables production‑grade autonomous agents at scale —the critical infrastructure that transforms experimental AI into reliable, deployable intelligence.

Our integrated suite of tools enables teams to orchestrate complex workflows, maintain complete observability, continuously benchmark performance against production standards, and iteratively enhance autonomous systems with confidence. We're establishing the evaluation standards and governance frameworks that will become the backbone of enterprise AI operations.

As a Lead AI Engineer at Baluarte, you'll drive the development and deployment of production‑grade AI systems and intelligent agent workflows that define how enterprises evaluate and operate autonomous intelligence at scale. You'll own the complete ML lifecycle, from data preparation through rigorous performance assessment, and ensure every model and agent system meets the production standards that matter.

Responsibilities

• Design and implement robust pipelines for data ingestion, processing, and feature engineering across diverse data sources
• Deploy machine learning models and large language models to production with comprehensive evaluation frameworks that guarantee performance, stability, and auditability
• Create efficient fine‑tuning workflows for LLMs with version control and systematic hyperparameter management, ensuring measurable improvements
• Establish evaluation frameworks (comparative testing, LLM‑based assessment, automated validation) and monitoring infrastructure that tracks performance metrics, detects model drift, and triggers corrective actions
• Build and optimize retrieval‑augmented generation (RAG) systems with rigorous performance evaluation and production reliability

Qualifications

Innovative Builder

You thrive amid uncertainty, adapt quickly to changing priorities, and excel in dynamic startup environments

Compensation & Benefits

Competitive base salary (€75,000 / yr to €100,000 / yr) + performance‑based incentives

Flexible hybrid working arrangement + mobility support as needed (based in Madrid)

30 days of annual leave (in addition to local statutory holidays)

Interview Process

Most candidates complete all stages within 2 weeks. Practical Assessment – Real‑world technical challenge reflecting actual projects at Baluarte

Values & Vision Conversation – Exploration of your career goals, professional values, and cultural fit

#J-18808-Ljbffr