Senior Data Scientist – LLM Expert

Description

As a Senior Data Scientist specialized in Large Language Models at Kyndryl's AI Innovation Hub, you'll help shape the frontier of intelligent and agentic systems — turning cutting‐edge research into real‐world impact for some of the world's most forward‐thinking enterprises.

You'll work with state‐of‐the‐art technologies, foundation models, and emerging agentic frameworks to design, fine‐tune, and deploy powerful LLM‐based solutions that understand, reason, and generate language with purpose.

In this role, you'll collaborate closely with architects, ML engineers, and product teams to transform ideas into production‐ready systems that redefine how organizations interact with knowledge and automation.

You'll operate in an environment that values experimentation, precision, and creativity — where you'll be encouraged to explore the limits of generative AI, drive technical excellence, and contribute to solutions used by top global clients.

If you're passionate about transforming language models into intelligent agents that can think, act, and assist — this is where your work will make a lasting mark.

Your Mission

Design, train, fine-tune, and evaluatelarge language modelsand their distilled or specialized variants (SLMs).

Develop and integrateGenerative AI and Agentic AI solutionsthat combine reasoning, retrieval, and language understanding.

Implement and optimizeRAG (Retrieval‐Augmented Generation)pipelines, ensuring precision, traceability, and scalability.

Collaborate with architects and ML engineers to bring LLM‐based solutions into production environments.

Define and apply robustevaluation frameworksand metrics for alignment, safety, hallucination control, and factual consistency.

Contribute to the Hub's innovation roadmap by exploring new models, architectures, and methods for fine‐tuning and instruction learning.

Advise on model optimization, includingquantization,distillation, andmemory‐efficient inference.

Promote best practices in documentation, traceability, and Responsible AI across all LLM‐based initiatives.

Who You Are

Essential Qualifications

4+ years of experience in AI model development, with at least 2 years focused onLLMs or advanced NLP systems.

Proven expertise infine‐tuning, instruction tuning, andevaluationof foundation models (GPT, Llama, Claude, Mistral, Gemma, etc.).

Hands‐on experience developingRAG pipelinesandLLM‐based reasoning architectures.

Solid understanding ofPythonand major libraries for LLM and AI development (Transformers, LangChain, LlamaIndex, PEFT, BitsAndBytes, LoRA, Accelerate).

Experience training or serving models onGPU / TPU environments(PyTorch, DeepSpeed, vLLM, Ollama).

Strong background invector databasesandembedding models.

Familiarity withmulti‐agent frameworksand orchestration systems (CrewAI, AutoGen, LangGraph, Google ADK).

KnowledgeofResponsible AI and evaluation principles— safety, bias mitigation, factual alignment, and model interpretability.

Experience deploying models inMLOps environments(MLflow, Vertex AI, Azure ML, OpenShift AI).

Education & Certifications

Bachelor's or Master's degree inComputer Engineering,Data Science,Mathematics,Computational Linguistics, or related field.

Postgraduate studies (Master's or PhD) inNatural Language Processing (NLP),Deep Learning, orArtificial Intelligenceare highly valued.

Additional training inGenerative AI,Prompt Engineering, orResponsible AIis a plus.

Demonstrated commitment to continuous learning and staying current with the latest research in LLMs and generative AI.

Preferred Skills

Expertise inprompt optimization,context management, andhallucination detection / mitigation.

Understanding ofLLMOpspractices andobservability toolsfor model monitoring and evaluation.

Experience withdistillation,quantization, andefficient inference strategies for scaling LLMs in production.

Familiarity withsemantic search,retrieval frameworks, andknowledge‐grounded generation.

Background inreinforcement learning from human feedback (RLHF)orpreference optimization.

Ability to analyze research papers, prototype rapidly, and transfer innovation into production‐ready systems.

Comfort working withhybrid architectures, integrating models across cloud and on‐premise environments.

Soft Skills

Clear and articulate communicator , able to explain complex model behavior and design choices to diverse audiences.

Analytical and experimental mindset , combining scientific rigor with creativity and problem‐solving agility.

Collaborative and cross‐functional approach , working closely with architects, engineers, and designers to deliver cohesive AI solutions.

Curiosity and innovation‐driven attitude , always exploring new models, datasets, and emerging techniques in the LLM space.

Business awareness , able to translate functional requirements into measurable AI outcomes.

Commitment to quality and reproducibility , ensuring experiments, metrics, and models are well‐documented and traceable.

Adaptability and growth mindset , embracing continuous learning in the rapidly evolving world of generative AI.

#AgenticAI

Being You Diversity is a whole lot more than what we look like or where we come from, it's how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we're not doing it single‐handily : Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That's the Kyndryl Way.

What You Can Expect With state‐of‐the‐art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well‐being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learningprograms give you access to the best learning in the industry to receive certifications, includingMicrosoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non‐profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.

#J-18808-Ljbffr