Jobb Terminal45 753 lediga jobb

← Alla jobb

Annons (#31628869)

Senior LLM Inference Engineer / AI Infrastructure Architect - 20159

Veritaz AB · Stockholm

Stockholm, Stockholms län

2dagar kvarSista ansökningsdag
20 november 2026

Publicerad
21 oktober 2026 kl 17:17
Sista ansökningsdag
20 november 2026
Heltid eller deltid
Heltid
Anställning
Tidsbegränsad anställning
Varaktighet
6 månader – upp till 12 månader
Lön
Fast och rörlig lön
Yrke
Infrastrukturarkitekt
Erfarenhet
Krävs enligt arbetsgivaren
Körkort
Krävs inte

Utbildning

Utbildning eller motsvarande erfarenhet.

Yrket i rubriken (Engineer) kräver normalt eftergymnasial utbildning (högskola, YH eller legitimation) eller motsvarande erfarenhet

Bedömt automatiskt från annonsen. Kan bli fel, läs annonstexten.

Om jobbet

KravOm företagetCV-ord

Veritaz is a leading IT staffing solutions provider in Sweden, committed to advancing individual careers and aiding employers in ensuring the perfect talent fit. With a proven track record of successful partnerships with top companies, we have rapidly grown our presence in the USA, Europe, and Sweden as a dependable and trusted resource within the IT industry.
Job Overview
Role Summary
An experienced Senior LLM Inference Engineer / AI Infrastructure Architect
Key Responsibilities
Analyze existing LLM-powered applications and agent workflows to identify performance bottlenecks, resource constraints, and cost drivers.
Optimize inference performance with respect to token usage, response times, concurrency, GPU memory utilization, and overall service capacity.
Evaluate model selection, including the use of smaller models for less complex tasks where appropriate.
Assess and implement inference optimization techniques such as prompt caching, batching, and quantization.
Conduct performance measurement, load testing, and capacity planning for AI services.
Compare operating models including model APIs, self-hosted cloud deployments, on-premises infrastructure, and hybrid alternatives.
Develop a concrete decision basis for future operating strategy, including recommendations for GPU capacity, scaling approaches, and economically viable usage-volume thresholds.
Document findings, implemented improvements, and technical recommendations, and transfer knowledge to the development team.

Technical Stack & Requirements Krav

Production deployment and optimization of Large Language Models (LLMs).
Strong understanding of the relationship between model size, context length, GPU memory, concurrency, response latency, and operating cost.
Hands-on experience with Python, Linux, and container-based deployments.
Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or equivalent technologies.
Experience with performance benchmarking, load testing, and capacity planning for AI solutions.
Practical knowledge of caching, batching, quantization, and GPU-oriented inference optimization.

Qualifications & Experience Krav

The ideal candidate has substantial practical experience deploying and optimizing language models in production environments. They can translate technical analysis and performance results into clear, commercially relevant recommendations and decision material. Experience with AI agents and agent-based workflows is advantageous. Additional merit is given for experience with distributed inference, multi-GPU or multi-node scaling, and evaluating cloud, self-hosted, and hybrid operating models from both technical and financial perspectives.

Ansök hos arbetsgivaren

Du söker på arbetsgivarens webbplats, veritaz.se. Den öppnas i en ny flik. Sista ansökningsdag 20 november 2026.

Källa: Platsbanken, annons 31628869. Texten visas som arbetsgivaren skrev den.

45 753 lediga jobbUppdaterad 18 nov kl. 21:46Källa Platsbanken, JobAd Links och Jobicy