Roc Search
ML Systems Engineer
ML Systems Engineer at Roc Search, based in Greater London, paying £100,000 per annum. This is a permanent role.
- Pay
- £100,000 per annum
- Hours and contract
- Permanent · On site
- Location
- Greater London
- Closing date
- Sector
- DevOps Engineer
About 58% above the going rate for devops engineer
Reference BBBH97864_1795080335
About the role
ML Systems Engineer
Distributed AI | Machine Learning Infrastructure | Edge Computing
London (2 days per week in office)
AI Startup
£100,000-£110,000 DOE + Bonus
Skills: Python, MLops, Pytorch, Grafana, Elastic Search, TensorRT
The Opportunity
An exciting opportunity to join a fast-growing AI technology business developing advanced machine learning solutions for complex, real-world environments.
The company is building a distributed AI platform that enables machine learning models to operate directly within physical infrastructure, rather than relying solely on centralised cloud environments. Its technology focuses on improving operational efficiency, enabling intelligent decision-making and supporting more sustainable infrastructure.
As an ML Systems Engineer, you'll join a specialist team responsible for building the infrastructure that allows AI models to be trained, deployed, monitored and continuously improved across multiple distributed environments.
The Role
You'll take ownership of the systems engineering behind production ML workloads, ensuring models run reliably and efficiently across heterogeneous, resource-constrained hardware.
Working closely with Applied Scientists and Research Engineers, you'll bridge the gap between research and production, building the infrastructure, deployment workflows and experimentation environments needed to take new algorithms from concept through to real-world application.
Key Responsibilities
- Design and manage workload scheduling, resource allocation and isolation across multiple concurrent ML applications.
- Own model deployment and lifecycle management, including versioning, updates, monitoring, rollbacks and fleet-wide consistency.
- Build automated deployment pipelines, staged releases and testing environments.
- Develop distributed training and fine-tuning infrastructure, including orchestration, checkpointing and recovery.
- Profile and optimise model inference across different hardware environments, including GPU and LLM workloads.
- Build monitoring, alerting and observability solutions using tools such as Grafana and the Elastic Stack.
- Develop reliable telemetry and data pipelines to support machine learning, analytics and model performance.
- Troubleshoot complex issues across infrastructure, software and ML systems.
- Work closely with research teams to accelerate experimentation and improve engineering standards.
What We're Looking For
- Strong software engineering fundamentals and excellent Python skills.
- Experience building and operating production machine learning systems, from training and data pipelines through to deployment and monitoring.
- Solid distributed systems knowledge, particularly around reliability, state management and version control.
- Experience managing multiple workloads across shared or resource-constrained hardware.
- Understanding of model optimisation, profiling and efficient inference.
- Strong knowledge of PyTorch or similar ML frameworks, including distributed training and checkpointing.
- Experience with monitoring and observability tools such as Grafana, Prometheus or the Elastic Stack.
- A hands-on engineer who enjoys solving complex technical problems and working closely with research and engineering teams.
Desirable Experience
Experience in one or more of the following would be beneficial:
- Reinforcement learning infrastructure (Ray, RLlib) or control systems.
- LLM deployment and inference optimisation (vLLM, llama.cpp, ONNX, TensorRT).
- Federated learning, transfer learning or distributed machine learning.
- Edge computing, on-premise GPU infrastructure or hardware-constrained environments.
- Device orchestration, remote deployment and fleet management.
- Simulation environments and virtualised testing infrastructure.
- Streaming and telemetry technologies such as Kafka or MQTT.
- Operating AI systems within critical or regulated infrastructure.
Why Join?
- Work on genuinely challenging problems at the intersection of AI, software engineering and distributed systems.
- Play a key role in taking advanced machine learning research into production.
- Join an ambitious, well-backed technology business at an exciting stage of growth.
- Work alongside talented Applied Scientists, Research Engineers and infrastructure specialists.
- Take ownership of systems and architecture with the opportunity to make a significant technical impact.
- Contribute to technology with real-world applications across large-scale physical infrastructure and sustainability.
Reference: BBBH97864_1795080335 · Posted 25 minutes ago · Closes 17 Dec 2026 · Listed via Roc Search
Apply for this job
This role is listed via Roc Search. Applications are handled on the employer's site.
Apply on employer siteOpens the employer's website in a new tab.
Signed in? Every job you apply for counts toward your weekly goal and badges. How it works
Safe applying: a genuine employer will never ask you to pay for a DBS check, training or equipment, or move you onto WhatsApp before you are hired. If this listing does, report it and do not pay anything.