At Serve Robotics, we’re reimagining how things move in cities. Our personable sidewalk robot is our vision for the future. It’s designed to take deliveries away from congested streets, make deliveries available to more people, and benefit local businesses. The Serve fleet has been delighting merchants, customers, and pedestrians along the way in Los Angeles, Miami, Dallas, Atlanta and Chicago while doing commercial deliveries. We’re looking for talented individuals who will grow robotic deliveries from surprising novelty to efficient ubiquity.<h3>Who We Are</h3>We are tech industry veterans in software, hardware, and design who are pooling our skills to build the future we want to live in. We are solving real-world problems leveraging robotics, machine learning and computer vision, among other disciplines, with a mindful eye towards the end-to-end user experience. Our team is agile, diverse, and driven. We believe that the best way to solve complicated dynamic problems is collaboratively and respectfully.OverviewWe are seeking a highly skilled ML Performance Engineer to join our robotics team. This technical role bridges the gap between ML research and real-time deployment, enabling advanced ML models to run efficiently on edge hardware such as NVIDIA Jetson platforms. You will work closely with ML researchers, embedded systems engineers, and robotics software teams to ensure that state-of-the-art models can be deployed with optimal performance on robotic platforms.Responsibilities<ul style=""><li>Own the full lifecycle of ML model deployment on robots—from handoff by the ML team to full system integration.</li><li>Convert, optimize, and integrate trained models (e.g., PyTorch/ONNX/TensorRT) for Jetson platforms using NVIDIA tools.</li><li>Develop and optimize CUDA kernels and pipelines for low-latency, high-throughput model inference.</li><li>Profile and benchmark existing ML workloads using tools like Nsight, nvprof, and TensorRT profiler.</li><li>Identify and remove compute and memory bottlenecks for real-time inference.</li><li>Design and implement strategies for quantization, pruning, and other model compression techniques suited for edge inference.</li><li>Ensure models are robust to the resource constraints of real-time, low-power robotic systems.</li><li>Manage memory layout, concurrency, and scheduling for optimized GPU and CPU usage on Jetson devices.</li><li>Build benchmarking pipelines for continuous performance evaluation on hardware-in-the-loop systems.</li><li>Collaborate with QA and systems teams to validate model behavior in field scenarios.</li><li>Work closely with ML researchers to influence model architectures for edge deployability and provide technical guidance on the feasibility of real-time ML models in the robotics stack.</li></ul>Qualifications<ul style=""><li>Bachelor’s degree in Computer Science, Robotics, Electrical Engineering, or equivalent field.</li><li>3+ years experience in deploying ML models on embedded or edge platforms (preferably robotics).</li><li>2+ years of experience with CUDA, TensorRT, and other NVIDIA acceleration tools.</li><li>Proficient in Python and C++, especially for performance-sensitive systems.</li><li>Experience with NVIDIA Jetson (e.g., Xavier, Orin) and edge inference tools.</li><li>Familiarity with model conversion workflows (e.g., PyTorch → ONNX → TensorRT).</li></ul>What Makes You Standout<ul style=""><li>Master’s degree in Computer Science, Robotics, Electrical Engineering, or equivalent field.</li><li>Experience with real-time robotics systems (e.g., ROS2, middleware, safety-critical constraints and linux embedded systems).</li><li>Knowledge of performance tuning under thermal, power, and memory constraints on embedded devices.</li><li>Experience with model quantization (e.g., INT8), sparsity, and latency-aware model design.</li><li>Contributions to open-source ML or CUDA projects.</li></ul>

Why deliver a 2-pound burrito in a 2-ton car? Serve is the future of sustainable, self-driving delivery. Our zero-emissions robots are designed to serve people in public spaces, starting with food delivery. We partner with platforms and merchants to help local businesses reach more customers.

Software Engineer, ML Performance 

At Serve Robotics, we’re reimagining how things move in cities. Our personable sidewalk robot is our vision for the future. It’s designed to take deliveries away from congested streets, make deliveries available to more people, and benefit local businesses. The Serve fleet has been delighting merchants, customers, and pedestrians along the way in Los Angeles, Miami, Dallas, Atlanta and Chicago while doing commercial deliveries. We’re looking for talented individuals who will grow robotic deliveries from surprising novelty to efficient ubiquity.<h3>Who We Are</h3>We are tech industry veterans in software, hardware, and design who are pooling our skills to build the future we want to live in. We are solving real-world problems leveraging robotics, machine learning and computer vision, among other disciplines, with a mindful eye towards the end-to-end user experience. Our team is agile, diverse, and driven. We believe that the best way to solve complicated dynamic problems is collaboratively and respectfully.OverviewWe are seeking a highly skilled ML Performance Engineer to join our robotics team. This technical role bridges the gap between ML research and real-time deployment, enabling advanced ML models to run efficiently on edge hardware such as NVIDIA Jetson platforms. You will work closely with ML researchers, embedded systems engineers, and robotics software teams to ensure that state-of-the-art models can be deployed with optimal performance on robotic platforms.Responsibilities<ul><li>Own the full lifecycle of ML model deployment on robots—from handoff by the ML team to full system integration.</li><li>Convert, optimize, and integrate trained models (e.g., PyTorch/ONNX/TensorRT) for Jetson platforms using NVIDIA tools.</li><li>Develop and optimize CUDA kernels and pipelines for low-latency, high-throughput model inference.</li><li>Profile and benchmark existing ML workloads using tools like Nsight, nvprof, and TensorRT profiler.</li><li>Identify and remove compute and memory bottlenecks for real-time inference.</li><li>Design and implement strategies for quantization, pruning, and other model compression techniques suited for edge inference.</li><li>Ensure models are robust to the resource constraints of real-time, low-power robotic systems.</li><li>Manage memory layout, concurrency, and scheduling for optimized GPU and CPU usage on Jetson devices.</li><li>Build benchmarking pipelines for continuous performance evaluation on hardware-in-the-loop systems.</li><li>Collaborate with QA and systems teams to validate model behavior in field scenarios.</li><li>Work closely with ML researchers to influence model architectures for edge deployability and provide technical guidance on the feasibility of real-time ML models in the robotics stack.</li></ul>Qualifications<ul><li>Bachelor’s degree in Computer Science, Robotics, Electrical Engineering, or equivalent field.</li><li>3+ years experience in deploying ML models on embedded or edge platforms (preferably robotics).</li><li>2+ years of experience with CUDA, TensorRT, and other NVIDIA acceleration tools.</li><li>Proficient in Python and C++, especially for performance-sensitive systems.</li><li>Experience with NVIDIA Jetson (e.g., Xavier, Orin) and edge inference tools.</li><li>Familiarity with model conversion workflows (e.g., PyTorch → ONNX → TensorRT).</li></ul>What Makes You Standout<ul><li>Master’s degree in Computer Science, Robotics, Electrical Engineering, or equivalent field.</li><li>Experience with real-time robotics systems (e.g., ROS2, middleware, safety-critical constraints and linux embedded systems).</li><li>Knowledge of performance tuning under thermal, power, and memory constraints on embedded devices.</li><li>Experience with model quantization (e.g., INT8), sparsity, and latency-aware model design.</li><li>Contributions to open-source ML or CUDA projects.</li></ul>

Software Engineer, ML Performance

About the Job

About the Company

Serve Robotics

Similar Jobs

Sr. ML Research Scientist

Sr. ML Research Scientist

Machine Learning Engineer, Autonomy

Machine Learning Engineer, Autonomy

Software Engineer - Learned Trajectory Machine Learning Engineer

Software Engineer - Learned Trajectory Machine Learning Engineer

AI Engineer

AI Engineer

Senior/Staff Machine Learning Engineer, Training Runtime Performance

Senior/Staff Machine Learning Engineer, Training Runtime Performance

Senior Data Engineer, ML Infrastructure

Senior Data Engineer, ML Infrastructure

Machine Learning Engineer

Machine Learning Engineer

Sr. Principal Software Development & MLOps Lead

Sr. Principal Software Development & MLOps Lead

Senior AI Application Engineer

Senior AI Application Engineer

Software Engineer, ML Infrastructure

Software Engineer, ML Infrastructure