AI Runtime Engineer

The role

You will develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators. You will work on low-latency, high-performance runtime software to enable efficient execution of deep learning models on specialized hardware.

What you will do

• Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
• Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
• Optimize data movement between host and device using PCIe, DMA, shared memory.
• Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM.
• Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.
• Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.
• Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments.

Required qualifications

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
• 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.
• Strong proficiency in C/C++ and low-level systems programming.
• Deep understanding of task scheduling, concurrency, and memory hierarchy.
• Experience with hardware-aware optimizations and dataflow architectures.
• Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO).
• Experience with low-latency, high-throughput workload execution for AI models.
• Strong debugging and profiling skills for optimizing AI execution performance.
• Exposure to AI model deployment pipelines (Triton, TensorFlow Serving).

About the company

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. Launched in 2022, it is led by veteran technologists with backgrounds in semiconductor design and AI systems.