Engineering Manager, Compiler & Runtime

The role

You will build and lead a team that writes the compiler, runtime, and kernels for hardware that runs memory-bound parts of large-model inference. You will hire the team, plan work against the hardware program, and partner with the senior compiler architect.

What you will do

• Grow the compiler and runtime team and set the hiring bar
• Develop each engineer's growth and career
• Turn the Systems Software roadmap into plans, milestones, and staffing
• Deliver software so LLMs run end to end on hardware through PyTorch
• Work with the compiler architect to make, staff, and finish technical decisions
• Review designs and weigh trade-offs
• Coordinate with the hardware team and serving and simulation work
• Keep compiler and runtime working against simulators, FPGA prototypes, and silicon
• Set up testing, release, and review practices

Required qualifications

• Experience managing engineers who build compilers, runtimes, or kernels for accelerators or other non-standard hardware
• Track record of hiring and mentoring strong systems engineers
• Depth in compilers and runtimes to review designs and weigh technical trade-offs with senior engineers
• Experience delivering software against a hardware schedule, from simulation through bring-up
• Familiarity with state of the art ML compiler stacks and with LLM inference workloads

Nice to have

• Experience taking an accelerator software stack from zero to production at a startup or new hardware initiative
• Experience with in-memory compute, processing-in-memory, or analog hardware interfaces
• Experience shipping an SDK or software product to external customers

About the company

Normal is an applied AI company solving the hardest problems in AI and silicon. They build foundational hardware and software for the semiconductor industry, critical AI infrastructure, and the broader systems that power our world.