Backend Engineer- Inference Services

The role

You will design and implement secure, robust, and scalable services for speech processing, distributed compute orchestration, and optimized scheduling. You will improve core inference services including networking, speech processing, audio transcoding, and latency and memory optimization.

What you will do

• Improve Deepgram's core inference services including networking, speech processing, audio transcoding, and latency and memory optimization
• Develop processes for measuring, building, and optimizing services to maximize system performance
• Debug complex system issues including networking, scheduling, and high performance computing interactions
• Rapidly customize backend services to support customer needs
• Partner with Product to design and implement new services, features, and/or products end to end

Required qualifications

• 3+ years of experience in an industry role
• Programming experience in Rust (or C, C++)
• Competence in Python
• Excellent communication and organizational skills, both written and verbal
• A high level of experience and understanding of version control
• Comprehensive experience with UNIX-style systems

Nice to have

• Experience with modern machine learning, such as experience with a framework like Torch or implementation knowledge of architectures like CNNs, RNNS, and transformers
• Experience with audio processing
• High level of experience and understanding of version control; preferably git

About the company

Deepgram is a research company that productizes as fast as possible. Their speech models and real-time infrastructure power AI systems for more than 5,000 organizations.