Towerresearchcapital
Research Platform Engineer
New York. Posted a month ago
The role
You will develop a multi-tenant research compute platform to orchestrate large scale ML workloads across hybrid GPU and CPU infrastructure. You will work with Quant Researchers, Portfolio Managers, and Infrastructure teams to build a unified, elastic research substrate.
What you will do
- Design platform abstractions, APIs, scheduler wrappers, and a job control plane
- Build a multi-tenant compute substrate with HPC-grade batch scheduling and tenant isolation
- Establish infrastructure agnostic execution abstractions for multi-datacenter and multi-cloud portability
- Evaluate, select, and integrate production-grade job graph orchestration engines
- Implement automated failure detection, retry-on-fault mechanisms, and high-performance checkpointing
- Profile and eliminate I/O bottlenecks for distributed ML workloads
- Implement telemetry to track compute utilization, queue pressure, and cost attribution
Required qualifications
- Deep experience with HPC job schedulers (e.g., Slurm), including gang scheduling, fair-share priority trees, topology-aware node allocation, and containerized HPC execution
- Advanced understanding of Kubernetes architecture, CRDs, HPC focused operators, admission controllers and GPU-native schedulers
- Familiarity with distributed computing frameworks (e.g., Ray) and deep learning frameworks (e.g., PyTorch, JAX) with multi-node scaling primitives
- Hands-on experience evaluating, architecting, and operating job graph orchestration frameworks
- Experience designing vendor-agnostic infrastructure layers, cloud-bursting strategies, and compute execution spanning multiple on-premise datacenters and public cloud environments
- Familiarity with high-performance storage solutions and high-speed network fabrics for large scale research workloads
- Proven track record building cluster-wide telemetry and cost-attribution platforms for multi-tenant environments
- A strong platform engineering mindset focused on reducing friction for researchers while maintaining operational efficiency, cost transparency, and system scalability
Benefits
- Generous paid time off policies
- Savings plans and other financial wellness tools available in each region
- Hybrid working opportunities
- Free breakfast, lunch, and snacks daily
- In-office wellness experiences and reimbursement for select wellness expenses
- Company-sponsored sports teams and fitness events
- Volunteer opportunities and charitable giving
- Social events, happy hours, treats, and celebrations throughout the year
- Workshops and continuous learning opportunities
About the company
Tower Research Capital is a leading quantitative trading firm founded in 1998. The firm has built its business on a high-performance platform and independent trading teams.