Agencywithin

Member of Technical Staff, AI

Long Island City, New York. Posted 8 months ago

The role

You will design applied AI systems and build products across frontend, backend, and data. You will own the full product lifecycle from defining problems to maintenance and scaling.

What you will do

  • Design applied AI systems and build products across frontend, backend, and data
  • Define problems, decide what to build, ship, evaluate, and maintain products
  • Find product-market fit by testing small versions with users
  • Improve products by testing changes and investing in high-performing versions
  • Expand and scale adoption and system reliability
  • Monitor performance and resolve problems
  • Set direction with business partners to scope and develop products

Required qualifications

  • Owned products end to end from ambiguous problems through launch and operation
  • Can decide what to test first, define success, and change course
  • AI tools are part of how you scope, build, test, and maintain software
  • Can choose between model behavior, deterministic software, and human review
  • Work independently and communicate tradeoffs
  • Strong Python skills and experience building production systems
  • Experience building production applications with LLM APIs such as OpenAI, Anthropic, or Vertex AI
  • Experience building agent workflows that use tools, call external systems, maintain state, and handle multi-step tasks
  • Experience designing evaluations for LLM-powered systems
  • Understanding of context management, token limits, multi-turn conversations, tool calling, structured outputs, prompt design, and common failure modes
  • Experience integrating external APIs and working with SQL
  • Experience tracing and debugging behavior across model calls, application code, tools, and external systems

Nice to have

  • Experience with TypeScript, React, and backend services
  • Multi-agent architectures
  • Embeddings, vector search, and retrieval-augmented generation
  • Stateful or sandboxed code execution environments
  • Human review and approval workflows
  • Observability, model routing, latency management, and cost control for AI systems
  • Document automation (Google Docs, Slides, PDFs)
  • Building internal developer tools or productivity platforms
  • Data warehouses (BigQuery, Snowflake, Databricks)
  • Data transformation (dbt)

Benefits

  • Unlimited vacation policy
  • Monthly Phone Stipend
  • Comprehensive Medical, Dental, and Vision insurance options
  • 401(K) plan with matching
  • Dog friendly office
  • Hybrid work opportunity
  • Professional Development Program
  • Bonus Perk - Seamless allowance

Before you apply

  • Interview process includes Excel and Typing Test
  • AI-assisted tool may be used to compare skills and job titles from resume with requirements

About the company

WITHIN is a Performance Branding company that partners with brands to drive growth through integrated marketing strategies. The company uses AI across all teams to innovate and solve problems.

Member of Technical Staff, AI at Agencywithin | JobZoey