Certifyos

AI & Support Automation - Engineer

Bengaluru, India, Remote. Posted 2 months ago

The role

This engineer will lead support automation initiatives and design and build AI solutions end-to-end. You will identify support problems, build AI/automation solutions, deploy them to production, and continuously improve them.

What you will do

  • Identify high-impact support processes for AI/automation.
  • Design, build, integrate, test and deploy AI-powered workflows and agents.
  • Develop solutions using LLMs, RAG, AI agents and workflow automation.
  • Build end-to-end AI pipelines covering knowledge/data ingestion, orchestration, model execution, tools/actions, evaluation and production monitoring.
  • Integrate AI with CRM, ticketing, knowledge bases and internal tools.
  • Monitor AI quality, accuracy, cost, latency and business impact.
  • Partner with Product and Engineering to drive AI-led transformation.

Required qualifications

  • 3+ years overall experience in software engineering, AI/ML, automation, technical operations or support technology.
  • 2+ years of hands-on Generative AI/LLM application development, with demonstrated production experience.
  • Experience in automation, integrations or workflow engineering.
  • Strong experience taking AI/automation projects from concept and architecture through production and continuous improvement.
  • Strong Python and/or JavaScript/TypeScript.
  • LLM APIs and Generative AI application development.
  • RAG, embeddings, vector databases and knowledge pipelines.
  • AI agents, agentic workflows, tool/function calling and MCP.
  • End-to-end AI/LLM pipelines: ingestion to orchestration to model to tools/actions to evaluation to production.
  • REST APIs, webhooks, SQL and system integrations.
  • LLM evaluation, observability, guardrails, monitoring and cost/latency optimization.
  • Production deployment, CI/CD and troubleshooting of AI/automation systems.

Nice to have

  • Experience with OpenAI/Anthropic/Claude/Gemini
  • Claude Code
  • LangChain/LangGraph
  • LlamaIndex
  • n8n/Make/Zapier/Power Automate
  • vector databases
  • AI evaluation/observability tools
  • AWS/Azure/GCP
  • Docker
  • CRM/helpdesk platforms such as Zendesk, Salesforce, Jira, Freshdesk or Zoho

Benefits

  • 100% coverage of health, dental, and vision insurance premiums for employees
  • US-based team benefits from unlimited PTO, with at least two weeks off each year
  • India employees are supported with health insurance, statutory leave benefits, and additional wellness (menstrual) leave for women

About the company

CertifyOS is building the data infrastructure that powers modern healthcare. Their API-first platform automates provider licensing, enrollment, credentialing, and network monitoring.