Carefull - Sr. AI Engineer

The role

A Senior AI Engineer will build, evaluate, and improve AI-powered detection systems. You will research fraud patterns, design detection logic, and write production code to protect older adults from financial fraud.

What you will do

• Design and ship new AI-driven detection features from prototype to production.
• Build data enrichment pipelines for financial transaction data.
• Research fraud and scam typologies to translate into detection logic.
• Build reproducible evaluations including test sets, metrics, and error analysis.
• Investigate and fix issues reported by users or surfaced in production.
• Optimize AI pipelines for accuracy, latency, and cost.
• Work with Customer Care, Go-to-Market, and partner-facing teams.
• Keep up with new developments in LLMs and agents.

Required qualifications

• Strong Python skills with experience building data pipelines and production systems.
• Hands-on experience building LLM applications in production including prompting, structured outputs, context management, and working with provider SDKs and APIs.
• Comfort deploying and operating what you build on a cloud platform.
• A habit of measuring before claiming something works, including setting up evaluations and reading precision and recall.
• A track record of owning work end to end without close supervision.
• Real curiosity about the US financial system and how scammers operate.
• Comfort reasoning about ambiguity.
• Clear written and verbal communication in English.

Nice to have

• AWS experience (Lambda, CDK, Bedrock, Redshift, DynamoDB).
• Experience with LLM observability and tracing tools such as Langfuse or LangSmith.
• Background in fraud detection, fintech, or risk and compliance.
• Experience with financial transaction data (ACH, Zelle, wires, card payments).
• Experience working with regulated institutions such as banks.
• Experience working with regulated industries or bank partners.
• Exposure to elder care, aging-in-place, or financial vulnerability research.
• Background in data science or ML beyond LLMs (statistical modeling, anomaly detection).

Before you apply

• Silver Screening interview
• Take-home challenge
• Client technical interview
• CTO interview
• Final interview Hiring Manager

About the company

Carefull is an AI-powered financial safety platform that helps banks, credit unions, and wealth advisors protect older-adult customers from fraud and money mistakes.