Legalhero logo

(Senior) AI Product Engineer (m/w/d)

Legalhero
Berlin, DERemote

About the Role

What You'll Do

You'll identify open AI opportunities, build them from start to finish, and bring them to real users. As a Senior AI Product Engineer, you'll work across our three product squads: you'll single-handedly turn unaddressed topics into products, hand them off once they're up and running, and serve as a sparring partner for the squad PMs on all AI-related topics. For us, "senior" refers to your approach to work, not your years of experience. You'll report directly to Product Leadership.

Your Responsibilities

Independent AI Projects (about half of your time)

  • You'll identify high-impact AI opportunities in our legal workflows - in areas where no specific squad is responsible
  • Validation happens quickly: discussions with attorneys, Legal Ops, and insurers; prototypes built in days
  • You'll bring the winning solutions into production yourself: routing, chaining, summarization, and agent-based loops
  • You'll hand off mature features to the squad - complete with documentation, evaluations, and a handover plan

Support for the Squads (the other half)

  • Feasibility, costs, model selection, risks: You'll answer these questions before every AI feature is launched
  • You support the teams in designing evaluations, golden datasets, and guardrails
  • You review concepts before they go into the roadmap - including prompt injection and compliance risks (GDPR, Section 203 of the German Criminal Code)
  • You advance AI best practices: prompt engineering standards, LLM observability, and agent-based coding workflows

What You Bring

Must-have

  • Multiple production-ready AI/LLM systems that you've shipped to real users and taken responsibility for - no prototypes
  • Demonstrable product ownership: from a vague problem to a finished product
  • Strong Python skills and a solid foundation in software engineering (Git, testing, CI/CD, code review)
  • In-depth experience with LangGraph, LangChain, or similar - including an understanding of what's happening under the hood
  • Proficiency with LLM provider APIs: function/tool calling, structured outputs, streaming
  • Evaluations, golden datasets, and guardrails before deployment
  • Solid prompt engineering - you know when to use which technique
  • Business-level English; German is a major plus due to our legal domain

Soft Skills

  • The maturity to work without a squad around you: You set your own priorities and know when to say no
  • You can explain a technical trade-off to a lawyer and a legal workflow to an engineer

What We Promise

  • Office-first: 3 days in the office, 2 days working from home
  • Modern, air-conditioned office with plenty of natural light and a large rooftop terrace overlooking Berlin
  • Central location between Gleisdreieck and Potsdamer Platz
  • Full coverage of the public-transport ticket
  • Company pension plan with a 20% employer contribution
  • Corporate benefits platform with discounts
  • Dog-friendly office
  • Regular company and team events
  • Free drinks, fresh fruit, and granola

Fast Application Process

Your application - short and to the point; approx. 20-minute introductory conversation with HR; approx. 60-minute in-person interview with your hiring manager; approx. 30-minute discussion with the management team; a prompt job offer.

Job Overview

100% EnglishNo German required
LegalheroHiring Company
Sep 13, 2026Date Posted