Technical Legal Engineer - Evals
legora
Job Score
80 ptsAbout Us
Legora is redefining how legal work gets done. Not built for lawyers, built with them. We work alongside the world’s best legal teams, who expect excellence, precision, and speed, and we hold ourselves to the same bar.
Our AI-native workspace lets legal professionals move faster, think more clearly, and operate with sharper precision. By analysing thousands of documents in minutes and powering end-to-end workflows, we cut through complexity, teams can focus on what matters: judgment, strategy, and outcomes.
1,000+ customers across 50+ countries trust us, including Cleary Gottlieb, Goodwin, Linklaters, White & Case, Dentons, and Barclays. We’ve scaled to $100M+ in ARR, with teams across Europe, North America and APAC, and continue to expand through acquisitions including Qura, Walter AI and Graceview.
We partner with world-class performers: including Aaron Judge and the New York Yankees, Ludvig Åberg (and his caddie), and campaigns featuring Jude Law.
Joining Legora means three things.
We lean in: ownership over titles, outcomes over intentions.
We fight for excellence: high standards, direct, ego-free feedback.
We grow together: as a team and with our customers.
Mission before ego. Everyone contributes. No one coasts.
If you’re driven by impact, pace, and raising the bar. This is the place.
The Role
We are seeking a tech-savvy lawyer with knowledge of, or a strong interest in tech products, AI and LLM evaluations.
Apply your legal training and practice experience to evaluate, stress-test, and improve AI systems used in legal work. You will not be expected to code, but will apply legal judgment at scale. You would be reviewing and helping to improve AI-generated outputs as an experienced lawyer would review junior work, precedents, or research memos.
This role is ideal for a lawyer who enjoys issue-spotting, quality control, and analytical rigor, and is eager to shape how legal work is performed using modern technology.
You will collaborate closely with senior legal engineers, product managers, and engineers to ensure AI outputs meet professional standards for legal accuracy, reasoning, and usability.
What You Will Be Doing
Legal Review & Evaluations
Review AI-generated legal outputs for accuracy, completeness, legal reasoning, and jurisdictional correctness across research, drafting, and analysis use cases.
Assess outputs for real-world usability and identify failure modes, edge cases, and legal ambiguities that affect product reliability.
Dataset & Benchmark Development
Design and build high-quality evaluation datasets, including benchmark cases and gold-standard legal answers.
Define clear scoring rubrics and evaluation guidelines for consistent, objective assessment.
Continuously refine benchmarks as products, models, and legal requirements evolve.
Error Analysis & Insight Generation
Identify recurring legal errors, edge cases, and failure patterns.
Distinguish minor drafting issues from substantive legal risks.
Flag AI behavior that could mislead users or create downstream legal risk.
Collaboration & Feedback
Work closely with senior legal engineers, product managers, and engineers.
Translate legal feedback into clear, actionable guidance for non-lawyers.
What This Role Is Not
No production coding required.
No provision of legal advice to clients.
No traditional billable work.
Instead, you will use your legal training to define, evaluate, and safeguard legal quality at scale.
Legora is an Equal Opportunity Employer
At Legora, we believe great teams are built on diversity of thought and experience. We’re proud to be an equal opportunity employer and committed to creating an inclusive, high-performance culture where everyone can do their best work. We welcome people of all backgrounds and don’t discriminate based on race, color, religion, national origin, gender, gender identity or expression, sexual orientation, age, disability, veteran status, or any other characteristic protected by law.
About Account Manager
The Account Manager is the professional responsible for managing and expanding the relationship with clients after the sale. They act as a strategic partner, ensuring satisfaction, retention, and account growth, connecting client needs with company solutions.
Key skills include relationship management, negotiation, upsell and cross-sell, contract renewal, account planning, business reviews, metrics analysis (NPS, churn, LTV), and CRM knowledge (Salesforce, HubSpot). Communication, empathy, and business vision are fundamental differentiators.
Account Managers in technology and SaaS companies are highly valued, especially those who can increase recurring revenue (MRR/ARR) through account expansion and churn prevention. The field offers opportunities from account executive to director of accounts, with a focus on strategic relationship, revenue growth, and customer success.
Discover Other Areas
Understand the scope of work, key skills, and tools used in different career areas.
About Technical Support
Technical Support is essential to ensure customer satisfaction and retention. Support professionals resolve technical issues, document solutions, and identify patterns that can lead to product improvements.
Key skills include troubleshooting, customer service, technical documentation, ITIL knowledge, and ticketing tools (Zendesk, Freshdesk, Intercom).
Technical support has evolved from a reactive to a proactive function, with high-level professionals working in Customer Engineering and Support Engineering.
About Branding
Branding is the area responsible for building, managing, and strengthening a brand's identity and market value. Branding professionals create strategies that define how the brand is perceived by the public, from the logo to the complete customer experience.
Key skills include brand strategy, visual identity, brand guidelines, positioning, naming, brand voice, market research, brand equity, and brand management. Knowledge of graphic design (Figma, Illustrator, Photoshop), storytelling, and brand experience is a differentiator.
Branding professionals in technology companies are highly valued, especially those who master employer branding, digital branding, and can build strong, memorable brands in competitive markets. The field offers opportunities from brand designer to head of brand, with a focus on identity, differentiation, and perceived value.
About Administrative
The Administrative area is responsible for ensuring the efficient functioning of all organizational operations. Administrative professionals manage processes, human resources, procurement, and facility management.
Key skills include process management, Office 365, administrative ERPs, compliance, and people management. Knowledge of automation and AI tools is becoming increasingly relevant.
The digitization of administrative processes has created new opportunities for professionals who master technology and management.
About Business Intelligence
Business Intelligence (BI) is the area responsible for transforming raw data into strategic information for decision-making. BI professionals build dashboards, reports, and analyses that help companies understand their performance and identify growth opportunities.
Key skills include data modeling (star schema, snowflake), ETL (extraction, transformation, loading), advanced SQL, BI tools (Power BI, Tableau, Looker), data warehousing, KPIs, and business metrics analysis (MRR, churn, cohort). Knowledge of dbt, Airflow, and data pipelines is a differentiator.
BI professionals in technology companies are highly valued, especially those who master data visualization, analytics engineering, and can translate complex data into actionable insights for the business. The field offers opportunities from BI analyst to head of data, with a focus on data-driven decision making.
About Traffic Manager
The Traffic Manager is the professional responsible for planning, executing, and optimizing paid media campaigns across various digital platforms. With the competitiveness of the digital market, paid traffic professionals are essential for generating qualified leads and maximizing return on advertising investment.
Key skills include campaign management on Google Ads, Meta Ads, LinkedIn Ads, and TikTok Ads, media planning, metrics analysis (ROAS, CPA, CPC, CTR), A/B testing, remarketing, and landing page creation. Tools like Google Analytics, Google Tag Manager, Hotjar, and automation platforms are essential.
Traffic managers in technology companies are highly valued, especially those who master performance marketing, conversion funnel optimization, and scaling strategies. The field offers opportunities from media analyst to head of performance, with a focus on growth, budget efficiency, and return on investment.
Comments 0