Sources & Methods

“A computer can never be held accountable. That's your job as the human in the loop.”

“The model has read a large chunk of the internet. It doesn't remember facts the way you do — it has learned statistical patterns across trillions of words. The training data is everything: what it knows, what it doesn't, and where it will confidently confabulate.”

“Our results show that fine-tuning with human feedback significantly improves outputs on a wide range of tasks — and that labelers strongly prefer InstructGPT outputs over those of GPT-3, despite InstructGPT having 100x fewer parameters.”

“We find that through purely reinforcement learning training, without any supervised chain-of-thought demonstrations, the model spontaneously develops sophisticated reasoning behaviours — including self-verification, backtracking, and extended deliberation before answering.”

Official overview of Harvey's legal AI capabilities — document drafting, contract analysis, legal research, and matter summarisation.

Harvey's product home — enterprise AI built specifically for law, tax, and professional services firms.

Fast Company's profile of Harvey as one of the most innovative companies of 2026, covering its enterprise growth and legal AI positioning.

Bar association overview of Harvey's feature set written for practising lawyers — useful for grounding capability expectations against professional standards.

Independent practitioner review covering Harvey's strengths, limitations, and workflow integration from a user perspective.

GrowLaw's review of Harvey for law firms — practical coverage of use cases, pricing considerations, and day-to-day workflow fit.

Legora's solution page for law firms — document intelligence, workflow automation, and due diligence tooling.

Legora's product home — legal AI platform with a strong focus on Nordic and European jurisdictions and data residency.

A practical framework for evaluating legal AI tools, covering jurisdiction fit, data governance, accuracy benchmarks, and hallucination risk.

Microsoft's case study on Legora's Azure OpenAI integration — covers technical architecture and enterprise deployment at scale.

The foundational professional conduct rules underpinning responsible legal AI use: Rule 1.1 Comment 8 (technology competence), Rule 1.6 (confidentiality of client data), and Rules 5.1 & 5.3 (supervision of lawyers and non-lawyer assistants, including AI tools).

Landmark 2023 case in which counsel submitted AI-generated briefs citing non-existent cases. The court sanctioned the attorneys — establishing binding precedent that lawyers bear full accountability for AI-generated content they file.

The foundational paper introducing RAG — the technique that lets AI models ground responses in retrieved documents rather than training memory alone. Core to how legal AI tools reduce hallucination when working with specific source material.

The landmark RCT on professional AI use — 758 BCG consultants, 18 tasks. Source for the 'jagged frontier' concept: 25% faster, 40% higher quality inside the frontier; 19pp worse outside it. Foundation for the Research Evidence section.

Preregistered RCT with 444 professionals on writing tasks. Source for the 40% speed gain, 18% quality improvement, and skill-compression findings in the Research Evidence section.

First legal-specific RCT: law students with/without GPT-4 on realistic legal tasks. Source for the consistent speed gains / uneven quality improvement finding and the junior-lawyer uplift pattern.

Primary source for the 2026 legal RCT showing quality gains from o1-preview and Vincent AI, fewer hallucinated citations with the RAG-grounded tool, and task-specific quality effects.

Source for the claim that untrained LLM access can be counterproductive in legal analysis, while brief training improved adoption and scores.

Source for the workflow-placement claim: AI helped early legal synthesis without reducing later comprehension, but AI revision helped weaker memos while degrading stronger ones.

Deployment study supporting the legal-engineering claim that curated legal knowledge bases, controlled prompting, and expert-in-the-loop review can produce near-final legal drafts in a bounded workflow.

Interview study supporting the claim that legal AI fact-verification workflows require auditability, accountability, confidentiality controls, and human legal judgment.

Benchmark source for the claim that specialized statutory RAG and legal error analysis can outperform generic or commercial legal AI setups, but retrieval and reasoning failures remain material.

Benchmark source for the claim that retrieval quality sets the ceiling for many legal RAG workflows and that groundedness must be evaluated separately from answer fluency.

Quasi-experimental source for the claim that specialized GenAI can reduce task-level drafting time in rule-bound public-sector workflows, especially for newer employees.

Source for the measurement caution that AI can increase output volume more than useful task completion, making workflow-level productivity metrics essential.

Systematic review source for the cross-study synthesis that task-level AI productivity gains are real but heterogeneous by task, expertise, and measurement method.

Source for the legal-engineering claim that real legal work is an adaptive workflow with decision points and review loops, not just isolated answer generation.

Methodology source for the claim that legal AI evaluation and tool design benefit from participatory methods where lawyers and technologists co-design tasks, simulations, and criteria.

Benchmark source for the evaluation-rubric claim: legal AI should be tested against legal task taxonomies rather than generic model capability claims.

Benchmark source for the retrieval-grounding claim that legal RAG needs expert-annotated relevant passages and legal-domain groundedness checks.

Source for the verification-risk claim that legal hallucinations remain a core failure mode requiring citation checks and human legal review.

Source for the claim that even legal RAG and legal research tools require human verification because hallucinations and unsupported legal propositions can persist.

Foundational empirical paper establishing that TAR matches or exceeds exhaustive manual review recall at dramatically lower cost. Kept as background context for validated, auditable legal automation.

Vendor-funded controlled comparison retained as supporting context for narrow contract-review automation claims; no longer used as a headline academic evidence card.

Industry survey retained as adoption context for legal and compliance professionals; not used as primary academic evidence for productivity or quality claims.

Practitioner coverage retained as context for how legal AI RCT findings were surfaced in the legal industry; primary claims now use the 2026 journal article directly.

The most thorough independent tracker of legal technology developments. Primary source for the Recent Developments feed — covering tool launches, court decisions, and adoption data with detailed analysis.

Legal AI industry publication covering tool launches, market developments, and technology trends. Source for Microsoft Legal Agent and OpenAI legal vertical coverage in the developments feed.

Survey of 1,300+ legal professionals conducted in late 2025. Found individual AI adoption doubled to 69% in a year while institutional governance (policies, training) significantly lagged — the governance gap entry in the developments feed.

Source for the hallucination incidents data: 1,348 cases catalogued worldwide as of April 2026, growing from ~2/week to ~2-3/day. Covers the shift in legal AI toward reasoning-based approaches.

Effective June 15 2026, requires all signers of Florida court filings to certify that cited legal authorities exist and are accurately cited. Direct regulatory response to AI hallucination incidents in court submissions.

Legal news outlet covering AI regulation, court rulings, and compliance developments. Monitored as part of the daily digest.

Industry publication covering law firm strategy, legal tech adoption, and market developments. Monitored as part of the daily digest.

Official EU source for AI Act updates, implementation guidance, and enforcement timelines. Primary regulatory reference for EU AI coverage in the digest.

Independent tracker of the EU AI Act's progress, obligations by risk tier, and implementation deadlines. Useful for quickly checking where a specific article or obligation stands.

EDPB guidance and enforcement actions on AI and GDPR intersections — transparency obligations, data subject rights, and coordinated enforcement. Monitored for AI-specific opinions and decisions.

EU policy news outlet with dedicated AI coverage. Strong on legislative process, member-state positions, and Brussels negotiations around the AI Act and digital regulation.

Investigative and policy outlet tracking algorithmic accountability and AI governance in Europe. Covers enforcement gaps, civil society responses, and high-risk AI system incidents.

Law firm insights on EU and global AI regulation — practical compliance analysis written for practitioners. Useful for understanding legal obligations in plain terms.

Fieldfisher's technology and AI regulatory commentary. Covers GDPR enforcement, AI Act obligations, and cross-border AI compliance for European businesses.

Official Anthropic announcements covering model releases, safety research, and product updates. Primary source for Claude-related developments in the digest.

Official OpenAI announcements covering model releases, API changes, and product launches. Monitored for frontier model developments relevant to legal and enterprise AI.

Google DeepMind's research and product announcements, including Gemini model releases. Monitored for capability and pricing developments.

Mistral's model and product announcements. Relevant for open-weight model releases and European frontier AI developments.

Meta's AI research and product updates, including Llama model releases. Monitored for open-weight model developments and inference ecosystem changes.

xAI's announcements covering Grok model releases and updates. Monitored as part of the frontier model landscape.

Release notes and feature updates for the Cursor AI code editor. Monitored for prompting and agentic coding workflow developments.

GitHub's official blog covering Copilot updates, Actions features, and developer AI tools. Monitored for AI coding workflow and agent developments.

Cognition AI's blog covering Devin — the autonomous software engineering agent. Relevant for understanding agentic coding patterns and capabilities.

High-signal blog from the creator of Datasette, covering practical LLM usage, prompting techniques, and agentic coding workflows. One of the most reliable sources for real-world AI coding tips.

Tech community aggregator where popular prompting techniques and LLM workflow threads frequently surface. Front page and search reliably capture what practitioners are finding useful.

Community for Claude users sharing prompting techniques, workflows, and tips. High-upvote threads reliably surface practical insights that haven't made it to formal writeups yet.

Community focused on running and prompting open-weight models locally. Techniques discussed here often generalise to hosted models. Strong signal for prompting patterns and inference optimisations.

Podcast and newsletter covering AI engineering, prompting research, and practitioner workflows. Surfaces Twitter/X discourse and translates it into structured analysis.

Karpathy's writing and social posts on LLM behaviour, prompting intuitions, and AI learning. His observations on X regularly generate high-signal discussion worth tracking.

Engineering-focused newsletter with serious AI coding tool coverage. Covers real-world adoption of AI tools in engineering teams — useful for prompting and workflow patterns in professional contexts.

Daily AI news aggregator covering model releases, research, and industry developments across all major sources. Used as a catch-all to surface developments that may have been missed from primary sources.

The primary reference for the LLM Deep Dive module. Karpathy's lecture covers the full stack from pretraining data and tokenization through the transformer architecture, alignment, and reasoning models — all without requiring a maths background.

HuggingFace's open pretraining dataset and interactive demo. Shows the quality filtering pipeline used to build web-scale training data, making abstract data curation decisions concrete and explorable.

Interactive tokenizer visualiser. Shows in real time how different text is split into tokens by GPT-4, Llama, and other tokenizers — essential for building intuition about cost, context limits, and tokenization failure modes.

A 3D interactive visualisation of the transformer architecture showing how tokens flow through attention and feed-forward layers. Referenced in the architecture lesson as a hands-on companion.

Karpathy's from-scratch C implementation of GPT-2 pretraining. Makes the pretraining process concrete and auditable — valuable for understanding exactly what pretraining does and how base models differ from assistant models.

Meta's technical report for Llama 3. One of the most detailed public accounts of a modern LLM training pipeline — pretraining data, tokenizer design, architecture choices, and alignment approach. Referenced throughout the deep dive module.

Cloud inference platform offering access to base models (pre-alignment) alongside instruction-tuned variants. Allows direct comparison of base vs. fine-tuned model behaviour — used in the pretraining lesson challenge.

The paper that established RLHF as the standard approach to LLM alignment. Demonstrated that a 1.3B parameter aligned model outperforms a 175B base model on human preference metrics — making alignment quality as important as scale.

Browser-based interface for running open models via HuggingFace's inference API. Used in the alignment lesson challenge to compare base vs. instruction-tuned model behaviour.

The paper demonstrating that RL training on verifiable tasks produces emergent chain-of-thought reasoning without explicit demonstrations. Open-source weights enabled broad reproducibility. Central reference for the reasoning models lesson.

Cloud inference playground for open models including DeepSeek-R1, Llama 3, and Mistral variants. Used in the reasoning models lesson challenge for side-by-side model comparison.

The AlphaGo paper showing that RL with self-play can discover superhuman strategies in Go without human demonstrations. Provides the conceptual foundation for understanding how RL training enables reasoning models to discover chain-of-thought strategies.

Human preference benchmark for language models. Real users vote on blind model comparisons, producing ELO-based rankings that reflect genuine user preference rather than academic benchmark performance.

Daily newsletter summarising significant AI research, model releases, and industry developments. Recommended in the inference ecosystem lesson as a reliable way to stay current in a fast-moving field.

Desktop application for downloading and running open LLMs locally without any command-line setup. Used in the inference ecosystem lesson challenge to experience fully local, private model inference.