ai-engineering-from-scratch: An AI engineering course from math to MCP
An AI engineering course for developers, moving from Python math foundations to LLMs, ReAct, and MCP with an agent tutor.
GitHub rohitg00/ai-engineering-from-scratch Updated 2026-09-04 Branch main Stars 64.8K Forks 11.1K
Python AI engineering education Model Context Protocol Claude Code

🧭 Decision Guide

Try it if you

  • You want to progress from Python linear algebra, probability, and gradient descent to LLMs and MCP.
    The Contents lists Vectors, Probability, and Gradient Descent in Phase 1, while the later highlights list GPT-3, ReAct, and Model Context Protocol.
  • You use Claude Code or a compatible agent and want learning progress to resume across sessions.
    Option A provides npx skills add and says the skills include start-learning, learn, and course-guide, with progress stored in LEARNING.md and related files.
  • You want to read the course without setup, or clone it and run Python examples.
    Getting started provides online reading through Option B and the git clone, cd, and python3 vectors.py path through Option C.

Skip it if you

  • You need a production component with existing releases, stable dependencies, and an identifiable maintenance team.
    Project data lists 0 contributors, 0 releases, No releases, and recent maintenance as Unknown.
  • You require non-English course content to be human-reviewed.
    The README says English is canonical and lesson pages on the translations branch are machine-translated.
  • You need to complete executable MCP or Agent Skills labs without cloning the repository.
    Option A explicitly says copied repository code commands and executable MCP or Agent Skills labs require a local clone.

Requirements

  • Option A requires the Node.js, npx, host, and scope preflight; the README does not provide exact versions.
  • Running the Option C Python example requires the python3 command; the README does not provide a Python version.
  • Executable MCP or Agent Skills labs require a local clone; the online course pages do not require cloning.

First step (verbatim from README)

npx skills add rohitg00/ai-engineering-from-scratch

Watch out

  • Online Option B only opens completed lessons; code commands and MCP labs still require a local clone.
    Getting started describes Option B as no-clone reading and separately states the local-clone requirement for code commands and MCP labs.
  • Translated pages are not equivalent to the original English content because lessons on the translations branch use machine translation.
    The Read in your language section says English is canonical and lesson pages are machine-translated.
  • The contents after Phase 3 are omitted, so the supplied material cannot verify every later course.
    The README states that subsequent content is omitted due to length.

Not stated in the README

  • The exact versions of Node.js, Python, Julia, Docker, and phase-specific dependencies are unknown.
  • GPU models, cloud-service requirements, API providers, and key configuration details are unknown.
  • The complete lesson counts, code coverage, and test results after Phase 3 are unknown.
  • Beyond 0 contributors and 0 releases, code review, Issue response, and actual maintenance frequency are unknown.
  • Whether the course covers specific production frameworks, model weights, or deployment platforms is unknown.

💡 Deep Analysis

6
No I already know how to call LLM APIs and only want to ship an application quickly. I am not planning to study 22 mathematics lessons or the full ML and deep-learning paths. Is this project suitable for my goal?
For: An independent developer who only wants to ship an LLM application quickly, already knows API calls, and lacks time for systematic mathematics, classical ML, and deep-learning study

No, not as the primary tool for rapidly shipping an LLM application. Its purpose is a complete learning path from environment setup, mathematics, and classical ML through generative AI, LLMs, and agents, rather than a production framework or model-serving platform.

  • Phase 1 alone contains 22 mathematics lessons, Phase 2 contains 18 ML lessons, and later material covers deep learning, Transformers, diffusion models, RLHF, DPO, ReAct, and MCP.
  • The project insight explicitly says that it fills the gap between an end-to-end AI engineering learning path and executable practice, not the gap for a single model library or production framework.
  • Although the README offers web reading and focused routes, learn-mcp and learn-agent-skills are learning entry points, not ready-made application runtimes.

The project is valuable if I want to understand principles and build evidence progressively. For merely calling APIs, deploying a service, and controlling cost, the README makes no sufficient production capability claims.

  • Phase 1 — Math Foundations: 22 lessons
  • Phase 2 — ML Fundamentals: 18 lessons
  • Why this matters now: lists Transformers, diffusion models, RLHF, DPO, ReAct, and MCP
  • Project insight, market_gap: "not the gap for a single model library or production framework"
  • Project insight, usage_limitations: "not an AI framework, model service, or complete production platform that can be directly embedded in a business"
npx skills add rohitg00/ai-engineering-from-scratch
Not stated in the README:The README does not explain how to deploy a production LLM service, evaluate models, monitor latency, or control API cost.;The README does not state whether reusable application templates, server APIs, or production deployment configurations are included.
Yes I already use Claude Code, want to progress from LLMs into MCP and Agent Skills, and need learning state to persist across sessions in my own project repository. Is this project suitable for me?
For: An engineer using Claude Code who wants to move from LLMs into MCP and Agent Skills, while preserving resumable learning progress inside an existing repository

Yes, it is suitable because the project provides dedicated learning routes for MCP and Agent Skills and supports running the learning skills in Claude Code.

  • The Getting started section lists the learn-mcp and learn-agent-skills routes, so I can focus on these topics instead of following only the entire curriculum linearly.
  • Progress is stored in MCP-LEARNING.md or AGENT-SKILLS-LEARNING.md, making continuation across sessions possible.
  • The README says that cloning the repository auto-loads the learning skills in Claude Code. A local clone is required for copied repository commands and executable MCP or Agent Skills labs.

The README does not specify which MCP servers are supported, which Claude Code versions are required, how permissions are handled, or whether particular labs require paid APIs.

  • Getting started: "The installed skills provide `start-learning`, `learn`, `course-guide`, and the focused `learn-mcp` and `learn-agent-skills` routes."
  • Getting started: "Progress lives in `LEARNING.md`, `MCP-LEARNING.md`, or `AGENT-SKILLS-LEARNING.md` in your project"
  • Getting started: "Cloning also auto-loads the learning skills in Claude Code"
npx skills add rohitg00/ai-engineering-from-scratch
Not stated in the README:The README does not specify supported MCP servers, Claude Code versions, or detailed lab permission requirements.;The README does not state whether MCP or Agent Skills labs require paid APIs, cloud resources, or external models.
Yes I already have a mathematics background, mainly use Python, and want runnable code and Build lessons to produce portfolio evidence rather than only read online. Should I start with this project?
For: A student with mathematical foundations who wants to build evidence of AI engineering ability through local code and deliverables, mainly using Python and willing to clone the repository

Yes, it is suitable because the project explicitly connects learning, building, and shipping, while providing a local clone, lesson code, and Build-type lessons.

  • The README distinguishes Learn and Build lessons. Phase 0, Phase 1, and Phase 2 all contain Python Build lessons, including vector and matrix operations, automatic differentiation, PCA, linear regression, and logistic regression.
  • Option C provides a command to clone the repository and run vectors.py directly, so portfolio work can begin with executable code rather than web reading alone.
  • The project insight says that each lesson emphasizes code, experiments, and deliverables. Progress can also be stored in LEARNING.md, which helps document a continuous learning record.

However, the README does not define portfolio acceptance criteria, testing requirements, a unified project template, or an evidence format recognized by employers. The final presentation quality therefore requires work beyond the course itself.

  • Getting started: "Option C — clone and run."
  • Getting started: "python3 phases/01-math-foundations/01-linear-algebra-intuition/code/vectors.py"
  • Phase 1: Vectors, Matrices & Operations, Chain Rule & Automatic Differentiation, and PCA are marked Build
  • Phase 2: Linear Regression from Scratch and Logistic Regression & Classification are marked Build
  • Project insight, solution_analysis: "Each lesson is practice-oriented" and learning is completed "through code, experiments, and deliverables"
git clone https://github.com/rohitg00/ai-engineering-from-scratch.git
Not stated in the README:The README does not specify acceptance criteria, test coverage, or final deliverable formats for each Build lesson.;The README does not state whether a unified portfolio template or project-review mechanism is provided.
It depends I do not have a local GPU but can obtain cloud resources. I also need to learn Python environments, Docker, API keys, and debugging. Can this project be my starting point?
For: A Python learner without a local GPU who can use cloud resources and wants to configure an AI engineering environment first

It depends. The project is suitable for learning environment and tooling fundamentals, but completing later labs depends on their GPU, cloud, and external-API requirements.

  • Phase 0 explicitly includes Dev Environment, GPU Setup & Cloud, APIs & Keys, Python Environments, Docker for AI, Data Management, Terminal & Shell, Linux for AI, and Debugging & Profiling.
  • The project offers three entry points: web reading requires no setup or clone; terminal skills require Node.js, npx, a compatible host agent, and scope preflight; copied code and executable labs require a local clone.
  • Option C in the README provides a directly executable Python example, showing that at least some lessons can run locally.

The README does not identify cloud providers, GPU models, minimum VRAM, dependency versions, or per-lab resource thresholds. Without a GPU, I therefore cannot assume the later curriculum can be executed end to end.

  • Phase 0: "GPU Setup & Cloud", "APIs & Keys", "Python Environments", "Docker for AI", and "Debugging & Profiling"
  • Getting started: "Option B — read... No setup, no cloning."
  • Getting started: "A local clone is required for copied repository code commands and executable MCP or Agent Skills labs."
  • Getting started: "python3 phases/01-math-foundations/01-linear-algebra-intuition/code/vectors.py"
git clone https://github.com/rohitg00/ai-engineering-from-scratch.git
Not stated in the README:The README does not specify supported cloud platforms, GPU models, minimum VRAM, or expected cost.;The README does not provide Python, Docker, Node.js, or third-party API version requirements for each lesson.
Yes I mainly know Python and classical machine learning. I want to learn Transformers, LLM training, and inference without merely copying high-level APIs. Can this curriculum meet that need?
For: A developer with Python fundamentals who is moving from classical machine learning toward Transformers and LLMs, and wants to understand internals before using high-level frameworks

Yes, but I should expect a long and demanding path rather than a quick tutorial for mastering a particular LLM API.

  • Phase 1 covers linear algebra, gradients, automatic differentiation, probability, information theory, and tensor operations, providing the mathematical background needed to understand model mechanisms.
  • Phase 2 covers classical ML such as linear and logistic regression, followed by deep-learning fundamentals in Phase 3. The project insight explicitly says it builds core mechanisms before using frameworks.
  • The README’s industry-signal section lists Transformers, GPT-3, RLHF, DPO, Chain-of-Thought, and ReAct, showing that the path extends into LLMs and reasoning.

However, the README does not specify the complete Transformer or LLM code, frameworks, datasets, training scale, or experiment metrics. Its production-level depth therefore cannot be determined from the available material.

  • Project insight, solution_analysis: "build core mechanisms before using frameworks"
  • Phase 1 — Math Foundations: 22 lessons including Chain Rule & Automatic Differentiation, Optimization, and Tensor Operations
  • Phase 2 — ML Fundamentals: "Classical ML — still the backbone of most production AI."
  • Why this matters now: lists Attention Is All You Need, GPT-3, RLHF, DPO, Chain-of-Thought, and ReAct
git clone https://github.com/rohitg00/ai-engineering-from-scratch.git
Not stated in the README:The README does not provide the complete directory or code details for the Transformer, LLM training, and inference lessons.;The README does not specify the deep-learning frameworks, datasets, training hardware, cost, or evaluation metrics used.
Yes I run internal training, and the team already uses Python, Julia, Shell, and Docker. I want to turn mathematical foundations and classical ML into executable lessons. Is this repository suitable as training material?
For: An internal AI trainer working with Python, Julia, Shell, and Docker who wants to turn the curriculum into runnable mathematics and ML labs

Yes, it is suitable as training material, especially for an AI engineering course that combines theory, code, and phased progression. It should not be treated as a fully validated enterprise training platform without further review.

  • Phase 1 contains 22 mathematics lessons, with Python and Julia explicitly used for vector, matrix, eigenvalue, and SVD exercises.
  • Phase 2 contains 18 ML fundamentals lessons, and topics such as linear regression and logistic regression are marked as Build, which supports hands-on lab design.
  • Phase 0 covers Python environments, Shell, Docker, Git, and collaboration, connecting the lessons with practical development workflows.
  • The MIT License permits learning, modification, and reuse of the course content, which is compatible with internal training and derivative exercises.

The README does not specify test coverage, locked dependencies, instructor materials, enterprise case studies, or a maintenance policy. I would therefore need to validate each lesson in the team environment.

  • Phase 1 — Math Foundations: 22 lessons; Linear Algebra and SVD lessons list Python and Julia
  • Phase 2 — ML Fundamentals: 18 lessons; Linear Regression from Scratch and Logistic Regression & Classification are marked Build
  • Phase 0 — Setup & Tooling: includes Git & Collaboration, Python Environments, Docker for AI, and Terminal & Shell
  • Project data: MIT License
git clone https://github.com/rohitg00/ai-engineering-from-scratch.git
Not stated in the README:The README does not state the code test coverage, dependency-locking approach, or continuous-integration status.;The README does not state whether instructor guides, enterprise cases, course durations, or assessment materials are provided.

✨ Highlights

  • Covers Phases 0–14, including math, ML, LLMs, and MCP
  • Phase 1 has 22 math lessons with Python and Julia
  • Provides npx skills add to install learning skills into compatible agents
  • Covers GPT-3, RLHF, DPO, ReAct, and MCP
  • Has 52,363 GitHub stars, but 0 contributors and 0 releases

🔧 Engineering

  • The course spans from Phase 0 environment setup to ReAct in Phase 14
  • Option A uses npx skills add to install start-learning and learn routes
  • Option C provides a git clone and Python vector-code execution path

⚠️ Risks

  • The stack is marked Mixed/Unknown, with no dependency versions or runtime matrix
  • Contributors are 0, releases are 0, and recent maintenance is Unknown
  • English is canonical, while lesson pages on the translations branch are machine-translated
  • MCP and Agent Skills labs require a local clone, so online reading does not cover them

👥 For who?

  • Developers who want to learn from linear algebra to deep learning with Python
  • AI learners who need to understand GPT-3, RLHF, and DPO
  • Users of Claude Code or compatible agents who want persistent learning progress