MIDREAL
Menu

Home / DeepInfer

deepseek-ai

DeepInfer

WatchingWatchingNone of the above. Nothing stands out yet. More on the methodology page

deepseek-ai/DeepInfer

DeepInfer: High-performance, large-scale inference framework for DeepSeek models

PythonCategories: Local AI

Our summary

DeepInfer is an open-source, high-performance inference framework for DeepSeek models. It provides offline inference with features for serving at scale, including optimized kernels, parallelism options, and batch-invariant inference.

Who it is for: Developers serving DeepSeek models at large scale on NVIDIA SM100 or Huawei Ascend 950 hardware.

What the README claims

  • Supports DeepSeek-V4.1-Flash as a model. Supported models: - DeepSeek-V4.1-Flash Not checked
  • Runs on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs. - NVIDIA SM100 GPUs - Huawei Ascend 950 NPUs Not checked
  • Provides batch-invariant inference that keeps results identical across different batch compositions. keep model results identical across different batch compositions Not checked
  • Supports structured outputs constrained to a regex, JSON schema, or EBNF grammar. constrain generation to a regex, JSON schema, or EBNF grammar Not checked
  • Reports measured benchmarks on 4 SM100 GPUs for prefill and 64 for decode. Measured on 4 SM100 GPUs for prefill and 64 for decode Not checked

Written by AI from the project's README on 2026-10-21. It does not affect the verdict.

Watching: no other rule matched yet.

7-day star gain 256, down from 417 the week before.

PyPI downloads on the latest day: 7, up from 2 a week earlier.

Commits in the last 30 days: 6, up from 3 30 days earlier.

Gaining 256 stars this week. Last push 3 days ago.

Verdict

OVERHYPED scored 1h ago

Hype
86
Reality
51
Hype Gap
+36
Momentum
-
Confidence
85%
  • Responsive moves Reality +6 points.
  • Adopted moves Reality -5 points.
  • Maintained moves Reality -4 points.

Rule verdict-2.0, scoring score-2.0. How we score. Backtest.

Repository on GitHub

Find them on

Maintained by

Maintained by a team with no developer above half of all commits, 3 external contributors in the last 90 days.

  • deepseek-ai is a GitHub organization.
  • GitHub account created October 2023.
  • Top contributors by commits: beginlner 33%, Inference1 17%, wx-csy 17%.

Why now 1% of its stars arrived in the last 7 days. No Hacker News posts in the last 7 days.

Stars StarsThe number of GitHub stars on the repository at our latest reading.
26,304
Gain 7d Gain 7dStars gained since our latest reading from at least 7 days ago.
+256
Pace Velocity (Nx usual pace)This week's star gain divided by the project's usual weekly gain. The usual gain is the average weekly gain over the 4 weeks before (days 8 to 35 ago), counted as at least 10 stars. 2.0x means twice the usual pace. Without a reading from 35 days ago, the ranking assumes 2% of the stars the project had 7 days ago as its usual weekly gain. More on the methodology page
0.5x
HN points HN pointsHacker News points added up across posts that mention the project, published in the last 7 days.
0 7 days
Downloads DownloadsDownloads per day of the project's package, as the registry (npm or PyPI) reports them.
7 latest day
Contributors Contributors, all timePeople and anonymous contributors who have ever committed to the repository, as GitHub counts them. A small number is context, not a flaw: many solid projects are kept by one or two people.
5
Last release Latest releaseDays since the latest GitHub release was published.
n/a

Gain 24h Gain 24hStars gained since our latest reading from at least 24 hours ago. +30. Forks ForksThe number of GitHub forks of the repository at our latest reading. 3,244. Open issues Open issuesThe number of open issues on the repository at our latest reading, as GitHub counts them. 264. Days since push Days since pushDays since the last push to the repository. 3 days. Archived ArchivedWhether the owner has archived the repository on GitHub. An archived repository is read-only. no. Hacker News posts in 7 days Hacker News postsThe number of Hacker News posts that mention the project, published in the last 7 days.: 0. Watchers WatchersThe number of GitHub users watching the repository for notifications, at our latest reading. 65.

Facts

License
Apache-2.0 source, checked 22 Nov 2026
Language
Python source, checked 22 Nov 2026
Releases
0 source, checked 19 Nov 2026
Contributors
5 source, checked 19 Nov 2026
Archived
no source, checked 22 Nov 2026

Nerd stuff

Python

Languages
Python (detected), C++ (detected), Shell (detected), Makefile (detected)
Runs on
Python >=3.12 (detected)
Hardware
CUDA: referenced (detected)
Docs
examples/ folder (detected)
License
Apache-2.0 (detected)
Package ecosystem
Python packaging (detected)

The Receipts

SourceEvidenceDate
Hacker NewsThread, 2,351 points, 892 comments20 Oct 2026
Newsletter or feedDeepSeek Open-Sourced the Engine Behind Its API. Is Self-Hosting V4.1 Flash Cheaper Than Paying per Token?25 Oct 2026
Newsletter or feedHow to run DeepSeek's DeepInfer: build, deterministic outputs and JSON schema24 Oct 2026
Newsletter or feedDeepSeek Just Made AI Inference More Interesting 🚀24 Oct 2026
Newsletter or feedThursdAI - Oct 22 - AI finds all the vulnerabilities, Claude Duet, DeepSeek drops Infer & more AI news23 Oct 2026
Newsletter or feedTools This Week: October 23, 2026 - DuckDB 2.0, TorchTPU23 Oct 2026
Newsletter or feed[AINews] OpenAI’s Patch the Planet program is 1 of 2 parties to discover PHP2Shell vulnerabilities in core PHP affecting 70% of the web, using GPT-5.6 Sol; coordinated response over 2 months22 Oct 2026
Newsletter or feed[AINews] OpenAI’s Patch the Planet program is 1 of 2 parties to discover PHP2Shell vulnerabilities in core PHP affecting 70% of the web, using GPT-5.6 Sol; coordinated response over 2 months22 Oct 2026
Newsletter or feedMistral Large 4 and Open Weights: A Practical Guide for Philippine AI Teams21 Oct 2026
Newsletter or feedDeepInfer Is an Inference Engine, Not an Installer, and the Four-Layer Boundary Explains Why21 Oct 2026
Newsletter or feedDeepSeek DeepInfer Won't Run on Your RTX 5090. Here's What to Run Instead21 Oct 2026
Newsletter or feed[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback21 Oct 2026
Newsletter or feed[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback21 Oct 2026
Newsletter or feedDeepSeek Open-Sources DeepInfer, Its Production Inference Engine21 Oct 2026
Newsletter or feedDeepSeek Opens DeepInfer: What Developers Still Need to Build a Serving Stack21 Oct 2026
Newsletter or feedDeepSeek open-sources the inference engine behind its API. And Huawei gets equal billing with Nvidia.20 Oct 2026
Newsletter or feedDeepSeek open-sourced its production inference engine today. I counted what's in it - and what's not.20 Oct 2026
Newsletter or feedSloth Brief: an AI news agent that reads overnight so I can be lazy in the morning20 Oct 2026
PackagePyPI deepinfer21 Nov 2026
deps.devDependent packages on PyPI: 022 Nov 2026
deps.devSecurity advisories on PyPI: 022 Nov 2026

What changed recently

GitHub release dates we stored. We do not track license changes yet.

Cite this

DeepInfer is a GitHub project at https://github.com/deepseek-ai/DeepInfer written mainly in Python, described there as "DeepInfer: High-performance, large-scale inference framework for DeepSeek models".

Source: https://midorreal.com/project/deepseek-ai-deepinfer, checked 22 November 2026. The same facts as JSON: /project/deepseek-ai-deepinfer.json.

Rank history

Peak day: +5,795 stars on 21 Oct 2026, 32 days ago.

Best rank on Blowing up: #46 on 28 Oct 2026.

Label timeline

  • 21 Oct 2026: Being talked about
  • 22 Oct 2026: Surging
  • 8 Nov 2026: Quiet climber
  • 21 Nov 2026: Watching

Stars

Stars each day Stars each dayThe highest star count we recorded on each day., last 34 days. Without JavaScript this shows the last 30 days.

Events in this window

Dated items we stored, last 30 days. They sit near the chart, they do not explain it.

Stars gained each day Stars gained each dayThe difference in the daily peak star count between consecutive days that both have a reading., between readings on consecutive days. Last 30 days in the fallback.

PyPI downloads

Downloads DownloadsDownloads per day of the project's package, as the registry (npm or PyPI) reports them.. Latest day 7, busiest day 74, 371 in total, 20 Oct 2026 to 21 Nov 2026.

Packages

RegistryPackage
PyPIdeepinfer

Only packages whose registry page links back to this repository are listed.

Signals

SourceWhat we measuredChecked
GitHub26,304 stars, 256 gained in 7 days22 Nov 2026
Hacker News1 post stored, 0 points in the last 7 days27 Oct 2026
Feed mentions17 mentions in tracked newsletters and blogs25 Oct 2026
npmNo linked package found-
PyPI7 downloads on the latest day21 Nov 2026
Docker HubNo linked package found-
crates.ioNo linked package found-
HomebrewNo linked package found-
deps.dev0 PyPI dependents22 Nov 2026
Hugging FaceNot tracked yet-
BlueskyNot tracked yet-
Stack ExchangeNot tracked yet-
YouTubeNot tracked yet-

Attention vs adoption

Attention: above 49% of tracked projects 49%
Star velocity against all tracked projects

Adoption: above 21% of tracked projects 21%
Strongest of downloads, dependents and pulls (PyPI)

Attention runs ahead of adoption: star velocity above 49% of tracked projects, best adoption figure above 21%. This describes the numbers; it is not a verdict.

Compared with Local AI

MeasureThis projectCategory median
Star velocity0.50.7
Days since releaseno data8.0
Contributors, all time53
Median time to first reply on issuesno data20 hours
Commits in the last 30 days631

Star velocity: above 39% of Local AI projects

Contributors, all time: above 58% of Local AI projects

Commits in the last 30 days: above 26% of Local AI projects

Compared with the project's first category only. A percentile line appears only where at least 30 projects in the category have the measure. This describes the numbers; it is not a verdict.

Compare with

Hacker News

Points by day Hacker News points by dayPoints on Hacker News posts that mention the project, grouped by the day each post was published. across 1 post and 1 day, 2,351 points in total.
PostPoints PointsThe points the post has on Hacker News.Comments CommentsThe number of comments on the post on Hacker News.Date
Hacker News post 2,351 892 20 Oct 2026

Caveats

  • The repository has no security policy on GitHub. Source
  • The repository has 0 releases on GitHub. Source
  • Star velocity is above 49% of tracked projects, while the best package adoption figure is above 21%.

Repo health

  • Languages LanguagesShare of the repository's code by bytes, as GitHub's language detection reports it. The five biggest languages are named and the rest are grouped as Other.Python 89%, C++ 11%
  • License LicenseThe SPDX license id GitHub detects, and a class: Open source (OSI) if the license is on the Open Source Initiative approved list, Source-available if the code is readable but the license limits use, Unclear if GitHub cannot match a known license, No license detected if it finds none. A public repository without a license is not open source.Apache-2.0, Open source (OSI)
  • Repository age Repository ageTime since the repository was created on GitHub. This is the repository, not necessarily the project, which may have existed elsewhere before.37 days, created 16 Oct 2026

Development

  • Commits in the last 7 days Commits in the last 7 daysCommits to the repository in the last 7 days, as GitHub counts them.0
  • Commits in the last 30 days Commits in the last 30 daysCommits to the repository in the last 30 days, as GitHub counts them.6
  • Commits in the last 90 days Commits in the last 90 daysCommits to the repository in the last 90 days, as GitHub counts them.6
  • Contributors, all time Contributors, all timePeople and anonymous contributors who have ever committed to the repository, as GitHub counts them. A small number is context, not a flaw: many solid projects are kept by one or two people.5
  • Releases ReleasesThe number of GitHub releases, and how many days ago the latest one was published.0
  • Issues in the last 30 days Issues in the last 30 daysIssues opened and issues closed in the last 30 days, as GitHub search counts them.0 opened, 0 closed
  • Pull requests merged in the last 30 days Pull requests merged in the last 30 daysPull requests merged in the last 30 days, as GitHub search counts them.7
  • Packages that depend on the latest version Packages that depend on the latest versionHow many other packages list the project's latest published version as a dependency, from deps.dev, added up across npm and PyPI.0

Maintenance

  • Stale open issues Stale open issuesOpen issues with no update in the last 90 days, as GitHub search counts them.0
  • Open pull requests Open pull requestsPull requests open now, as GitHub search counts them.228

Hygiene

  • Automated tests or builds (CI) Automated tests or builds (CI)Whether the repository has at least one GitHub Actions workflow file in .github/workflows.No
  • A tests folder A tests folderWhether the repository has a top-level folder named tests, test, __tests__ or spec.Yes
  • A license A licenseWhether GitHub detects a license file in the repository.Yes
  • Contributing guide Contributing guideWhether the repository has a contributing guide.Yes
  • Code of conduct Code of conductWhether GitHub finds a code of conduct in the repository.No
  • CODEOWNERS file CODEOWNERS fileWhether the repository has a CODEOWNERS file, which names who reviews changes to which files.No
  • A Dockerfile A DockerfileWhether the repository has a Dockerfile at its top level.No

Security

  • Security policy Security policyWhether the repository has a SECURITY.md or SECURITY.rst file.No
  • Unpatched high or critical advisories Unpatched high or critical advisoriesPublished GitHub security advisories rated high or critical on this repository that list a vulnerable version with no patched version.0
  • Known advisories on the latest version Known advisories on the latest versionSecurity advisories deps.dev lists against the project's latest published version, added up across npm and PyPI.0

Badge

For maintainers: one measured fact, no verdict. First spotted by Mid or Real at 3,437 stars on 20 Oct 2026

Markdown

[![Mid or Real](https://midorreal.com/badge/deepseek-ai-deepinfer.svg)](https://midorreal.com/project/deepseek-ai-deepinfer)

HTML

<a href="https://midorreal.com/project/deepseek-ai-deepinfer"><img src="https://midorreal.com/badge/deepseek-ai-deepinfer.svg" alt="Mid or Real"></a>

Verdict badge: Mid or Real: OVERHYPED It shows the verdict as this page shows it today.

Markdown

[![Mid or Real: OVERHYPED](https://midorreal.com/badge/deepseek-ai-deepinfer.svg?style=verdict)](https://midorreal.com/project/deepseek-ai-deepinfer)

HTML

<a href="https://midorreal.com/project/deepseek-ai-deepinfer"><img src="https://midorreal.com/badge/deepseek-ai-deepinfer.svg?style=verdict" alt="Mid or Real: OVERHYPED"></a>

Passport

Copy these facts into a post, a README or a page. Cite as "Source: Mid or Real". Full record: JSON.




First tracked 20 Oct 2026 at 3,437 stars.

Projects blowing up

How we call a verdict

Is this your project? Claim it

Figures by method 1.0