MIDREAL
Menu

Home / samir-vllm

samir-sarwar

samir-vllm

WatchingWatchingNone of the above. Nothing stands out yet. More on the methodology page

samir-sarwar/samir-vllm

small LLM inference engine from scratch, w/ 6+ hours of youtube tutorials & 85+ pages of handwritten notes included

C++Categories: Local AIDeveloper tools

Our summary

samir-vllm is a small LLM inference engine written in C++17 and CUDA, built to teach how inference works. It loads Llama 3.2 1B Instruct weights from a safetensors file, runs the transformer layers on the GPU, and supports greedy generation with static or continuous batching and a paged KV cache.

Who it is for: Learners studying how LLM inference works internally

What the README claims

  • Runs the Llama 3.2 1B Instruct model with dense causal prefill across all 16 layers Dense causal prefill now runs all 16 layers Not checked
  • Uses a paged KV cache with 16-token pages Each physical page holds 16 tokens of K and V Not checked
  • Supports static and continuous batching Static batching and a continuous scheduler that admit queued prompts according to available page budgets Not checked

Written by AI from the project's README on 2026-11-10. It does not affect the verdict.

Watching: no other rule matched yet.

Gaining 21 stars this week. Last push 19 days ago.

Verdict

TOO EARLY scored 1h ago

There is not enough data on this project yet to call it. The numbers below are shown anyway.

Too close to call

Early read: we are missing data on the size of the team behind it and how widely it is used. This is an estimate and will be replaced by a verdict once we have the data. How early reads work.

Hype
92
Reality
20
Hype Gap
+72
Momentum
-
Confidence
60%
  • Maintained moves Reality -14 points.
  • Responsive moves Reality -10 points.

Rule verdict-2.0, scoring score-2.0. How we score. Backtest.

Repository on GitHub

Maintained by

Maintained by 1 primary developer, 0 external contributors in the last 90 days.

  • samir-sarwar is a GitHub individual account.
  • GitHub account created September 2024.
  • Top contributors by commits: samir-sarwar 100%.

Why now 9% of its stars arrived in the last 7 days. 1 Hacker News points in the last 7 days.

Stars StarsThe number of GitHub stars on the repository at our latest reading.
241
Gain 7d Gain 7dStars gained since our latest reading from at least 7 days ago.
+21
Pace Velocity (Nx usual pace)This week's star gain divided by the project's usual weekly gain. The usual gain is the average weekly gain over the 4 weeks before (days 8 to 35 ago), counted as at least 10 stars. 2.0x means twice the usual pace. Without a reading from 35 days ago, the ranking assumes 2% of the stars the project had 7 days ago as its usual weekly gain. More on the methodology page
2.1x
HN points HN pointsHacker News points added up across posts that mention the project, published in the last 7 days.
1 7 days
Downloads DownloadsDownloads per day of the project's package, as the registry (npm or PyPI) reports them.
n/a
Contributors Contributors, all timePeople and anonymous contributors who have ever committed to the repository, as GitHub counts them. A small number is context, not a flaw: many solid projects are kept by one or two people.
1
Last release Latest releaseDays since the latest GitHub release was published.
n/a

Gain 24h Gain 24hStars gained since our latest reading from at least 24 hours ago. +11. Forks ForksThe number of GitHub forks of the repository at our latest reading. 15. Open issues Open issuesThe number of open issues on the repository at our latest reading, as GitHub counts them. 0. Days since push Days since pushDays since the last push to the repository. 19 days. Archived ArchivedWhether the owner has archived the repository on GitHub. An archived repository is read-only. no. Hacker News posts in 7 days Hacker News postsThe number of Hacker News posts that mention the project, published in the last 7 days.: 1. Watchers WatchersThe number of GitHub users watching the repository for notifications, at our latest reading. 0.

Facts

Language
C++ source, checked 22 Nov 2026
Releases
0 source, checked 21 Nov 2026
Contributors
1 source, checked 21 Nov 2026
Archived
no source, checked 22 Nov 2026

Nerd stuff

Languages
C++ (detected), Cuda (detected), Python (detected), CMake (detected)

The Receipts

SourceEvidenceDate
Hacker NewsThread, 1 points, 1 comments20 Nov 2026
Hacker NewsThread, 80 points, 12 comments9 Nov 2026

What changed recently

GitHub release dates we stored. We do not track license changes yet.

Cite this

samir-vllm is a GitHub project at https://github.com/samir-sarwar/samir-vllm written mainly in C++, described there as "small LLM inference engine from scratch, w/ 6+ hours of youtube tutorials & 85+ pages of handwritten notes included".

Source: https://midorreal.com/project/samir-sarwar-samir-vllm, checked 22 November 2026. The same facts as JSON: /project/samir-sarwar-samir-vllm.json.

Rank history

Hot on Hacker News: #58 today, #58 yesterday (no change), #40 7 days ago (down 18).

Peak day: +45 stars on 10 Nov 2026, 12 days ago.

Stars

Stars each day Stars each dayThe highest star count we recorded on each day., last 14 days. Without JavaScript this shows the last 30 days.

Events in this window

Dated items we stored, last 30 days. They sit near the chart, they do not explain it.

Stars gained each day Stars gained each dayThe difference in the daily peak star count between consecutive days that both have a reading., between readings on consecutive days. Last 30 days in the fallback.

Packages

- We checked npm, PyPI, Docker Hub, crates.io and Homebrew and found no package that links to this repository.

Signals

SourceWhat we measuredChecked
GitHub241 stars, 21 gained in 7 days22 Nov 2026
Hacker News2 posts stored, 1 points in the last 7 days22 Nov 2026
Feed mentionsNot tracked yet-
npmNo linked package found-
PyPINo linked package found-
Docker HubNo linked package found-
crates.ioNo linked package found-
HomebrewNo linked package found-
deps.devNot tracked yet-
Hugging FaceNot tracked yet-
BlueskyNot tracked yet-
Stack ExchangeNot tracked yet-
YouTubeNot tracked yet-

Attention vs adoption

Attention: above 79% of tracked projects 79%
Star velocity against all tracked projects

Adoption: not enough data to rank
Downloads, dependents and pulls

Not enough comparable data yet to set attention against adoption. This describes the numbers; it is not a verdict.

Compared with Local AI

MeasureThis projectCategory median
Star velocity2.10.7
Days since releaseno data8.0
Contributors, all time13
Median time to first reply on issuesno data20 hours
Commits in the last 30 days931

Star velocity: above 83% of Local AI projects

Contributors, all time: above 0% of Local AI projects

Commits in the last 30 days: above 33% of Local AI projects

Compared with the project's first category only. A percentile line appears only where at least 30 projects in the category have the measure. This describes the numbers; it is not a verdict.

Compare with

Hacker News

Points by day Hacker News points by dayPoints on Hacker News posts that mention the project, grouped by the day each post was published. across 2 posts and 2 days, 81 points in total.
PostPoints PointsThe points the post has on Hacker News.Comments CommentsThe number of comments on the post on Hacker News.Date
Hacker News post 1 1 20 Nov 2026
Hacker News post 80 12 9 Nov 2026

Caveats

  • GitHub lists 1 contributor to this repository. Source
  • The repository has no security policy on GitHub. Source
  • The repository has 0 releases on GitHub. Source

Repo health

  • Languages LanguagesShare of the repository's code by bytes, as GitHub's language detection reports it. The five biggest languages are named and the rest are grouped as Other.C++ 76%, Cuda 22%, Python 1%, CMake 1%
  • License LicenseThe SPDX license id GitHub detects, and a class: Open source (OSI) if the license is on the Open Source Initiative approved list, Source-available if the code is readable but the license limits use, Unclear if GitHub cannot match a known license, No license detected if it finds none. A public repository without a license is not open source.Unclear
  • Repository age Repository ageTime since the repository was created on GitHub. This is the repository, not necessarily the project, which may have existed elsewhere before.2 months, created 27 Aug 2026

Development

  • Commits in the last 7 days Commits in the last 7 daysCommits to the repository in the last 7 days, as GitHub counts them.0
  • Commits in the last 30 days Commits in the last 30 daysCommits to the repository in the last 30 days, as GitHub counts them.9
  • Commits in the last 90 days Commits in the last 90 daysCommits to the repository in the last 90 days, as GitHub counts them.74
  • Contributors, all time Contributors, all timePeople and anonymous contributors who have ever committed to the repository, as GitHub counts them. A small number is context, not a flaw: many solid projects are kept by one or two people.1, a small team
  • Releases ReleasesThe number of GitHub releases, and how many days ago the latest one was published.0
  • Issues in the last 30 days Issues in the last 30 daysIssues opened and issues closed in the last 30 days, as GitHub search counts them.0 opened, 0 closed
  • Pull requests merged in the last 30 days Pull requests merged in the last 30 daysPull requests merged in the last 30 days, as GitHub search counts them.0

Maintenance

  • Stale open issues Stale open issuesOpen issues with no update in the last 90 days, as GitHub search counts them.0
  • Open pull requests Open pull requestsPull requests open now, as GitHub search counts them.0

Hygiene

  • Automated tests or builds (CI) Automated tests or builds (CI)Whether the repository has at least one GitHub Actions workflow file in .github/workflows.No
  • A tests folder A tests folderWhether the repository has a top-level folder named tests, test, __tests__ or spec.Yes
  • A license A licenseWhether GitHub detects a license file in the repository.Yes
  • Contributing guide Contributing guideWhether the repository has a contributing guide.No
  • Code of conduct Code of conductWhether GitHub finds a code of conduct in the repository.No
  • CODEOWNERS file CODEOWNERS fileWhether the repository has a CODEOWNERS file, which names who reviews changes to which files.No
  • A Dockerfile A DockerfileWhether the repository has a Dockerfile at its top level.No

Security

  • Security policy Security policyWhether the repository has a SECURITY.md or SECURITY.rst file.No
  • Unpatched high or critical advisories Unpatched high or critical advisoriesPublished GitHub security advisories rated high or critical on this repository that list a vulnerable version with no patched version.0

Badge

For maintainers: one measured fact, no verdict. First spotted by Mid or Real at 103 stars on 9 Nov 2026

Markdown

[![Mid or Real](https://midorreal.com/badge/samir-sarwar-samir-vllm.svg)](https://midorreal.com/project/samir-sarwar-samir-vllm)

HTML

<a href="https://midorreal.com/project/samir-sarwar-samir-vllm"><img src="https://midorreal.com/badge/samir-sarwar-samir-vllm.svg" alt="Mid or Real"></a>

Verdict badge: Mid or Real: too early It shows the verdict as this page shows it today.

Markdown

[![Mid or Real: too early](https://midorreal.com/badge/samir-sarwar-samir-vllm.svg?style=verdict)](https://midorreal.com/project/samir-sarwar-samir-vllm)

HTML

<a href="https://midorreal.com/project/samir-sarwar-samir-vllm"><img src="https://midorreal.com/badge/samir-sarwar-samir-vllm.svg?style=verdict" alt="Mid or Real: too early"></a>

Passport

Copy these facts into a post, a README or a page. Cite as "Source: Mid or Real". Full record: JSON.




First tracked 9 Nov 2026 at 103 stars.

Projects blowing up

How we call a verdict

Is this your project? Claim it

Figures by method 1.0