Home / spinf-serve
spinfinc/spinf-serve
Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0
PythonCategories: Self-hosted
Our summary
spinf-serve is an open-source (Apache 2.0) inference server for bulk classification and decision inference on one 24 GB NVIDIA GPU. It reads a piece of content once and returns a probability over the options given for each question asked about it, instead of generated text. It exposes an OpenAI-compatible API.
Who it is for: Teams running bulk classification or decision scoring on their own GPU hardware
What the README claims
- Reads content once and answers many questions about it in the same pass
reads a piece of content once and answers many questions about it in the same pass
Not checked - Runs on one 24 GB NVIDIA GPU with an OpenAI-compatible API
It runs on one 24 GB NVIDIA GPU and serves an OpenAI-compatible API
Not checked - Processed 1,344 questions in 2.7 seconds on one RTX 4090 in the project's benchmark, versus 6.7 seconds for vLLM
| the 1,344 questions | **2.7 s** | 6.7 s |
Not checked - Batch-invariant: a content's scores are bit-identical whether scored alone or in a batch, with the fp8 checkpoints
With the fp8 checkpoints, a content's scores are bit-identical alone or packed with thousands of others
Not checked - Throughput is built as the priority rather than single-request latency
it is built for throughput rather than for the latency of a single request
Too broad to verify
Written by AI from the project's README on 2026-10-31. It does not affect the verdict.
Watching: no other rule matched yet.
No new stars this week. Last push 5 days ago.
Verdict
OVERHYPED scored 1h ago
- Hype
- 96
- Reality
- 38
- Hype Gap
- +58
- Momentum
- -
- Confidence
- 85%
- Maintained moves Reality -6 points.
- Adopted moves Reality -5 points.
- Responsive moves Reality +2 points.
Rule verdict-2.0, scoring score-2.0. How we score. Backtest.
Repository on GitHub Project homepage
Maintained by
Maintained by 1 primary developer, 0 external contributors in the last 90 days.
- spinfinc is a GitHub organization.
- Official organization: the project homepage matches the website on its GitHub profile.
- GitHub account created May 2024.
- Top contributors by commits: giarec 100%.
Why now No Hacker News posts in the last 7 days.
- Stars StarsThe number of GitHub stars on the repository at our latest reading.
- 21
- Gain 7d Gain 7dStars gained since our latest reading from at least 7 days ago.
- 0
- Pace Velocity (Nx usual pace)This week's star gain divided by the project's usual weekly gain. The usual gain is the average weekly gain over the 4 weeks before (days 8 to 35 ago), counted as at least 10 stars. 2.0x means twice the usual pace. Without a reading from 35 days ago, the ranking assumes 2% of the stars the project had 7 days ago as its usual weekly gain. More on the methodology page
- 0.0x
- HN points HN pointsHacker News points added up across posts that mention the project, published in the last 7 days.
- 0 7 days
- Downloads DownloadsDownloads per day of the project's package, as the registry (npm or PyPI) reports them.
- 1 latest day
- Contributors Contributors, all timePeople and anonymous contributors who have ever committed to the repository, as GitHub counts them. A small number is context, not a flaw: many solid projects are kept by one or two people.
- 1
- Last release Latest releaseDays since the latest GitHub release was published.
- 24 days ago
Gain 24h Gain 24hStars gained since our latest reading from at least 24 hours ago. 0. Forks ForksThe number of GitHub forks of the repository at our latest reading. 0. Open issues Open issuesThe number of open issues on the repository at our latest reading, as GitHub counts them. 0. Days since push Days since pushDays since the last push to the repository. 5 days. Archived ArchivedWhether the owner has archived the repository on GitHub. An archived repository is read-only. no. Hacker News posts in 7 days Hacker News postsThe number of Hacker News posts that mention the project, published in the last 7 days.: 0. Watchers WatchersThe number of GitHub users watching the repository for notifications, at our latest reading. 0.
Facts
- License
- Apache-2.0 source, checked 21 Nov 2026
- Language
- Python source, checked 21 Nov 2026
- Homepage
- https://spinf.com source, checked 21 Nov 2026
- Last release
- 0.1.2, 29 Oct 2026 source, checked 21 Nov 2026
- Releases
- 2 source, checked 21 Nov 2026
- Contributors
- 1 source, checked 21 Nov 2026
- Archived
- no source, checked 21 Nov 2026
Nerd stuff
PythonDockerCLI
- Languages
- Python (detected), Dockerfile (detected)
- Runs on
- Python >=3.12 (detected)
- Interfaces
- CLI (detected)
- Deployment
- Docker (detected)
- Hardware
- CUDA: referenced (detected)
- Docs
- docs/ folder (detected)
- License
- Apache-2.0 (detected)
- Package ecosystem
- Python packaging (detected)
The Receipts
| Source | Evidence | Date |
|---|---|---|
| Hacker News | Thread, 22 points, 5 comments | 30 Oct 2026 |
| Package | PyPI spinf-serve | 19 Nov 2026 |
| deps.dev | Dependent packages on PyPI: 0 | 22 Nov 2026 |
| deps.dev | Security advisories on PyPI: 0 | 22 Nov 2026 |
What changed recently
GitHub release dates we stored. We do not track license changes yet.
Cite this
spinf-serve is a GitHub project at https://github.com/spinfinc/spinf-serve written mainly in Python, described there as "Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0".
Source: https://midorreal.com/project/spinfinc-spinf-serve, checked 22 November 2026. The same facts as JSON: /project/spinfinc-spinf-serve.json.
Stars
Events in this window
Dated items we stored, last 30 days. They sit near the chart, they do not explain it.
PyPI downloads
Packages
| Registry | Package |
|---|---|
| PyPI | spinf-serve |
Only packages whose registry page links back to this repository are listed.
Signals
| Source | What we measured | Checked |
|---|---|---|
| GitHub | 21 stars, 0 gained in 7 days | 2 Nov 2026 |
| Hacker News | 1 post stored, 0 points in the last 7 days | 6 Nov 2026 |
| Feed mentions | Not tracked yet | - |
| npm | No linked package found | - |
| PyPI | 1 downloads on the latest day | 19 Nov 2026 |
| Docker Hub | No linked package found | - |
| crates.io | No linked package found | - |
| Homebrew | No linked package found | - |
| deps.dev | 0 PyPI dependents | 22 Nov 2026 |
| Hugging Face | Not tracked yet | - |
| Bluesky | Not tracked yet | - |
| Stack Exchange | Not tracked yet | - |
| YouTube | Not tracked yet | - |
Attention vs adoption
Attention: above 13% of tracked projects
Star velocity against all tracked projects
Adoption: above 0% of tracked projects
Strongest of downloads, dependents and pulls (PyPI)
Attention and adoption are about level: star velocity above 13% of tracked projects, best adoption figure above 0%. This describes the numbers; it is not a verdict.
Compared with Self-hosted
| Measure | This project | Category median |
|---|---|---|
| Star velocity | 0.0 | 0.7 |
| Days since release | 23.8 | 7.2 |
| Contributors, all time | 1 | 3 |
| Median time to first reply on issues | no data | 10 hours |
| Commits in the last 30 days | 10 | 71 |
Star velocity: above 17% of Self-hosted projects
Days since release: above 78% of Self-hosted projects
Contributors, all time: above 0% of Self-hosted projects
Commits in the last 30 days: above 15% of Self-hosted projects
Compared with the project's first category only. A percentile line appears only where at least 30 projects in the category have the measure. This describes the numbers; it is not a verdict.
Hacker News
| Post | Points PointsThe points the post has on Hacker News. | Comments CommentsThe number of comments on the post on Hacker News. | Date |
|---|---|---|---|
| Hacker News post | 22 | 5 | 30 Oct 2026 |
Caveats
- GitHub lists 1 contributor to this repository. Source
Repo health
- Languages LanguagesShare of the repository's code by bytes, as GitHub's language detection reports it. The five biggest languages are named and the rest are grouped as Other.Python 100%
- License LicenseThe SPDX license id GitHub detects, and a class: Open source (OSI) if the license is on the Open Source Initiative approved list, Source-available if the code is readable but the license limits use, Unclear if GitHub cannot match a known license, No license detected if it finds none. A public repository without a license is not open source.Apache-2.0, Open source (OSI)
- Repository age Repository ageTime since the repository was created on GitHub. This is the repository, not necessarily the project, which may have existed elsewhere before.28 days, created 25 Oct 2026
- Release dates Release datesThe date of the first and the latest GitHub release, and the latest release tag. Projects that ship without GitHub releases show none.First release 25 Oct 2026, current version 0.1.2 (29 Oct 2026)
Development
- Commits in the last 7 days Commits in the last 7 daysCommits to the repository in the last 7 days, as GitHub counts them.0
- Commits in the last 30 days Commits in the last 30 daysCommits to the repository in the last 30 days, as GitHub counts them.10
- Commits in the last 90 days Commits in the last 90 daysCommits to the repository in the last 90 days, as GitHub counts them.10
- Contributors, all time Contributors, all timePeople and anonymous contributors who have ever committed to the repository, as GitHub counts them. A small number is context, not a flaw: many solid projects are kept by one or two people.1, a small team
- Releases ReleasesThe number of GitHub releases, and how many days ago the latest one was published.2, latest release 24 days ago
- Releases in the last 90 days Releases in the last 90 daysHow many GitHub releases were published in the last 90 days.2
- Issues in the last 30 days Issues in the last 30 daysIssues opened and issues closed in the last 30 days, as GitHub search counts them.0 opened, 0 closed
- Pull requests merged in the last 30 days Pull requests merged in the last 30 daysPull requests merged in the last 30 days, as GitHub search counts them.1
- Packages that depend on the latest version Packages that depend on the latest versionHow many other packages list the project's latest published version as a dependency, from deps.dev, added up across npm and PyPI.0
Maintenance
- Stale open issues Stale open issuesOpen issues with no update in the last 90 days, as GitHub search counts them.0
- Open pull requests Open pull requestsPull requests open now, as GitHub search counts them.0
Hygiene
- Automated tests or builds (CI) Automated tests or builds (CI)Whether the repository has at least one GitHub Actions workflow file in .github/workflows.Yes
- A tests folder A tests folderWhether the repository has a top-level folder named tests, test, __tests__ or spec.Yes
- A license A licenseWhether GitHub detects a license file in the repository.Yes
- Contributing guide Contributing guideWhether the repository has a contributing guide.Yes
- Code of conduct Code of conductWhether GitHub finds a code of conduct in the repository.No
- CODEOWNERS file CODEOWNERS fileWhether the repository has a CODEOWNERS file, which names who reviews changes to which files.No
- A Dockerfile A DockerfileWhether the repository has a Dockerfile at its top level.Yes
Security
- Security policy Security policyWhether the repository has a SECURITY.md or SECURITY.rst file.Yes
- Unpatched high or critical advisories Unpatched high or critical advisoriesPublished GitHub security advisories rated high or critical on this repository that list a vulnerable version with no patched version.0
- Signed latest release Signed latest releaseWhether the latest GitHub release has an attached signature file (.sig, .asc or .sigstore).No
- Known advisories on the latest version Known advisories on the latest versionSecurity advisories deps.dev lists against the project's latest published version, added up across npm and PyPI.0
Badge
For maintainers: one measured fact, no verdict.
Markdown
[](https://midorreal.com/project/spinfinc-spinf-serve)
HTML
<a href="https://midorreal.com/project/spinfinc-spinf-serve"><img src="https://midorreal.com/badge/spinfinc-spinf-serve.svg" alt="Mid or Real"></a>
Verdict badge: It shows the verdict as this page shows it today.
Markdown
[](https://midorreal.com/project/spinfinc-spinf-serve)
HTML
<a href="https://midorreal.com/project/spinfinc-spinf-serve"><img src="https://midorreal.com/badge/spinfinc-spinf-serve.svg?style=verdict" alt="Mid or Real: OVERHYPED"></a>
First tracked 31 Oct 2026 at 19 stars.
- GitHub data 10 h old
- Hacker News data 15 d old
Is this your project? Claim it
Figures by method 1.0