--- title: "Open replicas: servers and logit readers over other models" type: community source_tier: community tags: [community, replicas, open-models, local-serving] created: 2026-09-25 updated: 2026-09-25 confidence: medium sources: - raw/x-repos/logan-markewich__jeff.md - raw/x-repos/logan-markewich__jeff__bench-results.md - raw/x-repos/githubnext__localjev.md - raw/x-repos/githubnext__localjev__eval-reports-2026-09-18-bakeoff-report.md - raw/x-repos/razorback16__openjev.md - raw/x-repos/9pings__notjev.md - raw/x-repos/9pings__notjev__docs-measurements.md - raw/x-repos/fidecastro__jevify.md - raw/x-repos/chengyongru__fastjev.md - raw/x-repos/chengyongru__fastjev__docs-results.md - raw/x-repos/TheoLeeCJ__SemIf.md - raw/x-repos/deepanwadhwa__OpenDecision.md - raw/x-repos/ikermoel__open-alternative-jev.md - raw/x-repos/ikermoel__open-alternative-jev__benchmarks-docs-results.md - raw/x-repos/NotXf1le__choosekit.md - raw/x-repos/NotXf1le__choosekit__benchmarks-supergpqa-benchmark-json.md - raw/x-repos/zhangcy122__OpenJev.md - raw/x-repos/zhangcy122__OpenJev__examples-benchmark-results-json.md - raw/x-repos/Rizzo-AI-Academy__rizzo-flow.md - raw/x-repos/Rizzo-AI-Academy__rizzo-flow__results-readme.md - raw/x-repos/taeold__djev-run.md - raw/x-repos/emnlmn__snap.md - raw/x-repos/yoheinakajima__glance.md - raw/x-repos/yoheinakajima__glance__site-vslaya-index-html.md - raw/x-repos/HITsz-TMG__JevEmbed.md - raw/x-repos/HITsz-TMG__JevEmbed__reports-jevbench-public.md - raw/x-repos/HITsz-TMG__JevEmbed__reports-jevembed-data-test.md - raw/x-repos/nokia-applied-research__AnyJev.md - raw/x-repos/featherless-ai__simple-jev.md - raw/x-repos/yijunyu__jev-rs.md - raw/x-repos/ziozzang__hearim.md - raw/x/theanandprasad-2102199067057307900.md - raw/x-repos/fstandhartinger__jevbench__results-v1-4-2.md - raw/community/huggingface-co-datasets-localllama-typed-decisions.md - docs/sweep/2026-09-25-mrjev/parta.md - docs/sweep/2026-09-25-mrjev/partc.md jev_version: "jev-1.13.0" summary: "Servers and readers that put Jev's /v1/systemone shape over someone else's model (logits, NLI, embeddings, prompted probabilities); none is Jev. Split from ideas/open-replicas 2026-09-25." --- # Open replicas: servers and logit readers over other models > **TL;DR** None of these is TypeSafe or runs Jev. Each wraps a model it did not train (a stock LLM read by option-letter logits or logprobs, an NLI or embedding model, a diffusion LM, or an LLM asked to write probabilities) behind Jev's request shape or something close to it, and each computes `confidence` its own way, so thresholds tuned on Jev do not transfer. Several answer to `jev-latest`: check the response `model`. Read the Warnings on [[ideas/warnings]] first (key routing, look-alikes, install names); models with their own weights, the Laya family, the which-is-which table and the replicas' own negatives are there too. Split from [[ideas/open-replicas]] on 2026-09-25 (nothing dropped). Numbers are each author's unless marked. ★ · push as captured 2026-09-23 to 25. Pattern IDs: [[ideas/patterns]]. "Our check" = our 2026-09-25 source and registry vetting (docs/sweep record), not a raw capture. JevBench ranks are by version ([[ideas/eval-boards]]). ## Servers and readers | Tool (owner) | What | Install | ★ · push | Their numbers and caveats | |---|---|---|---|---| | [jeff](https://github.com/logan-markewich/jeff) (Logan Markewich) | `/v1/systemone` over GLiFormer (knowledgator, 400M); accepts `jev-latest`; 529 on a full queue, 429 with `retry-after-ms` | clone | 246 · 2026-09-20 · MIT | **Jev run live**: Jev far ahead on accuracy, jeff cheaper and slower under load ([[ideas/eval-boards]]). JevBench v1.2.2: jeff 66.9 (#9 of 18), below Jev (board row and hard tier on [[ideas/eval-boards]]). v1.4.2: #40, 30.58. Self-run hard items: Jev lost the temporal and numeric items (matches [[concepts/jaggedness-jev-1-13]]) and led the ambiguous ones ([[ideas/eval-boards]]) | | [localjev](https://github.com/githubnext/localjev) (GitHub Next) | Bun bridge: any OpenAI-compatible local model writes probabilities as JSON (self-reported, not logits); accepts `jev-latest`, `jev-preview`; 529 above 64 queued | clone | 775 · 2026-09-18 · MIT | M5 Max bake-off, 120 items: short-input macro Qwen3.6-35B-A3B 76.7%. **2,048 unrelated words lowered every model's macro accuracy** (Qwen 76.7% → 69.2%; Gemma E4B SST-5 50.0% → 12.5%). Evidence that prompted-probability replicas degrade under irrelevant state. Answers as `localjev-0.2` (only the response `model` tells); the authors say to check calibration yourself; no Jev comparison | | [OpenJev](https://github.com/razorback16/openjev) (razorback16) | DiffusionGemma 26B-A4B via patched vLLM or MLX, read as a diffusion canvas; also serves Laya and Verdict; extensions incl. images; accepts `jev-latest` | clone; hosted free on Codiv (100M input tokens) | 421 · 2026-09-24 · Apache-2.0 | Author, one GPU: p50 27 ms (1 question), 31 ms (3); 57.4 req/s at concurrency 64 (p95 1,109 ms). JevBench v1.4.2 #27 (36.85; thinking mode #68). **Codiv key routing: [[ideas/warnings]] (c)** | | [NotJev](https://github.com/9pings/notjev) (Nathanael Braun) | letters the options, asks any logprob endpoint for one token (26 options max); abstains below `theta` | `npm i notjev` | 21 · 2026-09-22 · Apache-2.0 | Author: Qwen3-8B Q4 p50 23 ms; 27B NVFP4 on vLLM 101 ms; its one-token readout agrees 0.947 with the same model generating under a grammar (n = 1,224; majority-class null 0.693). Its "hosted Jev 419 ms" has no source in the repo. In `serve` mode one key is both upstream bearer and caller guard | | [jevify](https://github.com/fidecastro/jevify) (Felipe Infante de Castro) | any LLM as a Jev-like endpoint: hashed YAML recipe, state sent once, logprob ladder; endpoint, embedding, NLI or rerank backends | `uv tool install jevify` (PyPI) | 43 · 2026-09-23 · MIT | Unmodified `typesafe-sdk` works against it (author). policy-hard-52: DeepSeek-V4-Flash 47/52, Gemma 4 E4B 45/52. No Jev comparison | | [fastjev](https://github.com/chengyongru/fastjev) (chengyongru) | SDK-first SemIf fork: Torch, vLLM, MLX, llama.cpp GGUF, EXL3; 2–16 options; rejects `jev-latest` | `pip install 'fastjev[torch]'` (npm `fastjev` is unrelated) | 21 · 2026-09-24 · MIT | RTX 5090: vLLM batched 36.26 vs Torch 18.52 decisions/s. Jev side copied (SemIf's 0.845 vs Jev 0.883 on 102 rows; count once). Headline says "open source implementation" while its results say Jev is not reproduced | | [OpenDecision](https://github.com/deepanwadhwa/OpenDecision) (Deepan Wadhwa) | zero-shot NLI (ModernBERT-large) behind the Jev shape, plus retrieval | `pip install OpenDecision` (Python ≥ 3.13) | 57 · 2026-09-21 · Apache-2.0 | Treat scores as uncalibrated (README). JevBench v1.4.2 #56, 21.64. P24 | | [open-alternative-jev](https://github.com/ikermoel/open-alternative-jev) (Iker Moel Tacher) | in-process library: all questions about one state in one pass, option-letter logits; not SDK-compatible | clone (the PyPI name in its README does not exist) | 54 · 2026-09-25 · Apache-2.0 | Stock Qwen3.6-27B 8-bit on typed-decisions: 73.7% / ECE 0.020, above Jev's card figures (copied; gold is teacher agreement: [[ideas/eval-boards]]). **Reversing options moved 4B yes/no accuracy 13.5 pts**; packing hurts below ~4B. v1.4.2 #36. P01 | | [choosekit](https://github.com/NotXf1le/choosekit) (Felix Koba) | TS: option-label logprobs from llama.cpp, Ollama or OpenRouter, with images; `choosekit-mcp` | `npm i choosekit` | 23 · 2026-09-24 · Apache-2.0 | **Jev run live** (OpenRouter) on SuperGPQA: second to Kimi K3 at a small fraction of its cost ([[ideas/head-to-head-benchmarks]]); graduate knowledge questions are a poor fit ([[concepts/jaggedness-jev-1-13]]). SemIf authored set: tie with a local Qwen model ([[ideas/eval-boards]]) | | [OpenJevPro](https://github.com/zhangcy122/OpenJev) (Corel Zhang) | letter-logprob scoring on Ollama or OpenAI-compatible models; "guard" wrapper around Jev | `pip install openjevpro` | 30 · 2026-09-25 · **PolyForm Noncommercial** + paid licence | Author's Banking77 slices: Jev tied the open models answering directly and beat OpenJevPro's own harness; its README's Jev latency claim contradicts its own measurements, and its cost and SLA claims are unmeasured. Tiny samples; numbers on [[ideas/head-to-head-benchmarks]] | | [rizzo-flow](https://github.com/Rizzo-AI-Academy/rizzo-flow) (Simone Rizzo) | option-letter logits from one shared prefill; adds `numeric` and an "insufficient evidence" option | clone | 459 · 2026-09-25 · Apache-2.0 | Author (RTX 5060 Ti): SemIf authored144 0.812 vs SemIf 0.819; p50 49 ms. **6 of 36 confident wrong answers when evidence is missing.** "No Jev labels": `unverified` | | [djev-run](https://github.com/taeold/djev-run) (Daniel Lee) | Cloud Run deployment of mmastrac/djev on DiffusionGemma | ghcr.io image | 551 · 2026-09-24 · no licence | Author: $3.19/h on one RTX PRO 6000, scales to zero; cold start ~47.5 s; 117 ms median. Its "JevBench 73.4" is self-run, not an official row. Answer shape differs from the docs (1-indexed Score probabilities, no `type` field; our check) | | [SNAP](https://github.com/emnlmn/snap) (Emanuele Menon) | Rust over vendored llama.cpp; adds `numeric`, `allow_abstain`, and a `confidence` on Noul (Jev has none) | build | 21 · 2026-09-25 · no licence file | Author: Qwen3.8-4B agrees 73.2% with frontier-consensus labels over 373 TypeSafe public decisions; **option-order reversal flips a third of MiniCPM's choices**; 51 ms vs Ollama 149 ms. Binary `snap` shadows Ubuntu's | | [Glance](https://github.com/yoheinakajima/glance) (Yohei Nakajima) | logits from a frozen Qwen3-VL-4B for image decisions; `/v1/decide` | `pip install glance-vlm` | 23 · 2026-09-24 · Apache-2.0 | Pre-registered fresh photos: yes/no 0.939 (541) vs Gemini 3.1 Flash-Lite 0.961; exact rating on five synthetic 4-level scales (1,000 images) 0.669 vs 0.763. **vs Laya Vision on an M5: 0.886 vs 0.689** (0.747 without Laya's Pets37 collapse; Laya faster) ([page](https://github.com/yoheinakajima/glance/blob/d458a27654ad9258977526395547c51e632fa5cd/site/vslaya/index.html)). P34 | | [JevEmbed](https://github.com/HITsz-TMG/JevEmbed) (HIT Shenzhen) | any embedding model → Choice/Score/Noul by cosine and temperature; normalised-entropy confidence | clone | 26 · 2026-09-25 · Apache-2.0 | Author, JevBench public 231: best Qwen3-Embedding-8B 58.44%; that report was **deleted from the default branch on 2026-09-25** (captured from commit 9cb60bb). Dataset licences mixed, incl. CC-BY-NC; distillation note: [[ideas/warnings]] (b). P17 | | [AnyJev](https://github.com/nokia-applied-research/AnyJev) (Nokia Applied Research) | any HF LLM, debiased, optional head on 100–300 labels | `pip install "anyjev[hf]"` | 267 · 2026-09-23 · Apache-2.0 | order flips 0.230 → 0.073 (Qwen3-8B) | | [Simple Jev](https://github.com/featherless-ai/simple-jev) (Eugene Cheah) | logits server, free demo API | pip from repo | 491 · 2026-09-21 · Apache-2.0 | own contract. typed-decisions card: `Qwen3.6-35B-A3B-classifier` 0.716 (Jev's figure: [[ideas/eval-boards]]). JevBench v1.4.2: Qwen3.8-27B #32, Qwen3.6-35B-A3B #52 | | [jev-rs](https://github.com/yijunyu/jev-rs) (Yijun Yu) | Rust over llama-server; serve, MCP, eval | README's first command is `curl -fsSL …/install.sh \| sh` (read the script first; prebuilt binary, else a cargo build), then `cargo install jev-rs` with a Rust toolchain | 5 · 2026-09-22 · Apache-2.0 | SDKs reach it via `TYPESAFE_BASE_URL` | | [hearim](https://github.com/ziozzang/hearim) (ziozzang) | Go gateway over Ollama, vLLM, SGLang | `go build` | 5 · 2026-09-22 · NOASSERTION | entropy-based `confidence` | | Recipe ([@theanandprasad](https://x.com/theanandprasad/status/2102199067057307900)) | softmax over yes/no logits | — | post 2026-09-22 | 21/22 on Llama 3.3 70B; raw logits flip with option order (AnyJev) | Before swapping one in, test option order, irrelevant state, missing evidence and general judgement on your own labels: "What the replicas' own negatives say" on [[ideas/open-replicas]] and [[guides/testing-and-evaluation]]. ## Related - [[ideas/warnings]] — the Warnings block; [[ideas/open-replicas]] — which-is-which, models with their own weights, Laya and its servers, trust notes and the build decision - [[ideas/eval-boards]] — JevBench by version; [[ideas/head-to-head-benchmarks]] — public datasets - [[ideas/sdks-and-replicas]] — community SDKs and libraries that call the real Jev - [[concepts/confidence]] — Jev's own `confidence`, which these servers do not reproduce; [[reference/environment-variables]] — `TYPESAFE_BASE_URL` ## Sources Links inline; raw captures (2026-09-23 to 25) in frontmatter. "Our check" items come from the 2026-09-25 vetting record (docs/sweep/2026-09-25-mrjev), not raw captures.