A 16,000-token prompt in vLLM
Same model, same NVIDIA H100, same server software. Time until the first word of the answer.
What would you save each month?
Pick your fleet and your traffic. The biggest savings come from long inputs: documents, search and retrieval, coding agents and long conversations.
Modeled from measured test results at full-month utilisation. Your own savings are measured on your traffic before you pay anything.
Two packs. One install.
Each pack is built and tested for a specific model and licensed for your whole fleet. The first supported model is Qwen3.8-27B; more models follow.
Nested Run
The core upgrade. Your model reads faster and costs less, and an exact mode returns the original answers on demand.
- Long-prompt readingup to 1.46× faster
- Inside vLLM, same GPU1.3× faster
- Follow-up questionsup to 74% cheaper
- Longest prompts per GPU128k on 80 GB
- Embedding memory73% smaller
- Exact modeoriginal answers
Nested Run+
Everything in Nested Run, plus the add-ons that speed up the whole request, answers included.
- Whole request (prompt + answer)up to 2.2× faster
- Answer writing with compact weights1.3× faster
- Model memory~45% smaller
- Shorter reasoning, more right answers18% fewer tokens
- Edits and copy-heavy answersup to 2.1× faster
- Repeated questions81% cheaper
More upgrades are in the lab and will be added here as their tests complete.
Your servers or ours
Install it in your stack
A ready container and a vLLM add-on for your own GPUs, in your cloud or data center. Your data never leaves your servers.
Use our endpoint
Point your application at a hosted, OpenAI-compatible endpoint and start saving without touching your servers.
What your team will ask first
Exact mode
Flip one switch and get the original model's answers, word for word.
Your data stays put
Runs inside your environment. Nothing is sent to us.
No retraining
Your model is not retrained from scratch. A short calibration is included.
Measured on your traffic
Paired tests on your own requests, with the numbers in a report you keep.
Proof first. Then you pay.
Free first month
We run the upgrade beside your current setup on your real traffic for a month, at no cost, and show you the difference.
Install
A ready container for your servers, or a hosted endpoint. No retraining your model from scratch.
Save
A monthly savings report. License it, or share the savings with us: you choose.
Frequently asked
Will my model give different answers?
Exact mode returns the original model's answers word for word. In fast mode, answers stay close to the original, and we measure that on your own traffic before you decide.
Which models are supported?
The first pack is for Qwen3.8-27B. Packs for more model families are in testing. Tell us what you serve and we'll tell you where it stands.
Does it work with vLLM?
Yes. In our tests inside vLLM on an H100, a 16,000-token prompt was ready 1.3× faster, and exact mode matched normal vLLM on every test prompt.
Where do the biggest savings come from?
Long inputs: documents, retrieval, coding agents and long conversations. Short chat saves less. The calculator above shows both.
How is it priced?
Either a license, or a share of the savings we measure. You choose after the pilot.
Is there a free trial?
Yes. Your first month is free, at no cost. We measure side by side on your traffic and give you a written savings report. See the proof for yourself.
The people behind Dynamic Beads
Benny Goldstein
Benny leads Dynamic Beads. A lawyer by training (LLB, LLM) specialising in patents and contract law, with years of investor relations and capital raising.
Eytan Goldstein
Eytan invented Nested Run, the method behind every Dynamic Beads product. Patent pending.
Steve Marks
Steve leads customer and business relations. He brings many years of experience building lasting client partnerships, and is part of the team that created Dynamic Beads.
Technical notes
Per-word depth beats a uniform cut
At the same amount of work, giving each word its own depth beat cutting every word at the same layer (the SwiftKV-style approach) by about 10 points of agreement with the original model on average, 25 points on chat and 22 points on sums. Measured on Qwen3.8-27B with our own matched-work reimplementation of uniform layer skipping.
See your savings on your own traffic
Tell us what you serve. Get a free month at no cost and see the proof for yourself.