Runtime as featured inForbesRead the article
DeepSeek V4.1 Flash specs
DeepSeek logo

How to run DeepSeek V4.1 Flash

Bedrock, Vertex AI, or your own GPUs · Checked November 21, 2026

DeepSeek V4.1 Flash has 552B parameters, so it needs about 1,325GB of GPU memory at full precision and about 663GB at FP8. A practical starting point is FP8 on 8x 141GB GPUs.

You have three ways to run it: a managed host that already serves it, your own GPUs in your cloud, or both behind one endpoint. Then you point your agents at it. Here is what each path takes.

DeepSeek V4.1 Flash hardware requirements

PrecisionMemory neededSmallest setup that fits
BF16 (full precision)~1,325GBMultiple 8x H200 nodes (about 2)
FP8~663GB8x 141GB GPUs (one H200 node)
4-bit quantized~332GB8x 80GB GPUs (one H100 node)

Our estimates: 552B parameters times bytes per parameter, plus 20% for the KV cache and the serving runtime. As a mixture-of-experts model, DeepSeek V4.1 Flash activates only 8B per token, which makes it fast, but every expert still has to sit in memory. Using the full 1M-token context needs more. Check the model card for the precision the weights ship in and any recommended settings.

Where to run DeepSeek V4.1 Flash

01Amazon Bedrock

Not confirmed as of November 21, 2026

We could not confirm DeepSeek V4.1 Flash in the Bedrock model catalog. To keep it in AWS anyway, serve it yourself on GPU instances in your account (EC2 or SageMaker) with the setup below, and check the Bedrock catalog again: new open models are added often.

02Google Cloud Vertex AI

Available

DeepSeek V4.1 Flash is available on Vertex AI as a managed API in Model Garden. You call it from your Google Cloud project, and Google runs the GPUs. Source

03Self-host on your own GPUs

vLLM and SGLang support confirmed

Download deepseek-ai/DeepSeek-V4.1-Flash-1017 from Hugging Face and serve it with an inference server that exposes an OpenAI-compatible endpoint. vLLM and SGLang support it. Start with FP8 on 8x 141GB GPUs (one H200 node), then load-test with your real prompts before you size for production.

  • Keep the endpoint private to your VPC, so prompts and payment data never leave your cloud.
  • Read the MIT license, which allows commercial use.
  • Run two replicas or keep a hosted model as a fallback, so agents keep working during an upgrade.

Run DeepSeek V4.1 Flash with Runtime

Serving the model is half the job. The other half is giving agents a safe place to use it. Runtime is the AI agent harness for payment and fintech teams, and it is model-neutral: connect DeepSeek V4.1 Flash from Bedrock, Vertex AI, or your own endpoint, and your agents use it next to Claude, GPT, or Gemini.

  • In your cloud. Runtime runs in your AWS, GCP, or Azure account or fully self-hosted, next to the model.
  • Routed by evals. Evals show which steps DeepSeek V4.1 Flash handles as well as a frontier model, so routine work moves to the cheaper model.
  • Fallbacks. If your endpoint is down or slow, agents fall back to another model instead of stopping.
  • Guardrails. Agents start read-only, wait for approval before money moves, and every run is recorded.

Harnesses that can drive DeepSeek V4.1 Flash on Runtime:

Claude CodeOpenCodeCline

Running DeepSeek V4.1 Flash: FAQ

How much GPU memory does DeepSeek V4.1 Flash need?

+

About 1325GB at BF16, 663GB at FP8, and 332GB at 4 bits. These are our estimates: the weights plus 20% headroom. Long contexts need more memory for the KV cache.

What is the cheapest way to self-host DeepSeek V4.1 Flash?

+

Start with FP8 on 8x 141GB GPUs (one H200 node). Quantizing further saves memory but can cost accuracy, so test it on your own tasks first.

Is DeepSeek V4.1 Flash available on Amazon Bedrock?

+

As of November 21, 2026, we could not confirm DeepSeek V4.1 Flash in the Bedrock model catalog. You can still run it in your AWS account on your own GPU instances (EC2 or SageMaker) with vLLM and SGLang.

Is DeepSeek V4.1 Flash available on Google Vertex AI?

+

Yes. DeepSeek V4.1 Flash is available on Vertex AI as a managed API in Model Garden.

Can I use DeepSeek V4.1 Flash with Runtime?

+

Yes. Runtime is model-neutral. Serve DeepSeek V4.1 Flash from Bedrock, Vertex AI, or your own endpoint, connect it to Runtime, and agents use it through a harness like Claude Code. Your data stays in your cloud, and evals tell you which steps it can take over from a more expensive model.