Runtime as featured inForbesRead the article

Kimi K3.1 Pro vs DeepSeek V4.1 Flash vs GLM-5.3: Which Open Model for Fintech Agents

Kimi K3.1 Pro, DeepSeek V4.1 Flash and GLM-5.3 compared for AI agents in payments and fintech: specs, licenses, reported benchmarks, cost at volume, and which to pick for each job.

Gus Trigos
Co-founder and CEO, Runtime
Updated November 11, 2026 · 6 min read

Short answer: for most fintech agents, start with DeepSeek V4.1 Flash. It is cheap to run, MIT licensed and reads images. Move the hardest, document-heavy cases to Kimi K3.1 Pro, the most capable open model in our list. Use GLM-5.3 when a run chains many tools and the inputs are plain text.

Three open-weight models now sit at the top of most rankings, and they were released within ten weeks of each other. Each one wins somewhere. The useful question for a payments team is not which model is best, but which model each job should run on.

This is a guide to choosing between them for agents in payment operations, risk and compliance. It uses the specs from our open source model comparison and the benchmark table Moonshot published with Kimi K3.1 Pro.

What it does. Puts the three models side by side, maps them to the jobs fintech agents do, and gives you a short method for testing them on your own cases.

What it is not. An independent benchmark. Every score here is reported by a model provider. The model you ship is the one that passes your evals.

The three models at a glance

Kimi K3.1 ProDeepSeek V4.1 FlashGLM-5.3
ProviderMoonshot AIDeepSeekZ.ai
Open weights sinceNovember 2, 2026October 17, 2026 (1017 checkpoint)August 25, 2026
Size2.8T total, 104B active552B total, 8B active753B total
Context1M tokens1M tokens1M tokens
InputText, imagesText, imagesText
LicenseKimi K3.1 Pro License (custom)MITGLM-5.3 License (custom)
In one lineMost capableBest overall valueBuilt for long tool-heavy runs

Active parameters drive cost. Each token in DeepSeek V4.1 Flash runs through 8B parameters; each token in Kimi K3.1 Pro runs through 104B. On your own hardware or a per-token API, that gap shows up directly in cost per run.

What the reported benchmarks say

Moonshot's model card collects scores for all three models in one table. Its footnotes combine Moonshot evaluations, other providers' reports, and external leaderboards, so this is a reported-score comparison, not a controlled like-for-like evaluation. Kimi K3.1 Pro's Terminal-Bench 4.0 and DeepSWE v1.1 results use the Claude Code harness.

Benchmark (higher is better)Kimi K3.1 ProDeepSeek V4.1 FlashGLM-5.3
Terminal-Bench 4.0 (agentic coding in a terminal)65.742.341.8
DeepSWE v1.1 (software engineering)75.577.066.9
Automation Bench-AA (business automation)73.366.662.2
GDPval-AA v2.1 (knowledge work, Elo)184617461650
OfficeQA Pro (questions over office documents)67.462.458.6

Source: the Kimi K3.1 Pro model card. Scores are provider-reported and not verified by Runtime.

Two things stand out. Kimi K3.1 Pro leads on long, multi-step work, and the gap is widest on Terminal-Bench, where an agent has to plan and recover across many commands. DeepSeek V4.1 Flash matches or beats it on plain coding while running a fraction of the parameters.

Which model for which job

JobStart withWhy
Transaction monitoring and alert triageDeepSeek V4.1 FlashHigh volume, short runs, cost per alert matters most
Payment reconciliationDeepSeek V4.1 FlashStrong on code and data work, MIT license
Chargebacks and dispute packetsKimi K3.1 ProReads receipts and screenshots, best at long document work
Partner-bank RFIsKimi K3.1 ProLong PDFs and scans, accuracy over cost
Merchant underwritingGLM-5.3 or Kimi K3.1 ProLong investigations across many tools and sources
KYC and KYBDeepSeek V4.1 FlashImage input, permissive license, cheap at onboarding volume

Most teams end up with two models: a cheap default for the queue and a stronger model for the cases that escalate. Routing by job beats picking one winner.

How to choose with your own cases

  1. Pull 30 to 50 resolved cases for one job, with the answer your team gave. Include the messy ones.
  2. Run each model on the same cases with the same skill and tools. Keep the harness fixed so you compare models, not prompts.
  3. Score against your answers, not against a benchmark. Track accuracy, steps taken and cost per run.
  4. Set the default and the escalation. The cheapest model that passes becomes the default; the strongest handles what it flags as low confidence.
  5. Rerun when a new model ships. This list changed three times in ten weeks.

A prompt that sets this up:

Run the 40 resolved chargeback cases in the evals folder on DeepSeek V4.1 Flash and Kimi K3.1 Pro with the current dispute skill. For each case, compare the packet to the one our analyst submitted and score it. Report accuracy, average steps and cost per run for each model, and list the cases where they disagree.

Say why, not just what: telling the agent the goal is choosing a default model makes it report the numbers you need for that decision.

What stays human

StepWhy
Choosing which cases go in the eval setIt encodes what "right" means for your team
Approving a model for productionLegal reviews the license, risk reviews the data path
Decisions that move money or answer a customerAn agent proposes, a person approves

The point

Open-weight models are now good enough that the choice is about fit, not quality. DeepSeek V4.1 Flash is the default for most queues, Kimi K3.1 Pro is the model for hard cases, and GLM-5.3 earns its place on long text-only runs. The ranking will change again; the eval set you build is what lets you switch in an afternoon.

Back to testing.

Run open models on your own cases

Bring one queue. We'll run it on open-weight and frontier models inside your own cloud and show accuracy and cost per run side by side.