MODEL RELEASE · 2026.07.15

Mira Murati’s First Open Model Activates Just 41 Billion Parameters per token

Thinking Machines Lab, founded by former OpenAI CTO Mira Murati, has released Inkling, its first large model trained in-house. It can read text, interpret images, listen to audio, write code, and use tools. Its full weights are available to download, and developers can continue training it on Tinker.

Sources: Thinking Machines Lab’s release post, model card, and Hugging Face weights repository

The One-Minute Overview

  • Thinking Machines Lab, founded by former OpenAI CTO Mira Murati, has released Inkling, its first general-purpose large model trained from scratch.
  • The full model weights are available for developers to download, deploy, and continue training. These models are often called “open-source models,” but “open-weight models” is more precise.
  • It can process text, images, and audio; write code; use tools; operate websites; and complete complex tasks that run for dozens of rounds. It outputs text only and does not generate images or speech directly.
  • It has 975 billion total parameters, but activates only about 41 billion for each token. Think of it as a company with many specialists that assigns only the best-suited teams to each job.
  • Developers can control how long it thinks: less for simple tasks and more for complex ones, trading output length for speed, cost, and accuracy.
  • Thinking Machines Lab also offers Tinker fine-tuning, a Playground, a Cookbook, and third-party deployment services, covering evaluation, continued training, and deployment.
  • It does not beat leading models across every capability, and running it yourself still requires at least about 600GB of GPU memory. Most users are better off using an online service.
Official Inkling release cover
Inkling is Thinking Machines Lab’s first open-weight model trained from scratch. Source: Thinking Machines Lab
BACKGROUND

A Year After Leaving OpenAI, Its Former CTO Unveils Her First In-House Model

Mira Murati served as OpenAI’s CTO before leaving in September 2024 and founding Thinking Machines Lab in 2025. The company recruited several researchers from OpenAI and focused on making models easier for businesses and developers to understand, modify, and train.

Thinking Machines Lab’s first product was Tinker, a model fine-tuning platform. Developers provide their data and scoring methods, and Tinker fine-tunes open-weight models. At the time, Thinking Machines Lab did not yet have a foundation model of its own.

On July 15, 2026, the company released Inkling, its first publicly available general-purpose large model trained from scratch. The full weights are on Hugging Face under the Apache 2.0 license, with direct Tinker integration. The company now has both its own model and its own training platform.

So What Exactly Is Inkling?

In short, Inkling is a multimodal foundation model that can be downloaded, deployed, and trained further. It accepts text, images, and audio, and can write code, use tools, and operate websites. It is not a standalone chat app for consumers. It is more like a general-purpose engine that developers can build into coding assistants, customer service systems, research tools, web agents, or internal enterprise software.

Why Not Simply Call It “Fully Open Source”?

When a large model finishes training, it leaves behind a vast set of numbers that determine how it responds. These are the model weights. Inkling’s full weights are on Hugging Face under the Apache 2.0 license, so developers can download, deploy, and modify them. But the team has not released all of the training data, training code, or training process. People may casually call it an “open-source model,” but “open-weight model” is the more accurate technical term.

How Is It Different from a Typical Open Model?

Many open-weight releases focus on the weight files. Inkling was integrated with Tinker from day one. Developers can test the model in the Playground, send their own data, scoring rules, and training jobs to Tinker, produce a version better suited to their business, and then download it or deploy it through a third-party service.

Downloading the Weights Alone

You still need to prepare training code, data formats, evaluations, GPU clusters, and deployment tools. The engineering barrier remains high.

Inkling Plus Tinker

Testing, data preparation, continued training, evaluation, and deployment can follow one connected workflow, with far less infrastructure to build.

KEY FEATURES

What Can Inkling Actually Do?

Start with the overall picture. The official release compares Inkling with four representative models across ten evaluations. The thick blue line is Inkling: it does not dominate every rival on any single axis, but it has no obvious gaps across coding, tool use, vision, audio, factuality, and instruction following. That is exactly the profile of a general-purpose foundation that developers can continue training.

Official radar chart comparing Inkling with Nemotron, GLM, GPT, and Claude across ten evaluations
Official capability radar chart. Scores from different evaluations are normalized to 0–100; missing public results are plotted as 0. It is therefore useful for seeing the breadth of capability, not for declaring the model with the largest area the strongest. Source: Thinking Machines Lab

1. Scale: 975 Billion Parameters, Plus a Faster Small Version

Original Inkling has 975 billion total parameters and uses a mixture-of-experts architecture. It activates only about 41 billion parameters for each token and supports up to 1 million tokens of context. These are tokens, not characters; Tinker currently offers practical context tiers of 64K and 256K.

Inkling-Small preview has 276 billion total parameters and activates about 12 billion per token. With upgraded pretraining data and training methods, it approaches or even surpasses the original on many tests while running faster and costing less. It is not equally strong on every test, however, and the full Small weights have not been released.

Inkling

Released · Full weights available
975 billiontotal parameters

41 billion parameters active per token
Maximum context: 1 million tokens

Inkling-Small

Preview · Weights not yet released
276 billiontotal parameters

12 billion parameters active per token
Designed for lower latency and cost

Think of the mixture of experts as a company with 256 specialist teams. For each token, it selects the 6 best-suited teams and adds 2 permanent teams. This lets the model be very large without running every parameter for each computation.
Diagram showing Inkling using only a few experts per token A token enters the router, which selects 6 of 256 experts and adds 2 shared experts to complete the computation. One tokenenters model RouterSelects best6 experts 256 experts · 24 shown 6 active / token Plus 2sharedexperts
The blue dots represent the 6 experts selected this time. The others remain in the model but do not participate in processing this token.

2. Controllable Reasoning: Developers Choose the Depth

Many reasoning models decide for themselves how long to think. Even simple tasks can produce lengthy internal reasoning, increasing wait times and cost. Inkling gives developers that choice. The release page shows reasoning effort from 0.2 to 0.99: lower values produce faster answers and use fewer tokens, while higher values give the model more time for math, code, and multistep tasks.

For organization, classification, and simple Q&AShorter reasoning, prioritizing speed and cost.
For writing, research analysis, and routine codingA middle ground between response speed and reasoning depth.
For math, complex code, and multistep tasksLets the model use more output tokens to complete its reasoning.
On the Terminal Bench 2.1 coding test, Inkling used about one-third as many output tokens on average while achieving a score close to Nemotron 3 Ultra. This result comes from the release team and still needs independent replication.
Official curves showing the relationship among Inkling reasoning effort, output token count, and scores on three evaluations
The blue line traces Inkling's results as reasoning effort increases from low to high. The horizontal axis is the average number of generated tokens and the vertical axis is the score. Together, the three charts show that more reasoning usually improves performance, but gains diminish at the high end and the best setting varies by task. Source: Thinking Machines Lab

3. Native Multimodality: Vision and Audio from the Start

Inkling’s vision and audio components were trained from scratch. Audio is converted into spectrograms the model can read, while images are split into 40×40-pixel patches. After lightweight conversion, they enter the same model alongside text; there is no need to transcribe everything into text first.

Text
Image patches
Audio spectrogram
Inkling joint reasoningProcesses text, vision, and audio together
Text output
or tool call

Audio: It can transcribe speech, follow spoken instructions, answer questions about recordings, and analyze longer audio.

Vision: It can interpret charts, formulas, and mathematical diagrams. When details matter, it can also use Python to zoom in or crop an image.

Capability boundary: Inkling accepts text, images, and audio, but still outputs text. It does not directly generate images or speech.

4. Getting Work Done: Less Guessing, More Follow-Through

Less guessing when uncertain: The training team designed a reward that allows the model to abstain. On short-answer questions it scores only for correct answers; when uncertain, saying “I don’t know” or qualifying its judgment is more rewarding. A separate grader searches the web to check facts in its answers. This can reduce confident fabrication, but it cannot guarantee the model will never make mistakes.

Practical skills: It was trained to write code, run programs, read and write files, and operate websites. The team uses complete tasks to demonstrate whether it can keep working through to completion.

Build a Job-Application Page, Then Fill In the Form

Inkling first generates a job-application webpage from a single request, including the role description, contact details, and reasons for applying. An embedded automation then reads the user’s saved profile and completes the form. The demo combines coding, interface generation, and browser operation.

Inkling generates a job-application webpage in one pass, then follows natural-language instructions to operate the page and fill in the form. Source: Thinking Machines Lab

Revise a Multiplayer Game Through 40 Rounds of Review

Another task was to build a multiplayer Snake game. The requirements covered server-authoritative game state, human and bot players together, collision rules, a leaderboard, tests, and startup instructions. Inkling built an initial version, then revised it through 40 rounds of GPT Codex review. The example demonstrates long-horizon task performance: the model can preserve context, take criticism, rerun tests, and keep correcting its work.

A multiplayer Snake game refined through 40 rounds of review. Source: Thinking Machines Lab
Official chart of Inkling's ranking on the Design Arena Agentic Web Dev leaderboard
Design Arena ranks generated webpages through anonymous head-to-head human comparisons. Inkling scored 1257, close to Claude Opus 4.6 but below leading closed models including Claude Sonnet 5 and Claude Fable 5. The result shows that Inkling is competitive at web generation, while also warning against describing it as the overall leader. Source: Thinking Machines Lab

Create a 9-Page Travel Magazine

The model searches for breakfast information and images from six cities, then assembles a consistently styled PDF with a cover, city features, a comparison spread, and references.

Use Tinker to Complete a Fine-Tuning Run

The model writes training code, prepares data, defines scoring rules, calls Tinker for training, and then has the outer program switch to the new model weights.

Cover of the nine-page breakfast travel magazine generated by Inkling
Cover of Breakfast Around the World, a nine-page travel magazine generated by Inkling. Click the image to open the original official PDF and inspect the complete layout, six city features, comparison spread, and references. Source: Thinking Machines Lab
Open the 9-page PDF generated by InklingBreakfast Around the World, the original output, about 10MB

The fine-tuning demo has a specific goal: make all future English answers avoid the letter e. The model first writes a scoring function that gives 0 points if e appears and 10 points if it does not. It then generates training data and configuration, and uses Tinker to complete 32 batches over 3 epochs, for 96 training steps in total.

Set the GoalFuture answers must not contain e
Write the Scoring Rule0 points with e; 10 without
Prepare TrainingGenerate data, code, and configuration
Train on Tinker32 batches × 3 epochs, 96 steps
Load the New VersionSwitch weights after about 27 minutes
Official OpenCode demo after Inkling completes self-fine-tuning and switches to the new weights
The final step of the official interactive demo: Inkling has completed training, loaded the new checkpoint, and verified the result by answering in English without the letter e. The full process also includes writing the objective function, generating data, running and evaluating 96 training steps; the model is not secretly modifying itself in the background. Source: Thinking Machines Lab
The fine-tuning demo requires a person to set the goal and an outer program to load the new weights. It shows that the model can operate training tools, not that it can endlessly rewrite itself without supervision.
TECHNICAL NOTES

Technical Choices and Surprising Findings

Learning to Say Less: Internal Reasoning Turns Telegraphic

Inkling’s pretraining data contains text, images, audio, and video, totaling 45 trillion tokens. Post-training included more than 30 million reinforcement-learning task attempts. One attempt means the model completes a task, receives a score, and improves based on the result.

Official reward curve from supervised-fine-tuning initialization through more than 30 million Inkling reinforcement-learning rollouts
The horizontal axis is the number of reinforcement-learning rollouts; the vertical axis is aggregate reward on held-out reasoning evaluations. The released checkpoint rises from 0.264 at supervised-fine-tuning initialization to 0.356 and continues approximately logarithmic growth beyond 30 million rollouts. This is the publisher's internal evaluation, not an absolute accuracy measure for user scenarios. Source: Thinking Machines Lab

The training team found that the model’s internal reasoning automatically grew shorter as reinforcement learning continued. Early on, sentences were complete and used many connecting words. Later, the model dropped articles, prepositions, and some grammar, producing telegraphic fragments while reaching the same final answer. This behavior was not written into the reward objective; the model learned it under pressure to reduce token cost.

Early Reinforcement Learning

“We need to understand this operator. This five-dimensional line element is…”

Complete sentences, but longer internal reasoning.

Late Reinforcement Learning

“Need determine eigenvalue problem… internal metric is…”

Drops connecting words but keeps the reasoning skeleton.

Official comparison of Inkling's internal reasoning text early and late in reinforcement learning
Internal reasoning on the same problem early and late in training. The later version on the right drops more articles and connective words, yet preserves the computational skeleton and reaches the same answer. This is the original visual evidence for “telegraphic reasoning.” Source: Thinking Machines Lab
Every internal reasoning token the model generates consumes compute. A shorter reasoning path means fewer token for the same problem. The final answer is still properly written; users do not receive the telegraphic fragments directly.
45 trillionpretraining tokens
30 million+reinforcement-learning task attempts
66 layersdecoder depth
5∶1local-to-global attention

Replacing Mainstream RoPE with Relative Position Encoding

Many large models use RoPE, or rotary position encoding, to help remember where content appears in a long document. Inkling instead uses relative position encoding, focusing more on the distance between two pieces of content. Its attention layers also alternate at a 5∶1 ratio: five consecutive layers look at nearby information, then the next considers the full context.

Common Approach: Record Content Positions

The model adds positional information to each segment. When text runs far beyond the training range, changes in position may affect stability.

Inkling: Record the Distance Between Content

The model focuses more on how far apart two segments are. In the release team’s tests, it was more stable on long sequences beyond the training length.

HOW TO USE IT

How Can You Use It?

To try it now: Open the Inkling Playground on Tinker, currently free for a limited time.

To fine-tune or build on it: The full weights are on Hugging Face, along with an NVFP4 quantized version for NVIDIA Blackwell GPUs. To continue training with your own data, use Tinker and the official Cookbook.

🧰 Inkling Access Points
Continue TrainingTinker Cookbook
LicenseApache 2.0

Downloadable Does Not Mean It Runs on an Ordinary Computer

The full weights on Hugging Face occupy about 1.9TB. The BF16 version requires at least about 2TB of aggregate GPU memory, while the NVFP4 quantized version still needs at least about 600GB. Most developers are better served by the Playground, a third-party API, or Tinker. Self-hosting is a data-center-scale job.

Expand: Main Benchmark Scores and Testing Methods

Inkling posts results across coding, tool use, vision, audio, knowledge Q&A, and safety tests. Its capabilities are broad, but it does not comprehensively outperform the leading open or closed models.

HLE + Tools
46.0%
SWE-Bench Verified
77.6%
MCP Atlas
74.1%
MMMU Pro
73.5%
VoiceBench
91.4%
FORTRESS Adversarial
78.0%

These tests measure different abilities, so their scores do not indicate comparable difficulty. Results are reported at the maximum reasoning effort of 0.99, and tool environments also affect coding tests. Forecasting, audio, and some vision results use the team’s internal testing and still need independent replication.

The model card also lists a safety gap: harmful requests framed through role-play or indirect wording can occasionally bypass refusal behavior. Public deployments still need content filtering, rate limits, and monitoring.

RELATED ON THIS SITE
Bridgewater Trained a Model to Screen Financial Information at 84.7% Accuracy—and Published the Method
This case shows Tinker in practice: turn expert judgment into training data and scoring rules, then produce a specialized model.
Inkling brings four things together in one release: multimodal input, adjustable reasoning effort, open weights, and Tinker fine-tuning. Developers can try it directly or continue training their own version. Its limitations are equally clear: it does not lead the top models across the board, and self-hosting still requires at least about 600GB of GPU memory.