TL;DR
Thinking Machines has publicly released its first foundation model, Inkling, an open-weight, multimodal transformer with 975 billion parameters. The release emphasizes transparency and open licensing, but some restrictions may apply via a separate use policy. The model’s capabilities and limitations are now being scrutinized.
Thinking Machines has released its first foundation model, Inkling, a 975-billion-parameter, multimodal transformer, under the Apache 2.0 license. This marks a notable departure from typical proprietary releases, emphasizing open access and transparency in AI development. The full weights are now available on Hugging Face, enabling independent testing and deployment.
Inkling is a Mixture-of-Experts transformer supporting a 1-million-token context window, trained on 45 trillion tokens across text, images, audio, and video. It features a native multimodal input system, processing text, images, and audio jointly without external adapters. The model was trained with a hybrid optimizer on NVIDIA systems and underwent over 30 million reinforcement learning rollouts, with reasoning performance improving log-linearly during training.
While the weights are openly available, the training data and pipeline are not published, which is typical in industry but limits full reproducibility. Additionally, reports suggest that Thinking Machines maintains a separate Model Acceptable Use Policy (AUP) restricting surveillance, deception, and automated decision-making affecting individuals, raising questions about the true openness of the model’s use and licensing.
In benchmark testing, Inkling demonstrates strong performance in speech and safety benchmarks but shows middling results in pure language understanding tasks. The company explicitly states the model is not the strongest available today, prioritizing transparency and open access over raw performance.
Implications of Open-Source, Multimodal AI Release
The release of Inkling under an open license is a significant development in AI, enabling wider access, customization, and scrutiny of powerful foundation models. It challenges the norm of proprietary models by offering full weights and emphasizing transparency. However, the potential restrictions imposed by a separate use policy complicate the narrative, raising questions about the true openness and ethical use of the model. This move could influence industry standards and accelerate open AI research, but also underscores the importance of understanding licensing and usage restrictions.
LAFVIN ESP32-S3 1.69" LCD Development Board with Camera, AI Vision Voice Development Kit, Programmable IoT Board with Mic Speaker for STEM Education
- Powerful Microcontroller: ESP32-S3 with 16MB Flash and 8MB PSRAM
- AI Vision & Voice Capabilities: Camera and audio for AI interactions
- Supports OpenCV & YOLO: Face tracking and human pose estimation
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Background on AI Model Releases and Industry Norms
Over recent years, most large AI models have been released as closed-source or with restricted access, limiting external validation and customization. The recent trend has been toward proprietary API-based models, with full weights often withheld. Open releases like Meta’s Llama 2 and EleutherAI’s models have aimed to democratize access, but often with licensing restrictions or incomplete transparency. Thinking Machines’ release of Inkling marks a notable shift, emphasizing full weight release under Apache 2.0, but with some caveats regarding usage policies. The model’s multimodal capabilities and scale position it among the most advanced open models to date.
“Thinking Machines’ release of Inkling is a milestone in transparency, offering open weights but with notable restrictions via a separate use policy.”
— Thorsten Meyer, Source
AI Systems Performance Engineering: Optimizing Model Training and Inference Workloads with GPUs, CUDA, and PyTorch
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Remaining Questions About Inkling’s Use Restrictions
It is not yet confirmed how enforceable the separate Model Acceptable Use Policy is, or how it might impact commercial or research applications. The exact scope of restrictions and whether they could limit certain types of deployment remains unclear. Additionally, the transparency of the training data and pipeline has not been disclosed, leaving questions about reproducibility and bias unaddressed.
As an affiliate, we earn on qualifying purchases.
Next Steps for Testing and Adoption of Inkling
Independent researchers and organizations will likely begin testing Inkling’s capabilities and limitations, focusing on benchmarks, safety, and ethical use. The full release of weights for the smaller Inkling-Small model is expected soon, providing additional avenues for evaluation. Monitoring how the separate use policy is enforced and how the community responds will be critical in assessing the model’s impact on open AI development.
large scale AI model deployment tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Key Questions
What makes Inkling different from other open models?
Inkling is notable for its scale—975 billion parameters—and its native multimodal input capabilities, supporting text, images, and audio jointly. It is also released under Apache 2.0, making the weights freely available for modification and deployment.
Are there any restrictions on how I can use Inkling?
Yes, reports suggest that a separate Model Acceptable Use Policy may restrict certain applications, such as surveillance or automated decision-making affecting individuals. The enforceability and scope of these restrictions are not fully confirmed.
Why is the training data not published?
While the weights are open, the training data and pipeline remain proprietary, which is common in industry. This limits full reproducibility and transparency but does not prevent use of the model under the license.
Will Inkling be competitive with proprietary models?
In benchmarks, Inkling shows strong safety and speech capabilities but middling performance on some language understanding tasks. Its true competitiveness will depend on application-specific needs and how restrictions impact deployment.
Source: ThorstenMeyerAI.com
