The Critical Clues In Thinking Machines’ Inkling For AI Development
AIThis post was created with the assistance of artificial intelligence (AI).

TL;DR

Before you orderOffer from Amazon

Get the latest gadgets delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Thinking Machines launched Inkling, a large, open-weight multimodal AI model, openly available on Hugging Face. The release emphasizes transparency but raises questions about licensing and use restrictions. The development signals a shift toward open models with clear limitations.

Thinking Machines has publicly released its latest foundation model, Inkling, under an Apache 2.0 license, making it freely downloadable and modifiable. This marks a significant moment in AI development, as the model’s weights are openly accessible, but the company also maintains a separate use policy restricting certain applications. The release underscores a shift toward transparency in large AI models, with important implications for developers and regulators alike.

Inkling is a 975-billion-parameter multimodal transformer supporting text, images, and audio inputs, with a 1-million-token context window. It was trained on 45 trillion tokens across diverse media, using a hybrid optimizer and over 30 million reinforcement learning rollouts, including synthetic data from open models such as Kimi K2.5. The model is not the strongest available, but its open weights under Apache 2.0 are notable for enabling independent inspection and modification.

Released on Hugging Face, the weights are accompanied by a model card stating the license, but reports suggest the company enforces a separate Model Acceptable Use Policy that restricts surveillance, deception, and automated decision-making affecting individuals. This layered policy raises questions about the true openness of the release, especially for sensitive applications. The model’s performance on benchmarks varies, with strengths in speech and safety but middling results in some language understanding tasks.

At a glance
reportWhen: announced March 2024
The developmentThinking Machines released Inkling, a 975-billion-parameter multimodal AI model, openly available on Hugging Face, with licensing and use policies that impact AI deployment.

Impact of Open-Weight Release with Use Restrictions

The release of Inkling as an openly accessible model under Apache 2.0 signals a new approach in AI development, emphasizing transparency and community engagement. However, the potential restrictions via a separate use policy highlight ongoing tensions between openness and control. For developers, this means the ability to fine-tune and deploy the model independently, but also the need to verify compliance with the company’s restrictions, especially in sensitive domains like surveillance or public safety. The move could influence industry standards on model licensing and responsible AI deployment, but also raises questions about enforcement and transparency.

Amazon

AI model training datasets

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on Inkling’s Development and Release Strategy

Thinking Machines, founded 17 months ago by former OpenAI CTO, has built a reputation for transparency and technical rigor. Its prior work includes models with publicly available weights, but Inkling’s release under Apache 2.0 is notable for being one of the largest open models to date. The company’s approach contrasts with many industry players that restrict access via closed APIs. The model’s training involved diverse media and synthetic data, with a focus on safety benchmarks and performance metrics. The release follows recent debates over model openness, licensing, and responsible AI use, especially after incidents involving model shutdowns due to regulatory or political actions.

“We believe transparency and responsible use are compatible; our separate policy ensures the model is used ethically.”

— Thinking Machines spokesperson

Amazon

multimodal AI development tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Unclear Aspects of Inkling’s Licensing and Use Restrictions

It remains unclear how strictly the separate Model Acceptable Use Policy will be enforced and whether it will impact independent developers’ ability to modify or deploy Inkling freely. The exact scope of restrictions, especially regarding surveillance, deception, and decision-making, has not been publicly verified. Additionally, the extent to which the policy aligns with the Apache 2.0 license remains ambiguous, raising questions about potential legal and ethical boundaries.

Amazon

large language model fine-tuning software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Next Steps for Developers and Regulators

Developers will likely begin testing and fine-tuning Inkling, assessing its performance across various applications. Independent audits and benchmarks are expected to verify claims about safety and capabilities. Regulators and industry groups may scrutinize the licensing and use policies, especially in sensitive sectors. The company may also release further documentation clarifying restrictions and enforcement mechanisms. Monitoring how the community adopts and adapts the model will be crucial for understanding its impact on open AI development.

Amazon

AI model licensing compliance tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

What makes Inkling different from other large language models?

Inkling is a 975-billion-parameter multimodal transformer with open weights under Apache 2.0, supporting text, images, and audio inputs. Its emphasis on transparency and its layered use policies distinguish it from many proprietary models.

Can I freely modify and commercialize Inkling?

While the weights are openly available under Apache 2.0, the company reportedly enforces a separate use policy that may restrict certain applications. Users should verify the policy and compliance requirements before deploying the model commercially.

Why is the layered use policy significant?

The policy could impose restrictions on surveillance, deception, or automated decision-making, potentially limiting the model’s use in sensitive areas despite its open weights. Its enforceability and scope are still being evaluated.

What are the performance strengths of Inkling?

Inkling shows strong results in safety benchmarks like FORTRESS (78%) and speech tasks such as VoiceBench (91.4%). Its language understanding benchmarks are middling, but its multimodal capabilities are notable.

Source: ThorstenMeyerAI.com

FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

The Kill Switch: What the Anthropic Export Ban Really Costs the AI Industry

U.S. government’s export controls on Anthropic’s latest models led to their shutdown, raising concerns over reliance on AI and industry stability.

Donate To GrapheneOS

GrapheneOS has announced a new fundraising initiative to support its ongoing development and security enhancements, urging community donations.

What Happened When Claude Encountered Site Limits In Internal Tests?

A Search Engine Journal headline attributes an internal-test finding to Anthropic, but the sites, limits and test conditions are not available.

AI Transparency Gets A Boost: Claude’s Approach To Watermarking All Generated Content

Anthropic announces that all content generated with Claude will now carry a watermark to improve AI detection, though technical details remain limited.