Story
Trending

A Hugging Face post claims to contain an Anthropic Mythos-class checkpoint

AI · First reported 1 Nov, 15:45 · Updated 16:43

Image: Wikimedia Commons · Francis Matahum · CC BY-SA 4.0

A Hugging Face Blog post alleges that a large, mid-training checkpoint is from an Anthropic model codenamed numbat. The post describes its architecture and files, but the supplied evidence contains no independent confirmation of the claim.

  • The Hugging Face post describes the alleged checkpoint as a roughly 14-trillion-parameter model with 114 layers and a hybrid Gated DeltaNet and Multi-head Latent Attention architecture.
  • The post says the checkpoint is at training step 1,830,000 of an approximately 1.96-million-step run and has not undergone post-training or RLHF.
  • The post claims the 772 shards contain about 7.72 TB of tensor data; the Hacker News evidence only provides a title and says the item contains comments.
Summary written by Lux AI from 2 articlesUnverified

Key facts

Claimed model codename
numbat
Claimed parameter count
Approximately 14 trillion
Claimed checkpoint step
1,830,000 of an approximately 1.96-million-step run
Claimed shard count and data size
772 shards totaling about 7.72 TB

Source spectrum

Far left
Left
Lean left
Centre
Lean right
Right
Far right

Unrated

Left 0 · Centre 0 · Right 0 of 0 rated sources · +1 unrated

Background

All coverage

Coverage over time

011516171819
LeftCentreRight

Articles per hour since first reported, by side.

Ownership

  • Corporation 100% (2)

Share of the 2 sources by owner type.

From the companies