Anthropic's Scion is heavily inspired by Mononoke

Anthropic's Scion model is heavily inspired by Mononoke, a large language model developed by Google. Mononoke was trained on a dataset of web pages and has a distinctive ability to reason about the structure of the web. This inspiration is reflected in Scion's ability to generate text based on a given prompt, as well as its capacity for self-supervised learning. Scion's developers believe that this approach allows it to better learn and improve over time than traditional language models.