Muse Spark (Meta)

3 items · Capability 3 · all entities

Booz Allen runs 18 models as autonomous attackers and says one completed a full intrusion unaided

Booz Allen's Cyber Weapon Index ran 18 leading US and Chinese models against production-grade enterprise networks, each controlling a real attacker machine with no curated tool menu, and reports that one model — Anthropic's Claude Mythos — executed the full cyber kill chain autonomously, four more reached full domain access and control, four managed lateral movement, two progressed through credential access and all but one penetrated the network, with no substantial separation between the US and Chinese models. The accompanying report scores Claude Mythos at 80, Grok-4.5 at 49, GPT-5.6 Sol at 46 and Muse Spark 1.1 at 38, says a lower-ranked model paired with an attack harness rivalled the top scorer, and states that “the model is no longer the unit of risk. The system is.”

Self-reported, untestedBooz Allen Hamilton ↗ ·

XBOW publishes cross-model offensive-security comparison placing GLM-5.2 and Muse Spark 1.1 near frontier models at lower cost

XBOW ran black-box testing against vulnerable open-source applications across Muse Spark 1.1, GLM-5.2, GPT-5.5, Mythos, Opus 4.6, GPT-5, Gemini models and Grok 4.5. It reported Mythos as strongest, GLM-5.2 falling between GPT-5 and Opus 4.6, and Muse Spark 1.1 landing just below Opus 4.6, concluding that 'good-enough offensive capability is getting much cheaper, and that changes the threat model.'

Self-reported, untestedXBOW ↗ ·

Meta evaluation report says it cannot rule out a high risk cybersecurity designation for unmitigated Muse Spark 1.1

Meta's Muse Spark 1.1 evaluation report states that 'Our evaluations cannot rule out a "high risk" designation for the unmitigated model in the Cybersecurity domain under our Advanced AI Scaling Framework.' Reported results include 92.9% pass@1 and 97.0% pass@10 on Cybench CTF challenges (up from 65.4% for Muse Spark 1.0), 59.0% on CyberGym vulnerability reproduction, and completion of 1 of 10 CyScenarioBench multi-host attack scenarios.

On the recordMeta AI ↗ ·