Contact sales
3.6×
Faster time to first token
1.9×
Higher per-user output speed
60%
Lower cost per session

Open Superintelligence

Open models. Multisilicon infrastructure. Intelligence you control.

01Zyphra Cloud

The right accelerator for your workload

Datacenter capacity, accelerators, networking and storage across AMD, Google TPU, AWS Trainium, and Nvidia.

02Zyphra Optimization EngineConnector

More intelligence from every accelerator.

Zyphra’s Optimization Engine includes model and hardware specific kernels, algorithms and routing to deliver maximum intelligence and efficiency.

03Open Models & Inference

Open-source frontier intelligence.

Zyphra and frontier open-source models you can customize and consume in the cloud or your sovereign environment.

04Zyphra Customization StudioConnectorIn development

Customized with your data and workflows.

Zyphra’s Customization Studio turns general open models into your own custom intelligence with fine-tuning, reinforcement learning, and an integrated harness and memory.

05MAIA

MAIA. Puts intelligence to work.

Multiplayer agent for knowledge workers integrated with your sovereign stack and custom intelligence or available as an application.

The Frontier Open Stack

The intelligence that shapes your future should be yours to own.

Latest from Zyphra
ModelNovember 9, 2026

ZONOS3-Mini

Introducing ZONOS3-Mini, a compact zero-shot voice-cloning Text To Speech (TTS) model with state-of-the-art performance as well as leading voice control capabilities which can run in real-time on-device.

Read the post
Recent releasesAll research and news

Introducing MAIA: AI That Makes Teams Better Together

Our mission at Zyphra is to make open superintelligence accessible to everyone through a full stack spanning frontier models, multisilicon infrastructure, and agentic applications. Today, we're excited to introduce MAIA in beta, the application layer that brings this vision directly to people and teams. MAIA is a proactive, multiplayer AI agent that remembers shared context, takes action across tools, and helps teams turn knowledge into outcomes. This beta is an early step toward making powerful intelligence more accessible, useful, and under the control of those who use it. We invite you to try MAIA and help shape what comes next.

[Research]November 6, 2026

ZYFA: Fast and Accurate FP8 Attention on AMD MI355X

Zyphra presents ZYFA (Zyphra FlashAttention on AMD) - FP8 and BF16 prefill attention kernels for AMD Instinct MI355X GPUs. ZYFA is part of the attention engine of our Zyphra Optimization Engine (ZOE) on AMD MI355X GPUs, powering our inference cloud and on-prem deployments. We show that FP8 matrix instructions offer twice the peak throughput of BF16, but attention kernels fall well short of a 2x speedup in practice. On the MI355X at 32K tokens, the FP8 attention kernel of AITER (AMD’s library of inference kernels) reaches 39% of the FP8 peak, while its BF16 kernel reaches 49% of the BF16 peak. FP8 speeds up only the two matrix multiplications of attention, so the softmax between them becomes the bottleneck. ZYFA’s FP8 kernels shrink the softmax, overlap it with the matrix multiplications, and keep the 8-bit probabilities accurate. On attention inputs captured from three models and timed at sustained clock speeds (the steady clock under continuous load), they achieve 1.16–1.76× the throughput of AITER’s default kernels (Figure 1), and at head dimension 128 their numerical error is 62–78% lower than that of AITER’s FP8 kernel. This post summarizes our paper, and the source code is available at github.com/Zyphra/zyfa.

[Research]November 5, 2026

ZHA: Zyphra Hierarchical Attention

We introduce Zyphra Hierarchical Attention (ZHA), a sparse attention method that constructs and searches through a hierarchical tree to determine the relevant set of tokens for each query. ZHA achieves subquadratic complexity with suitably chosen top-p thresholds for routing, outperforming existing sparse-attention methods which maintain a quadratic indexer. We demonstrate that we can adapt existing pretrained models to ZHA through a distillation phase using only a few billion tokens, and that ZHA maintains performance on challenging long-context reasoning, agentic coding, and retrieval benchmarks at high levels of sparsity. Our performance model shows that ZHA dramatically outperforms sparse attention methods in speed and computational cost at ultra-long contexts.

[Research]November 2, 2026

Zyphra Inference Wave 2: Kernels, Quantization, and Speculative Decoding on MI355X

Building on our first round of benchmarks for Zyphra Inference on AMD Instinct™ MI355X GPUs, today we publish the second phase of our full-stack inference optimization effort. The first phase focused on tuning, parallelism, and communication. In this phase, we go deeper into the model forward pass. We measure the empirical rooflines of the MI355X, write custom HIP kernels for the most expensive operations (in particular the MoE feed-forward block and sparse attention (CSA/DSA)), and evaluate how those kernels compose with quantization and speculative decoding in deployed configurations of our forked versions of vLLM and SGLang. We call our full stack of optimizations and their integrations into forks of production stacks such as vLLM and SGLang the Zyphra Optimization Engine (ZOE). All work in this blog targets the MI355X (gfx950 / CDNA4), and the optimization work in this post is a mix of: a) demonstrating the performance that we can deliver in our inference cloud, b) sharing our research process, and c) previewing our upcoming inference work.

[Research]October 16, 2026

Expert Coupling in MoE Pretraining

Mixture-of-Experts (MoE) models scale model capacity efficiently by routing each token to only a small subset of experts. But at large scale, the cost of moving tokens between GPUs can become a major bottleneck, accounting for as much as 60.4% of total training step time in our experiments. In this work, we show that MoE routing contains substantial structure that can be exploited to reduce this communication. Experts selected by the same token are strongly correlated within a layer, while a token’s expert choices in one layer predict where it will be routed in later layers. We use these two properties to increase token–expert locality in two complementary ways: correlated expert placement co-locates experts that are frequently selected together, while token shuffling proactively moves tokens to the GPUs likely to contain their next experts. Neither technique changes the model architecture or its routing decisions. Moreover, we find that these routing patterns are cheap to estimate and emerge early enough in training to remain useful over long stretches of pretraining. In Megatron-LM experiments on MI300X GPUs, our methods reduce all-to-all communication time by up to 2.63× and improve end-to-end training step time by up to 1.41×.

[Research]October 8, 2026

How Hybrid NoPE Models Learn Position Without Position Encodings

Zyphra Research investigates how hybrid language models can recover positional information even when their global attention layers use no explicit position encoding (NoPE). We find that local layers such as sliding window attention (SWA) and gated linear attention naturally create a recency bias in the model’s residual stream, meaning that representations of nearby tokens become more similar than representations of distant tokens. We find that this recency bias then propagates through the model, where the query and key projections of global NoPE attention learn to read it out. The result is an implicit relative position encoding in attention layers that, on their own, have no direct access to token position. Our results provide a mechanistic explanation for why architectures interleaving local mixing with global NoPE attention can work so well, and point toward a promising way of building positional representations that extrapolate naturally beyond the sequence lengths seen during training.

[Research]October 1, 2026