Matrix multiplication exponent

Optimal exponent remains unknownEvidence checked

Subjects: Algorithms and data structures

Reading depth

The problem

A matrix is a rectangular grid of numbers. Multiply a grid with rows (1, 2) and (3, 4) by one with rows (5, 6) and (7, 8): the result has rows (19, 22) and (43, 50). Its first entry is 1×5+2×7=191\times5+2\times7=19, pairing a row with a column. The usual method repeats this work for every output entry. For large square grids, can the arithmetic cost grow almost as slowly as the number of entries in the answer?[1] [3]

Scope

The arithmetic-operation exponent ω for multiplying arbitrary dense square matrices over a fixed field, such as the complex numbers.

What remains open

Making each table twice as wide and twice as tall quadruples its number of entries. The target is an arithmetic-operation count whose growth can approach this square-growth scale as closely as desired. That target is called exponent two; it need not give a single exact square-growth bound. No proof reaches it or rules it out. Shortcuts that assume few nonzero entries do not settle the problem for arbitrary dense matrices—tables without that sparsity guarantee.[1] [2]

Why it matters

Matrix products combine transformations used in scientific computation and neural networks. They also combine connection information in graph algorithms. A cheaper general multiplication method could reduce a recurring cost in these larger computations; whether it helps a particular program still depends on its data and implementation.[1] [3]

Definitions

3 terms
arithmetic operation

A field addition, subtraction, multiplication or division counted as one step in this model. Bit lengths, memory transfers and hardware execution time are separate costs.[1] [3]

matrix multiplication exponent

The infimum of powers achievable asymptotically for arbitrary dense square matrices over a fixed field. Exponent two permits a bound with any positive extra exponent, without necessarily giving one exact quadratic algorithm.[1]

dense matrix

Here the general input model, with no promise that only a small number of entries are nonzero. A particular dense-model input may still contain zeros; sparse algorithms require additional guarantees.[2] [1]

Sources

  1. New Bounds for Matrix Multiplication: from Alpha to Omega Virginia Vassilevska Williams, Yinzhan Xu, Zixuan Xu and Renfei Zhou · 2023-07-16
    Notes on New Bounds for Matrix Multiplication: from Alpha to Omega

    Primary SODA 2024 paper reporting improved upper bounds rather than exponent two.

  2. Optimal Deterministic Fully Sparse Matrix Multiplication Omar Graia · 2026-08-19
    Notes on Optimal Deterministic Fully Sparse Matrix Multiplication

    Recent primary preprint; near-quadratic regimes have explicit sparsity qualifications and do not solve arbitrary dense multiplication.

  3. Discovering faster matrix multiplication algorithms with reinforcement learning Alhussein Fawzi and colleagues · 2022-10-05
    Notes on Discovering faster matrix multiplication algorithms with reinforcement learning

    Primary study explains block-product sharing/recursion and distinguishes arithmetic counts from practical runtime tailored to particular hardware. Used for those mechanisms and uses, not as exponent-two progress.

Suggest a correction