Archive - The AiEdge Newsletter

March 2025

Chapter 4 of The Big Book of Large Language Models is Here!

Chapter 4 of the Big Book of Large Language Models is finally here!

Mar 31 •

Damien Benveniste

Reduce AI Model Operational Costs With Quantization Techniques

A deep dive into quantization and precision levels

Mar 26 •

Damien Benveniste

How To Construct Self-Attention Mechanisms For Arbitrary Long Sequences

Toward Infinite Sequence Lengths

Mar 21 •

Damien Benveniste

How To Improve Decoding Latency With Faster Self-Attention Mechanisms

In LLMs, handling large sequences is not enough, we need to make sure the decoding process is fast.

Mar 12 •

Damien Benveniste

How To Reduce The Memory Usage Of The Self-Attention

With a bit of magic, we take a very inefficient computation like the Self-Attention and make it super memory-optimized for the specific hardware we use…

Mar 6 •

Damien Benveniste

February 2025

How To Linearize The Attention Mechanism!

Today, we talk about how to engineer attention mechanisms in O(n) complexity instead of O(n2).

Feb 26 •

Damien Benveniste

Understanding The Sparse Transformers!

The First Sparse Attention: Sparse Transformers

Feb 19 •

Damien Benveniste

Attention Is All You Need: The Original Transformer Architecture

This newsletter is the latest chapter of the Big Book of Large Language Models. You can find the preview here, and the full chapter is available in this…

Feb 12 •

Damien Benveniste

January 2025

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts