Voozh

5 min read

👁 zeromathai profile

zeromathai

Jun 17

How Attention Actually Works — From Next-Token Prediction to QKV Intuition

#ai #machinelearning #nlp #transformers

Add Comment

3 min read

👁 zeromathai profile

zeromathai

Jun 16

How Transformer Architecture Works — Encoder, Decoder, Tokens, and Context

#ai #machinelearning #nlp #transformers

Add Comment

6 min read

👁 aj1thkr1sh profile

aj1thkr1sh

Jun 15

Attention Is All You Need, Building a Transformer for Thanglish-to-Tamil

#ai #transformers #genai #deeplearning

Add Comment

3 min read

👁 yang_goufang_23c7ba674984 profile

Yang Goufang

Jun 11

有人在拆 Transformer：Memory Caching 與 CTM 各拆走了一半

#machinelearning #ai #transformers #deeplearning

Add Comment

3 min read

👁 tech_nuggets profile

Tech_Nuggets

Jun 10

Flash Attention: what it does and why it matters

#llm #ai #deeplearning #transformers

Add Comment

8 min read

👁 o96a profile

Aamer Mihaysi

May 13

MoE Architectures Keep Solving the Wrong Problem

#machinelearning #llm #transformers

Add Comment

3 min read

👁 garyljackson profile

Gary Jackson

May 2

Chapter 12: Inference - Generating New Text

#csharp #machinelearning #transformers #tutorial

Add Comment

9 min read

👁 garyljackson profile

Gary Jackson

Apr 30

Chapter 11: The Full GPT - Assembling the Model

#csharp #machinelearning #transformers #tutorial

Add Comment

10 min read

👁 garyljackson profile

Gary Jackson

Apr 28

Chapter 9: Single-Head Attention - Tokens Looking at Each Other

#csharp #machinelearning #transformers #tutorial

Add Comment

9 min read

👁 garyljackson profile

Gary Jackson

Apr 27

Chapter 8: RMS Normalisation and Residual Connections

#csharp #machinelearning #transformers #tutorial

Add Comment

4 min read

👁 alankritverma profile

Alankrit Verma

Apr 27

Beating Eager TurboQuant Was Not Enough: Why Dense GPU Attention Still Won

#machinelearning #gpu #research #transformers

Add Comment

8 min read

👁 garyljackson profile

Gary Jackson

Apr 26

Chapter 7: The Training Loop and Adam Optimiser

#csharp #machinelearning #transformers #tutorial

Add Comment

7 min read

👁 garyljackson profile

Gary Jackson

Apr 25

Chapter 6: Embeddings, the Forward Pass, and the Loss Function

#csharp #machinelearning #transformers #tutorial

Add Comment

7 min read

👁 aairom profile

Alain Airom (Ayrom)

Apr 30

Mamba vs. Transformers: Architecture Comparison

#mamba #transformers #llm #granite

👁 Image
1 reaction

Add Comment

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

URL: https://dev.to/t/transformers

⇱ Transformers - DEV Community

How Self-Attention Works — QKV, Softmax, and Matrix Computation

How Attention Actually Works — From Next-Token Prediction to QKV Intuition

How Transformer Architecture Works — Encoder, Decoder, Tokens, and Context

Attention Is All You Need, Building a Transformer for Thanglish-to-Tamil

有人在拆 Transformer：Memory Caching 與 CTM 各拆走了一半

Flash Attention: what it does and why it matters

MoE Architectures Keep Solving the Wrong Problem

Chapter 12: Inference - Generating New Text

Chapter 11: The Full GPT - Assembling the Model

Chapter 9: Single-Head Attention - Tokens Looking at Each Other

Chapter 8: RMS Normalisation and Residual Connections

Beating Eager TurboQuant Was Not Enough: Why Dense GPU Attention Still Won

Chapter 7: The Training Loop and Adam Optimiser

Chapter 6: Embeddings, the Forward Pass, and the Loss Function

Mamba vs. Transformers: Architecture Comparison