[SUBS]RANK
VIDEOS / UMAR JAMIL / UIX8K-XBUPE

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Umar Jamil UMAR JAMIL · SEP 15, 2024

This YouTube video has 42 000 views and was published Sep 15, 2024 on Umar Jamil. That is 0.4x the channel's average views.

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer ▸ WATCH ON YOUTUBE
Views
42 000
Likes
—
Comments
—
Like rate
—
▸ Vs channel average
-60%
This video is at 0.4x the channel's average views.
LAST 13 UPLOADS · ■ THIS VIDEO
Umar Jamil
Umar Jamil
@umarjamilai · 90.6K SUBS · 25 VIDEOS
AUDIT →
More from this channel
Building a distributed training framework from first principles Building a distributed training framework from first principles 36 000 VIEWS · 2MO AGO Flash Attention derived and coded from first principles with Triton (Python) Flash Attention derived and coded from first principles with Triton (Python) 98 000 VIEWS · 1Y AGO Coding Stable Diffusion from scratch in PyTorch Coding Stable Diffusion from scratch in PyTorch 222 000 VIEWS · 2Y AGO Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation 141 000 VIEWS · 2Y AGO