Li Miao on Large-Scale AI

Thoughts on LLM & Technology

HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Categories Model

Category

Model 1

Inside a 175B Parameter MoE Transformer: Architecture Deep Dive Jun 28, 2025

Recently Updated

Inside a 175B Parameter MoE Transformer: Architecture Deep Dive
Welcome to My Tech Blog
LLM Distributed System

Trending Tags

llm distributed_system transformer

© 2025 Li Miao. Some rights reserved.

Using the Chirpy theme for Jekyll.

Trending Tags

llm distributed_system transformer

A new version of content is available.