All modern models are MoE already, no? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		miohtama 16 days ago \| parent \| context \| favorite \| on: DeepSeek-v3.2: Pushing the frontier of open large ... All modern models are MoE already, no?

hasperdi 16 days ago [–]

That's not the case. Some are dense and some are hybrid.

MOE is not the holy grail, as there are drawbacks eg. less consistency, expert under/over-use

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact