Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
What Is Mixture-of-Experts (Moe) (turingpost.com)
1 point by alyona0l on May 25, 2024 | hide | past | favorite | 1 comment


Similar to how thought is organized, as a collection of items, rather than a singlar that it appears to us to be.

https://en.wikipedia.org/wiki/Thought#Computationalism

And then the "Selector" they talk about is similar in function to the neocortex, which selectively inhibits the activation of the other parts of the brain.

https://en.wikipedia.org/wiki/Neocortex

Interesting that the researchers converged to this approach, while not seeming to cite models of thought explicitly.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: