•1 min read•from Machine Learning
Does this idea sound fun? [R]
It's about inference-time learning by inserting some experts specialized for updating sibling expert weights in MoE. All the components needed were already there, but no one tried it inside MoE, so I did a small PoC. It kinda worked. I'd love to hear what you think.
[link] [comments]
Want to read more?
Check out the full article on the original site
Tagged with
#rows.com
#natural language processing for spreadsheets
#machine learning in spreadsheet applications
#generative AI for data analysis
#Excel alternatives for data analysis
#real-time data collaboration
#real-time collaboration
#inference-time learning
#MoE
#experts
#updating weights
#sibling expert
#PoC
#weights
#components
#specialized
#learning
#idea
#functions
#feedback