•1 min read•from Machine Learning
How to fine-tune an LLM for open-ended problems? [P]
I want to develop an LLM that can solve open-ended math problems (such as proof-only problems). This means that RLVR where we use the final answer alone as reward signal is not enough. Since SFT is useless here and GRPO/PPO methods will not have an appropriate reward function, what kind of fine-tuning can I do? For data, I will use the MathNet dataset.
[link] [comments]
Want to read more?
Check out the full article on the original site
Tagged with
#generative AI for data analysis
#Excel alternatives for data analysis
#natural language processing for spreadsheets
#rows.com
#big data management in spreadsheets
#conversational data analysis
#large dataset processing
#real-time data collaboration
#intelligent data visualization
#data visualization tools
#enterprise data management
#big data performance
#data analysis tools
#data cleaning solutions
#open-ended problems
#LLM
#math problems
#proof-only problems
#fine-tuning
#MathNet