1 min readfrom Machine Learning

Any tools to turn a codebase into a fine tuning dataset? [D]

I have a few web projects with pretty good UI/UX and I’m wondering if there’s any tool or workflow that can turn an existing codebase into a dataset for fine tuning.

For example, given a React/Next.js project with components, pages, styling, etc. or a static html site, I’d like to turn it into something like:

instruction/prompt -> code

or whatever format actually makes sense for training an instruct/thinking/diffusion coding model.

Also curious how people handle things like:

  • keeping the context between components/files
  • screenshots + code
  • generating useful instructions instead of generic descriptions

I’m also working on a different model architecture that I think could improve quality/speed while using less VRAM, so I want to build a decent dataset and benchmark to test it properly.

Has anyone done something like this? Any tools, repos, papers, or workflows you’d recommend?

submitted by /u/ImBadGuyInEveryStory
[link] [comments]

Want to read more?

Check out the full article on the original site

View original article

Tagged with

#fine tuning
#codebase
#dataset
#React
#Next.js
#UI/UX
#instruction/prompt
#coding model
#diffusion model
#components
#pages
#styling
#static html
#context
#screenshots
#model architecture
#VRAM
#benchmark
#workflow
#machine learning