•1 min read•from Machine Learning
Please help me understand figure on subspace similarity in LoRA paper. [D]
![Please help me understand figure on subspace similarity in LoRA paper. [D]](/_next/image?url=https%3A%2F%2Fpreview.redd.it%2F3l5qhbiroech1.png%3Fwidth%3D640%26crop%3Dsmart%26auto%3Dwebp%26s%3De5534631f23bcc8d8e89b7fd411120c2b7a84442&w=3840&q=75)
| I am studying the LoRA paper and have trouble understanding this figure. The function essentially measures how much of the subspace spanned by the top i vectors is contained in the subspace spanned by the top j vectors in the higher rank matrix. Therefore, j can not be lower than i. So when they say the 3rd and 4th figure zoom in on the lower-left triangle of the 2 left-most figures, how are there values for j=1 and i equals 2 to 8? I dont understand what kind of y-axis the 2 right figures are supposed to be using. Thanks in advance! [link] [comments] |
Want to read more?
Check out the full article on the original site
Tagged with
#rows.com
#natural language processing for spreadsheets
#generative AI for data analysis
#Excel alternatives for data analysis
#LoRA
#subspace similarity
#vectors
#rank matrix
#subspace
#machine learning
#figure
#i
#j
#y-axis
#lower-left triangle
#higher rank
#top vectors
#containment
#matrix
#dimension