GeoLoRA: Geometric integration for parameter efficient fine-tuning
Schotthöfer, Steffen, Zangrando, Emanuele, Ceruti, Gianluca, Tudisco, Francesco, Kusch, Jonas
Year of Publication 24.10.2024
Year of Publication 24.10.2024
Get full text
Journal Article
Neural Rank Collapse: Weight Decay and Small Within-Class Variability Yield Low-Rank Bias
Zangrando, Emanuele, Deidda, Piero, Brugiapaglia, Simone, Guglielmi, Nicola, Tudisco, Francesco
Year of Publication 06.02.2024
Year of Publication 06.02.2024
Get full text
Journal Article
Robust low-rank training via approximate orthonormal constraints
Savostianova, Dayana, Zangrando, Emanuele, Ceruti, Gianluca, Tudisco, Francesco
Year of Publication 02.06.2023
Year of Publication 02.06.2023
Get full text
Journal Article
Geometry-aware training of factorized layers in tensor Tucker format
Zangrando, Emanuele, Schotthöfer, Steffen, Ceruti, Gianluca, Kusch, Jonas, Tudisco, Francesco
Year of Publication 30.05.2023
Year of Publication 30.05.2023
Get full text
Journal Article
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations
Schotthöfer, Steffen, Zangrando, Emanuele, Kusch, Jonas, Ceruti, Gianluca, Tudisco, Francesco
Year of Publication 26.05.2022
Year of Publication 26.05.2022
Get full text
Journal Article
Robust low-rank training via approximate orthonormal constraints
Savostianova, Dayana, Zangrando, Emanuele, Ceruti, Gianluca, Tudisco, Francesco
Published in arXiv.org (02.06.2023)
Get full text
Published in arXiv.org (02.06.2023)
Paper