Rewrite the Stars

Recent studies have drawn attention to the untapped potential of the "star operation" (element-wise multiplication) in network design. While intuitive explanations abound, the foundational rationale behind its application remains largely unexplored. Our study attempts to reveal the star op...

Full description

Saved in:
Bibliographic Details
Published inProceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) pp. 5694 - 5703
Main Authors Ma, Xu, Dai, Xiyang, Bai, Yue, Wang, Yizhou, Fu, Yun
Format Conference Proceeding
LanguageEnglish
Published IEEE 16.06.2024
Subjects
Computer vision
element-wise multiplication
Pattern recognition
Polynomials
Prototypes
rewrite the stars
Solids
StarNet
Stars
Visualization
Online AccessGet full text

Cover

More Information
Summary:Recent studies have drawn attention to the untapped potential of the "star operation" (element-wise multiplication) in network design. While intuitive explanations abound, the foundational rationale behind its application remains largely unexplored. Our study attempts to reveal the star operation's ability of mapping inputs into high-dimensional, non-linear feature spaces-akin to kernel tricks-without widening the network. We further introduce StarNet, a simple yet pow-erful prototype, demonstrating impressive performance and low latency under compact network structure and efficient budget. Like stars in the sky, the star operation appears unremarkable but holds a vast universe of potential. Our work encourages further exploration across tasks, with codes available at https://github.com/ma-xu/Rewrite-the-Stars.
ISSN:1063-6919
DOI:10.1109/CVPR52733.2024.00544