SuperPos-Prompt: Enhancing Soft Prompt Tuning of Language Models with Superposition of Multi Token Embeddings

Mohammad Ali Sadraei Javaheri, Ehsaneddin Asgari, Alice C. McHardy, Hamid R. Rabiee. SuperPos-Prompt: Enhancing Soft Prompt Tuning of Language Models with Superposition of Multi Token Embeddings. In Mehdi Rezagholizadeh, Peyman Passban, Soheila Samiee, Vahid Partovi Nia, Yu Cheng, Yue Deng, Qun Liu, Boxing Chen, editors, NeurIPS Efficient Natural Language and Speech Processing Workshop, 14 December 2024, Vancouver, British Columbia, Canada. Volume 262 of Proceedings of Machine Learning Research, pages 34-46, PMLR, 2024. [doi]

Authors

Mohammad Ali Sadraei Javaheri

This author has not been identified. Look up 'Mohammad Ali Sadraei Javaheri' in Google

Ehsaneddin Asgari

This author has not been identified. Look up 'Ehsaneddin Asgari' in Google

Alice C. McHardy

This author has not been identified. Look up 'Alice C. McHardy' in Google

Hamid R. Rabiee

This author has not been identified. Look up 'Hamid R. Rabiee' in Google