PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities

Settaluri Lakshmi Sravanthi, Meet Doshi, Pavan Tankala, V. Rudra Murthy, Raj Dabre, Pushpak Bhattacharyya. PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities. In Lun-Wei Ku, Andre Martins, Vivek Srikumar, editors, Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024. pages 12075-12097, Association for Computational Linguistics, 2024. [doi]

Authors

Settaluri Lakshmi Sravanthi

This author has not been identified. Look up 'Settaluri Lakshmi Sravanthi' in Google

Meet Doshi

This author has not been identified. Look up 'Meet Doshi' in Google

Pavan Tankala

This author has not been identified. Look up 'Pavan Tankala' in Google

V. Rudra Murthy

This author has not been identified. Look up 'V. Rudra Murthy' in Google

Raj Dabre

This author has not been identified. Look up 'Raj Dabre' in Google

Pushpak Bhattacharyya

This author has not been identified. Look up 'Pushpak Bhattacharyya' in Google