Parnia Samimi, Sri Devi Ravana. Agreement between Crowdsourced Workers and Expert Assessors in Making Relevance Judgment for System Based IR Evaluation. In Tutut Herawan, Rozaida Ghazali, Mustafa Mat Deris, editors, Recent Advances on Soft Computing and Data Mining - Proceedings of The First International Conference on Soft Computing and Data Mining (SCDM-2014) Universiti Tun Hussein Onn Malaysia, Johor, Malaysia, June 16th-18th, 2014. Volume 287 of Advances in Intelligent Systems and Computing, pages 399-407, Springer, 2014. [doi]