Table of Contents

• NeurIPS 2020 Competition and Demonstration Track: Revised selected papersHugo Jair Escalante, Katja Hofmann. 1-2 [doi]
• Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020Ryan Turner, David Eriksson, Michael McCourt, Juha Kiili, Eero Laaksonen, Zhen Xu, Isabelle Guyon. 3-26 [doi]
• tspDB: Time Series Predict DBAnish Agarwal, Abdullah Alomar, Devavrat Shah. 27-56 [doi]
• Learning Cloth Dynamics: 3D+Texture Garment Reconstruction BenchmarkMeysam Madadi, Hugo Bertiche, Wafa Bouzouita, Isabelle Guyon, Sergio Escalera. 57-76 [doi]
• Solving Black-Box Optimization Challenge via Learning Search Space Partition for Local Bayesian OptimizationMikita Sazanovich, Anastasiya Nikolskaya, Yury Belousov, Aleksei Shpilman. 77-85 [doi]
• NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons LearnedSewon Min, Jordan L. Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins 0001, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick S. H. Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel 0001, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Sejr Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih. 86-111 [doi]
• Learning to run a Power Network Challenge: a Retrospective AnalysisAntoine Marot, Benjamin Donnot, Gabriel Dulac-Arnold, Adrian Kelly, Aidan O'Sullivan, Jan Viebahn, Mariette Awad, Isabelle Guyon, Patrick Panciatici, Camilo Romero. 112-132 [doi]
• MosAIc: Finding Artistic Connections across Culture with Conditional Image RetrievalMark Hamilton, Stephanie Fu, Mindren Lu, Johnny Bui, Darius Bopp, Zhenbang Chen, Felix Tran, Margaret Wang, Marina Rogers, Lei Zhang, Chris Hoder, William T. Freeman. 133-155 [doi]
• Semi-Automated Data LabelingMichael Desmond, Evelyn Duesterwald, Kristina Brimijoin, Michelle Brachman, Qian Pan. 156-169 [doi]
• Methods and Analysis of The First Competition in Predicting Generalization of Deep LearningYiding Jiang, Parth Natekar, Manik Sharma, Sumukh K. Aithal, Dhruva Kashyap, Natarajan Subramanyam, Carlos Lassance, Daniel M. Roy 0001, Gintare Karolina Dziugaite, Suriya Gunasekar, Isabelle Guyon, Pierre Foret, Scott Yak, Hossein Mobahi, Behnam Neyshabur, Samy Bengio. 170-190 [doi]
• Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education ChallengeZichao Wang 0001, Angus Lamb, Evgeny Saveliev, Pashmina Cameron, Yordan Zaykov, José Miguel Hernández-Lobato, Richard E. Turner, Richard G. Baraniuk, Craig Barton, Simon Peyton Jones, Simon Woodhead 0002, Cheng Zhang. 191-205 [doi]
• Hide-and-Seek Privacy Challenge: Synthetic Data Generation vs. Patient Re-identificationJames Jordon, Daniel Jarrett, Evgeny Saveliev, Jinsung Yoon, Paul W. G. Elbers, Patrick Thoral, Ari Ercole, Cheng Zhang, Danielle Belgrave, Mihaela van der Schaar. 206-215 [doi]
• The SpaceNet Multi-Temporal Urban Development ChallengeAdam Van Etten, Daniel Hogan. 216-232 [doi]
• Towards robust and domain agnostic reinforcement learning competitions: MineRL 2020William Hebgen Guss, Stephanie Milani, Nicholay Topin, Brandon Houghton, Sharada P. Mohanty, Andrew Melnik, Augustin Harter, Benoit Buschmaas, Bjarne Jaster, Christoph Berganski, Dennis Heitkamp, Marko Henning, Helge J. Ritter, Chengjie Wu, Xiaotian Hao, Yiming Lu, Hangyu Mao, Yihuan Mao, Chao Wang, Michal Opanowicz, Anssi Kanervisto, Yanick Schraner, Christian Scheller, Xiren Zhou, Lu Liu, Daichi Nishio, Toi Tsuneda, Karolis Ramanauskas, Gabija Juceviciute. 233-252 [doi]
• Musical Speech: A Transformer-based Composition ToolJason d'Eon, Sri Harsha Dumpala, Chandramouli Shama Sastry, Daniel Oore, Sageev Oore. 253-274 [doi]
• Flatland Competition 2020: MAPF and MARL for Efficient Train Coordination on a Grid WorldFlorian Laurent, Manuel Schneider, Christian Scheller, Jeremy D. Watson, Jiaoyang Li 0001, Zhe Chen, Yi Zheng, Shao-Hung Chan, Konstantin Makhnev, Oleg Svidchenko, Vladimir Egorov, Dmitry Ivanov, Aleksei Shpilman, Evgenija Spirovska, Oliver Tanevski, Aleksandar Nikov, Ramon Grunder, David Galevski, Jakov Mitrovski, Guillaume Sartoretti, Zhiyao Luo, Mehul Damani, Nilabha Bhattacharya, Shivam Agarwal, Adrian Egli, Erik Nygren, Sharada P. Mohanty. 275-301 [doi]
• NeurIPS 2020 NLC2CMD Competition: Translating Natural Language to Bash CommandsMayank Agarwal, Tathagata Chakraborti, Quchen Fu, David Gros, Xi Victoria Lin, Jaron Maene, Kartik Talamadupula, Zhongwei Teng, Jules White. 302-324 [doi]
• Traffic4cast at NeurIPS 2020 ? yet more on theunreasonable effectiveness of gridded geo-spatial processesMichael Kopp 0001, David P. Kreil, Moritz Neun, David Jonietz, Henry Martin, Pedro Herruzo, Aleksandra Gruca, Ali Soleymani, Fanyou Wu, Yang Liu, Jingwei Xu, Jianjin Zhang, Jay Santokhi, Alabi Bojesomo, Hasan Al-Marzouqi, Panos Liatsis, Pak Hay Kwok, Qi Qi, Sepp Hochreiter. 325-343 [doi]
• The Hateful Memes Challenge: Competition ReportDouwe Kiela, Hamed Firooz, Aravind Mohan, Vedanuj Goswami, Amanpreet Singh, Casey A. Fitzpatrick, Peter Bull, Greg Lipstein, Tony Nelli, Ron Zhu, Niklas Muennighoff, Riza Velioglu, Jewgeni Rose, Phillip Lippe, Nithin Holla, Shantanu Chandra, Santhosh Rajamanickam, Georgios Antoniou, Ekaterina Shutova, Helen Yannakoudakis, Vlad Sandulescu, Umut Ozertem, Patrick Pantel, Lucia Specia, Devi Parikh. 344-360 [doi]
• Measuring Sample Efficiency and Generalization in Reinforcement Learning Benchmarks: NeurIPS 2020 Procgen BenchmarkSharada P. Mohanty, Jyotish Poonganam, Adrien Gaidon, Andrey Kolobov, Blake Wulfe, Dipam Chakraborty, Grazvydas Semetulskis, João Schapke, Jonas Kubilius, Jurgis Pasukonis, Linas Klimas, Matthew J. Hausknecht, Patrick MacAlpine, Quang Nhat Tran, Thomas Tumiel, Xiaocheng Tang, Xinwei Chen, Christopher Hesse, Jacob Hilton, William Hebgen Guss, Sahika Genc, John Schulman, Karl Cobbe. 361-395 [doi]