NIPS 2018 (RL) Papers to Read



NIPS 2018 is approaching. I select some (51) papers to read carefully, so that the conference-attending experience would be great. It is feasible to read on average one paper carefully each day. This list is highly biased, reflecting my focus on deep reinforcement learning, and my broad interests in RL/AI. It is more of a personal note than a recommendation. However, hopefully the list may be helpful to some people. See the following blog for a complete list of Reinforcement Learning papers in NIPS 2018. Here comes the list of papers, ordered alphabetically by first author’s last names.

  1. Brandon Amos, Ivan Jimenez, Jacob Sacks, Byron Boots, and J. Zico Kolter. Differentiable MPC for end-to-end planning and control.
  2. Yusuf Aytar, Tobias Pfaff, David Budden, Thomas Paine, Ziyu Wang, and Nando de Freitas. Playing hard exploration games by watching YouTube.
  3. Jacob Buckman, Danijar Hafner, George Tucker, Eugene Brevdo, and Honglak Lee. Sample-efficient reinforcement learning with stochastic ensemble value expansion.
  4. Kurtland Chua, Roberto Calandra, Rowan McAllister, and Sergey Levine. Data-efficient model-based reinforcement learning with deep probabilistic dynamics models.
  5. Filipe de Avila Belbute-Peres, Kevin Smith, Kelsey Allen, Josh Tenenbaum, and J. Zico Kolter. End-to-end differentiable physics for learning and control.
  6. Amir massoud Farahmand. Iterative value-aware model learning.
  7. Justin Fu, Sergey Levine, Dibya Ghosh, Larry Yang, and Avi Singh. An event-based framework for task specification and control.
  8. Vikash Goel, Jameson Weng, and Pascal Poupart. Unsupervised video object segmentation for deep reinforcement learning.
  9. Abhishek Gupta, Russell Mendonca, YuXuan Liu, Pieter Abbeel, and Sergey Levine. Meta-reinforcement learning of structured exploration strategies.
  10. David Ha and Jürgen Schmidhuber. Recurrent world models facilitate policy evolution.
  11. Nick Haber, Damian Mrowca, Stephanie Wang, Li Fei-Fei, and Daniel Yamins. Learning to play with intrinsically-motivated, self-aware agents.
  12. Rein Houthooft, Yuhua Chen, Phillip Isola, Bradly Stadie, Filip Wolski, Jonathan Ho, and Pieter Abbeel. Evolved policy gradients.
  13. Zhiting Hu, Zichao Yang, Ruslan Salakhutdinov, LIANHUI Qin, Xiaodan Liang, Haoye Dong, and Eric Xing. Deep generative models with learnable knowledge constraints.
  14. Jiexi Huang, Fa Wu, Doina Precup, and Yang Cai. Learning safe policies with expert guidance.
  15. Kwang-Sung Jun, Lihong Li, Yuzhe Ma, and Xiaojin Zhu. Adversarial attacks on stochastic bandits.
  16. Raksha Kumaraswamy, Matthew Schlegel, Adam White, and Martha White. Context-dependent upper-confidence bounds for directed exploration.
  17. Isaac Lage, Andrew Ross, Samuel J Gershman, Been Kim, and Finale Doshi-Velez. Human-in-the-loop interpretability prior.
  18. Marc Lanctot, Sriram Srinivasan, Vinicius Zambaldi, Julien Perolat, karl Tuyls, Remi Munos, and Michael Bowling. Actor-critic policy optimization in partially observable multiagent environments.
  19. Nevena Lazic, Craig Boutilier, Tyler Lu, Eehern Wong, Binz Roy, MK Ryu, and Greg Imwalle. Data center cooling using model-predictive control.
  20. Jan Leike, Borja Ibarz, Dario Amodei, Geoffrey Irving, and Shane Legg. Reward learning from human preferences and demonstrations in Atari.
  21. Shuang Li, Shuai Xiao, Shixiang Zhu, Nan Du, Yao Xie, and Le Song. Learning temporal point processes via reinforcement learning.
  22. Yuan Li, Xiaodan Liang, Zhiting Hu, and Eric Xing. Hybrid retrieval-generation reinforced agent for medical image report generation.
  23. Chen Liang, Mohammad Norouzi, Jonathan Berant, Quoc V Le, and Ni Lao. Memory augmented policy optimization for program synthesis with generalization.
  24. Qiang Liu, Lihong Li, Ziyang Tang, and Denny Zhou. Breaking the curse of horizon: Infinite-horizon off-policy estimation.
  25. Yao Liu, Omer Gottesman, Aniruddh Raghu, Matthieu Komorowski, Aldo A Faisal, Finale Doshi-Velez, and Emma Brunskill. Representation balancing MDPs for off-policy policy evaluation.
  26. Tyler Lu, Craig Boutilier, and Dale Schuurmans. Non-delusional Q-learning and value-iteration.
  27. Mario Lucic, Karol Kurach, Marcin Michalski, Sylvain Gelly, and Olivier Bousquet. Are GANs created equal? a large-scale study.
  28. David Alvarez Melis and Tommi Jaakkola. Towards robust interpretability with self-explaining neural networks.
  29. Robin Manhaeve, Sebastijan Dumancic, Angelika Kimmig, Thomas Demeester, and Luc De Raedt. DeepProbLog: Neural probabilistic logic programming.
  30. Horia Mania, Aurelia Guy, and Benjamin Recht. Simple random search of static linear policies is competitive for reinforcement learning.
  31. Damian Mrowca, Chengxu Zhuang, Elias Wang, Nick Haber, Li Fei-Fei, Josh Tenenbaum, and Daniel Yamins. A flexible neural representation for physics prediction.
  32. Ofir Nachum, Shixiang Gu, Honglak Lee, and Sergey Levine. Data-efficient hierarchical reinforcement learning.
  33. Ashvin Nair, Vitchyr Pong, Shikhar Bahl, Sergey Levine, Steven Lin, and Murtaza Dalal. Visual goal-conditioned reinforcement learning by representation learning.
  34. Matthew O’Kelly, Aman Sinha, Hongseok Namkoong, Russ Tedrake, and John C Duchi. Scalable end-to-end autonomous vehicle testing via rare-event simulation.
  35. Ian Osband, John S Aslanides, and Albin Cassirer. Randomized prior functions for deep reinforcement learning.
  36. Matthew Riemer, Miao Liu, and Gerald Tesauro. Learning abstract options.
  37. Adam Santoro, Ryan Faulkner, David Raposo, Jack Rae, Mike Chrzanowski, Theophane Weber, Daan Wierstra, Oriol Vinyals, Razvan Pascanu, and Tim Lillicrap. Relational recurrent neural networks.
  38. Shibani Santurkar, Dimitris Tsipras, Andrew Ilyas, and Aleksander Madry. How does batch normalization help optimization? (no, it is not about internal covariate shift).
  39. Ozan Sener and Vladlen Koltun. Multi-task learning as multi-objective optimization.
  40. Jiaming Song, Hongyu Ren, Dorsa Sadigh, and Stefano Ermon. Multi-agent generative adversarial imitation learning.
  41. Wen Sun, Geoffrey Gordon, Byron Boots, and J. Bagnell. Dual policy iteration.
  42. Aviv Tamar, Pieter Abbeel, Ge Yang, Thanard Kurutach, and Stuart Russell. Learning plannable representations with causal InfoGAN.
  43. Andrew Trask, Felix Hill, Scott Reed, Jack Rae, Chris Dyer, and Phil Blunsom. Neural arithmetic logic units.
  44. Tongzhou Wang, YI WU, David Moore, and Stuart Russell. Meta-learning MCMC proposals.
  45. Catherine Wong, Neil Houlsby, Yifeng Lu, and Andrea Gesmundo. Transfer learning with neural AutoML.
  46. Kelvin Xu, Chelsea Finn, and Sergey Levine. Uncertainty-aware few-shot learning with probabilistic model-agnostic meta-learning.
  47. Zhongwen Xu, Hado van Hasselt, and David Silver. Meta-gradient reinforcement learning.
  48. Kexin Yi, Jiajun Wu, Chuang Gan, Antonio Torralba, Pushmeet Kohli, and Josh Tenenbaum. Neural-Symbolic VQA: Disentangling reasoning from vision and language understanding.
  49. Lisa Zhang, Gregory Rosenblatt, Ethan Fetaya, Renjie Liao, William Byrd, Matthew Might, Raquel Urtasun, and Richard Zemel. Neural guided con- straint logic programming for program synthesis.
  50. Yu Zhang, Ying Wei, and Qiang Yang. Learning to multitask.
  51. Zeyu Zheng, Junhyuk Oh, and Satinder Singh. On learning intrinsic rewards for policy gradient methods.

Source: Deep Learning on Medium