November 3, 2020

[R] New Facebook & Berkeley AI Research Project: Multi-Agent Collaboration via Reward Attribution Decomposition

This is a new collaboration project between FAIR & BAIR. The team proposes CollaQ, a novel way to decompose Q function for decentralized policy in multi-agent […]
November 3, 2020

[P] Notes for Graham Neubig's NLP course (2020)

New post : https://medium.com/da-labs/nlp-lecture-13-cmu-a-watch-read-treat-93260305e966 Delve deep into the world of NLP with us! We continue our journey of generating trees over natural sentences, exploring models with […]
November 4, 2020

[P] Dataset of 196,640 books in plain text for training large language models such as GPT

Link for instructions before downloading a 37GB tarball: https://github.com/soskek/bookcorpus/issues/27#issuecomment-716104208 Shawn Presser released this dataset. From his Tweet thread: Suppose you wanted to train a world-class GPT […]
November 4, 2020

[D] Simple Questions Thread October 25, 2020

Please post your questions here instead of creating a new thread. Encourage others who create new posts for questions to post here instead! Thread will stay […]