October 14, 2020

[N] High-Quality Legal NLP Dataset

Legal datasets are extremely expensive because lawyers are, which has bottlenecked legal NLP. Here is a new legal dataset by the Atticus Project with ~3,000 labels […]
October 15, 2020

[D] Where are the limits and bottlenecks in the number of classes in a classifier?

I'm interested in the general answer to this, as well as for my concrete use case if it applies equally. There is conventional wisdom saying 10^3ish […]
October 15, 2020

[D] Confused mathematician looking for clarity on transformers, and also maybe for therapy.

LATE EDIT: see this. Transformer/attention is F(x) = φ(x W1 W2 xT ) x W3, followed by some standard renormalizations/RELU. This should be in the goddamned […]
October 15, 2020

[D] Simple Questions Thread September 27, 2020

Please post your questions here instead of creating a new thread. Encourage others who create new posts for questions to post here instead! Thread will stay […]