Nlp

Distill small, fast static models from any Sentence Transformer without needing a dataset.

A practical overview of efficient attention mechanisms that tackle the quadratic scaling problem.

Using extractive summarization to train Transformers on long documents efficiently.