Annotator Bias

Data Skeptic

• Episode: Annotator Bias
• Website: Data Skeptic
• Feed URL: https://dataskeptic.com/api/blog/rss
• Published: 2019-11-24 00:45

The modern deep learning approaches to natural language processing are voracious in their demands for large corpora to train on.  Folk wisdom estimates used to be around 100k documents were required for effective training.  The availability of broadly trained, general-purpose models like BERT has made it possible to do transfer learning to achieve novel results on much smaller corpora.