Evaluating Text Output in NLP: BLEU at your own risk

<p>One question I get fairly often from folks who are just getting into NLP is how to evaluate systems when the output of that system is text, rather than some sort of classification of the input text. These types of problems, where you put some text into your model and get some other text out of it, are known as&nbsp;<strong>sequence to sequence&nbsp;</strong>or&nbsp;<strong>string transduction&nbsp;</strong>problems.</p> <p>And they&rsquo;re really interesting problems! The general task of sequence to sequence modelling is at the heart of some of the most difficult tasks in NLP, including:</p> <p><a href="https://towardsdatascience.com/evaluating-text-output-in-nlp-bleu-at-your-own-risk-e8609665a213"><strong>Read More</strong></a></p>
Tags: Evaluating