Text Preprocessing: Splitting texts into sentences with Spark NLP
John Snow Labs
JUNE 5, 2023
It is a critical step in several natural language processing (NLP) tasks because many NLP tasks take sentence as an input unit, such as part-of-speech tagging, dependency parsing, named entity recognition or machine translation. Thus, we need the previous step, which produces the DOCUMENT that will be used as the input to SentenceDetectorDL.
52 
Let's personalize your content