org.languagetool.tokenizers

Class SimpleSentenceTokenizer

java.lang.Object

org.languagetool.tokenizers.SRXSentenceTokenizer

org.languagetool.tokenizers.SimpleSentenceTokenizer

All Implemented Interfaces:

SentenceTokenizer, Tokenizer

public class SimpleSentenceTokenizer
extends SRXSentenceTokenizer

A very simple sentence tokenizer that splits on [.!?…] followed by whitespace or an uppercase letter. You probably want to use an adapted SRXSentenceTokenizer instead.

Since:

2.6

Constructor Summary

Constructors

Constructor and Description
SimpleSentenceTokenizer()

Method Summary

Methods inherited from class org.languagetool.tokenizers.SRXSentenceTokenizer

setSingleLineBreaksMarksParagraph, singleLineBreaksMarksPara, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleSentenceTokenizer

public SimpleSentenceTokenizer()