org.languagetool.tokenizers.zh

Class ChineseSentenceTokenizer

java.lang.Object

org.languagetool.tokenizers.zh.ChineseSentenceTokenizer

All Implemented Interfaces:

SentenceTokenizer, Tokenizer

public class ChineseSentenceTokenizer
extends Object
implements SentenceTokenizer

Constructor Summary

Constructors

Constructor and Description
ChineseSentenceTokenizer()

Method Summary

Modifier and Type	Method and Description
void	setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs) Note: does have no effect for Chinese
boolean	singleLineBreaksMarksPara() Note: will always return false
List<String>	tokenize(String text) Tokenize the given string to sentences.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ChineseSentenceTokenizer

public ChineseSentenceTokenizer()

Method Detail

tokenize

public List<String> tokenize(String text)

Description copied from interface: SentenceTokenizer

Tokenize the given string to sentences.

Specified by:

tokenize in interface SentenceTokenizer

Specified by:

tokenize in interface Tokenizer

setSingleLineBreaksMarksParagraph

public void setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)

Note: does have no effect for Chinese

Specified by:

setSingleLineBreaksMarksParagraph in interface SentenceTokenizer

Parameters:

lineBreakParagraphs - if true, single line breaks are assumed to end a paragraph, with false, only two ore more consecutive line breaks end a paragraph

singleLineBreaksMarksPara

public boolean singleLineBreaksMarksPara()

Note: will always return false

Specified by:

singleLineBreaksMarksPara in interface SentenceTokenizer