org.languagetool.dev.dumpcheck

Class SentenceSourceIndexer

java.lang.Object

org.xml.sax.helpers.DefaultHandler

org.languagetool.dev.dumpcheck.SentenceSourceIndexer

All Implemented Interfaces:

AutoCloseable, ContentHandler, DTDHandler, EntityResolver, ErrorHandler

public class SentenceSourceIndexer
extends DefaultHandler
implements AutoCloseable

Creates a Lucene index of a SentenceSource. Performance examples (Dell XPS 13 9360): German Wikipedia and Tatoeba With POS tags: 22,000 sentences per minute German Wikipedia and Tatoeba Without POS tags: 2.4 million sentences per minute

Since:

2.4

Field Summary

Fields

Modifier and Type	Field and Description
static String	MAX_DOC_COUNT_FIELD
static String	MAX_DOC_COUNT_FIELD_VAL
static String	MAX_DOC_COUNT_VALUE

Method Summary

Modifier and Type	Method and Description
void	close()
static void	main(String... args)

Methods inherited from class org.xml.sax.helpers.DefaultHandler

characters, endDocument, endElement, endPrefixMapping, error, fatalError, ignorableWhitespace, notationDecl, processingInstruction, resolveEntity, setDocumentLocator, skippedEntity, startDocument, startElement, startPrefixMapping, unparsedEntityDecl, warning

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MAX_DOC_COUNT_VALUE

public static final String MAX_DOC_COUNT_VALUE

See Also:

Constant Field Values

MAX_DOC_COUNT_FIELD

public static final String MAX_DOC_COUNT_FIELD

See Also:

Constant Field Values

MAX_DOC_COUNT_FIELD_VAL

public static final String MAX_DOC_COUNT_FIELD_VAL

See Also:

Constant Field Values

Method Detail

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception

main

public static void main(String... args)
                 throws Exception

Throws:

Exception