NumberVectorLabelParser (ELKI: Environment for DeveLoping KDD-Applications Supported by Index-Structures)

java.lang.Object
- de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser
- - de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser
  - - de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser<V>

Type Parameters:

V - the type of NumberVector used

All Implemented Interfaces:

BundleStreamSource, Parser, StreamingParser

Direct Known Subclasses:

BitVectorLabelParser, CategorialDataAsNumberVectorParser, SparseNumberVectorLabelParser, TermFrequencyParser
```
public class NumberVectorLabelParser<V extends NumberVector>
extends AbstractStreamingParser
```
Parser for a simple CSV type of format, with columns separated by the given pattern (default: whitespace). Several labels may be given per point. A label must not be parseable as double. Lines starting with "#" will be ignored. An index can be specified to identify an entry to be treated as class label. This index counts all entries (numeric and labels as well) starting with 0.

Author:

Arthur Zimek

Nested Class Summary

Nested Classes
Modifier and Type Class and Description

static class NumberVectorLabelParser.Parameterizer<V extends NumberVector>
Parameterization class.
- Nested classes/interfaces inherited from interface de.lmu.ifi.dbs.elki.datasource.bundle.BundleStreamSource
  BundleStreamSource.Event

Nested Classes
Modifier and Type	Class and Description
`static class`	`NumberVectorLabelParser.Parameterizer<V extends NumberVector>` Parameterization class.

Field Summary

Fields
Modifier and Type	Field and Description
`(package private) gnu.trove.list.array.TDoubleArrayList`	`attributes` (Reused) store for numerical attributes.
`protected List<String>`	`columnnames` Column names.
`protected LabelList`	`curlbl` Current labels.
`protected V`	`curvec` Current vector.
`protected NumberVector.Factory<V>`	`factory` Vector factory class.
`protected boolean`	`haslabels` Whether or not the data set has labels.
`private BitSet`	`labelIndices` Keeps the indices of the attributes to be treated as a string label.
`(package private) ArrayList<String>`	`labels` (Reused) store for labels.
`private static Logging`	`LOG` Logging class.
`protected int`	`maxdim` Dimensionality reported.
`protected BundleMeta`	`meta` Metadata.
`protected int`	`mindim` Dimensionality reported.
`(package private) BundleStreamSource.Event`	`nextevent` Event to report next.
`(package private) Unique<String>`	`unique` For String unification.

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser
ATTRIBUTE_CONCATENATION, COMMENT_PATTERN, DEFAULT_SEPARATOR, NUMBER_PATTERN, QUOTE_CHARS, tokenizer

Constructor Summary

Constructors
Constructor and Description
`NumberVectorLabelParser(NumberVector.Factory<V> factory)` Constructor with defaults.
`NumberVectorLabelParser(Pattern colSep, String quoteChars, Pattern comment, BitSet labelIndices, NumberVector.Factory<V> factory)` Constructor.

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`protected void`	`buildMeta()` Update the meta element.
`void`	`cleanup()` Cleanup internal data structures.
`protected <A> V`	`createDBObject(A attributes, NumberArrayAdapter<?,A> adapter)` Creates a database object of type V.
`Object`	`data(int rnum)` Access a particular object and representation.
`protected Logging`	`getLogger()` Get the logger for this class.
`BundleMeta`	`getMeta()` Get the current meta data.
`(package private) SimpleTypeInformation<V>`	`getTypeInformation(int mindim, int maxdim)` Get a prototype object for the given dimensionality.
`void`	`initStream(InputStream in)` Init the streaming parser for the given input stream.
`protected boolean`	`isLabelColumn(int col)` Test if the current column is marked as label column.
`BundleStreamSource.Event`	`nextEvent()` Get the next event
`protected boolean`	`parseLineInternal()` Internal method for parsing a single line.

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser
asMultipleObjectsBundle, assignDBID, getLineNumber, hasDBIDs, nextLineExceptComments, parse

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser
isComment, lengthWithoutLinefeed, toString

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

- Field Detail
  - LOG
```
private static final Logging LOG
```
    Logging class.
  - labelIndices
```
private BitSet labelIndices
```
    Keeps the indices of the attributes to be treated as a string label.
  - factory
```
protected NumberVector.Factory<V extends NumberVector> factory
```
    Vector factory class.
  - mindim
```
protected int mindim
```
    Dimensionality reported.
  - maxdim
```
protected int maxdim
```
    Dimensionality reported.
  - meta
```
protected BundleMeta meta
```
    Metadata.
  - columnnames
```
protected List<String> columnnames
```
    Column names.
  - haslabels
```
protected boolean haslabels
```
    Whether or not the data set has labels.
  - curvec
```
protected V extends NumberVector curvec
```
    Current vector.
  - curlbl
```
protected LabelList curlbl
```
    Current labels.
  - attributes
```
final gnu.trove.list.array.TDoubleArrayList attributes
```
    (Reused) store for numerical attributes.
  - labels
```
final ArrayList<String> labels
```
    (Reused) store for labels.
  - unique
```
Unique<String> unique
```
    For String unification.
  - nextevent
```
BundleStreamSource.Event nextevent
```
    Event to report next.
- Constructor Detail
  - NumberVectorLabelParser
```
public NumberVectorLabelParser(NumberVector.Factory<V> factory)
```
    Constructor with defaults.
    
    Parameters:
    
    factory - Vector factory
  - NumberVectorLabelParser
```
public NumberVectorLabelParser(Pattern colSep,
                               String quoteChars,
                               Pattern comment,
                               BitSet labelIndices,
                               NumberVector.Factory<V> factory)
```
    Constructor.
    
    Parameters:
    
    colSep - Column separator
    
    quoteChars - Quote character
    
    comment - Comment pattern
    
    labelIndices - Column indexes that are numeric.
    
    factory - Vector factory
- Method Detail
  - isLabelColumn
```
protected boolean isLabelColumn(int col)
```
    Test if the current column is marked as label column.
    
    Parameters:
    
    col - Column number
    
    Returns:
    
    true when a label column.
  - initStream
```
public void initStream(InputStream in)
```
    Description copied from interface: StreamingParser
    
    Init the streaming parser for the given input stream.
    
    Specified by:
    
    initStream in interface StreamingParser
    
    Overrides:
    
    initStream in class AbstractStreamingParser
    
    Parameters:
    
    in - the stream to parse objects from
  - getMeta
```
public BundleMeta getMeta()
```
    Description copied from interface: BundleStreamSource
    
    Get the current meta data.
    
    Returns:
    
    Metadata
  - nextEvent
```
public BundleStreamSource.Event nextEvent()
```
    Description copied from interface: BundleStreamSource
    
    Get the next event
    
    Returns:
    
    Event type
  - cleanup
```
public void cleanup()
```
    Description copied from class: AbstractParser
    
    Cleanup internal data structures.
    
    Specified by:
    
    cleanup in interface Parser
    
    Overrides:
    
    cleanup in class AbstractStreamingParser
  - buildMeta
```
protected void buildMeta()
```
    Update the meta element.
  - data
```
public Object data(int rnum)
```
    Description copied from interface: BundleStreamSource
    
    Access a particular object and representation.
    
    Parameters:
    
    rnum - Representation number
    
    Returns:
    
    Contained data
  - parseLineInternal
```
protected boolean parseLineInternal()
```
    Internal method for parsing a single line. Used by both line based parsing as well as block parsing. This saves the building of meta data for each line.
    
    Returns:
    
    true when a valid line was read, false on a label row.
  - createDBObject
```
protected <A> V createDBObject(A attributes,
                               NumberArrayAdapter<?,A> adapter)
```
    Creates a database object of type V.
    
    Type Parameters:
    
    A - attribute type
    
    Parameters:
    
    attributes - the attributes of the vector to create.
    
    adapter - Array adapter
    
    Returns:
    
    a RalVector of type V containing the given attribute values
  - getTypeInformation
```
SimpleTypeInformation<V> getTypeInformation(int mindim,
                                            int maxdim)
```
    Get a prototype object for the given dimensionality.
    
    Parameters:
    
    mindim - Minimum dimensionality
    
    maxdim - Maximum dimensionality
    
    Returns:
    
    Prototype object
  - getLogger
```
protected Logging getLogger()
```
    Description copied from class: AbstractParser
    
    Get the logger for this class.
    
    Specified by:
    
    getLogger in class AbstractParser
    
    Returns:
    
    Logger.

Class NumberVectorLabelParser<V extends NumberVector>

Nested Class Summary

Nested classes/interfaces inherited from interface de.lmu.ifi.dbs.elki.datasource.bundle.BundleStreamSource

Field Summary

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

Constructor Summary

Method Summary

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

Methods inherited from class java.lang.Object

Field Detail

LOG

labelIndices

factory

mindim

maxdim

meta

columnnames

haslabels

curvec

curlbl

attributes

labels

unique

nextevent

Constructor Detail

NumberVectorLabelParser

NumberVectorLabelParser

Method Detail

isLabelColumn

initStream

getMeta

nextEvent

cleanup

buildMeta

data

parseLineInternal

createDBObject

getTypeInformation

getLogger