de.lmu.ifi.dbs.elki.evaluation.outlier

Class OutlierSmROCCurve

java.lang.Object

de.lmu.ifi.dbs.elki.evaluation.outlier.OutlierSmROCCurve

All Implemented Interfaces:

Evaluator, ResultProcessor

@Reference(authors="W. Klement, P. A. Flach, N. Japkowicz, S. Matwin",
           title="Smooth Receiver Operating Characteristics (smROC) Curves",
           booktitle="European Conf. Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD\'11)",
           url="https://doi.org/10.1007/978-3-642-23783-6_13",
           bibkey="DBLP:conf/pkdd/KlementFJM11")
public class OutlierSmROCCurve
extends java.lang.Object
implements Evaluator

Smooth ROC curves are a variation of classic ROC curves that takes the scores into account.

Reference:

W. Klement, P. A. Flach, N. Japkowicz, S. Matwin
Smooth Receiver Operating Characteristics (smROC) Curves.
European Conf. Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD'11)

However, this method has some deficiencies when the mean score is not 0.5, as discussed in:

Erich Schubert, Remigius Wojdanowski, Arthur Zimek, Hans-Peter Kriegel
On Evaluation of Outlier Rankings and Outlier Scores
Proc. 12th SIAM Int. Conf. on Data Mining (SDM 2012)

Since:

0.5.0

Author:

Erich Schubert

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	OutlierSmROCCurve.Parameterizer Parameterization class.
static class	OutlierSmROCCurve.SmROCResult Result object for Smooth ROC curves.

Field Summary

Fields

Modifier and Type	Field and Description
private static Logging	LOG The logger.
private java.util.regex.Pattern	positiveClassName Stores the "positive" class.
static java.lang.String	SMROCAUC_LABEL The label we use for marking ROCAUC values.

Constructor Summary

Constructors

Constructor and Description
OutlierSmROCCurve(java.util.regex.Pattern positive_class_name) Constructor.

Method Summary

Modifier and Type	Method and Description
private OutlierSmROCCurve.SmROCResult	computeSmROCResult(SetDBIDs positiveids, OutlierResult or)
void	processNewResult(ResultHierarchy hier, Result result) Process a result.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SMROCAUC_LABEL

public static final java.lang.String SMROCAUC_LABEL

The label we use for marking ROCAUC values.

See Also:

Constant Field Values

LOG

private static final Logging LOG

The logger.

positiveClassName

private java.util.regex.Pattern positiveClassName

Stores the "positive" class.

Constructor Detail

OutlierSmROCCurve

public OutlierSmROCCurve(java.util.regex.Pattern positive_class_name)

Constructor.

Parameters:

positive_class_name - Positive class name pattern

Method Detail

computeSmROCResult

private OutlierSmROCCurve.SmROCResult computeSmROCResult(SetDBIDs positiveids,
                                                         OutlierResult or)

processNewResult

public void processNewResult(ResultHierarchy hier,
                             Result result)

Description copied from interface: ResultProcessor

Process a result.

Specified by:

processNewResult in interface ResultProcessor

Parameters:

hier - The base of the result tree.

result - Newly added result subtree.