ChiSqSelector

Creates a ChiSquared feature selector. The selector supports different selection methods: numTopFeatures, percentile, fpr, fdr, fwe.

numTopFeatures chooses a fixed number of top features according to a chi-squared test.
percentile is similar but chooses a fraction of all features instead of a fixed number.
fpr chooses all features whose p-values are below a threshold, thus controlling the false positive rate of selection.
fdr uses the [Benjamini-Hochberg procedure] (https://en.wikipedia.org/wiki/False_discovery_rate#Benjamini.E2.80.93Hochberg_procedure) to choose all features whose false discovery rate is below a threshold.
fwe chooses all features whose p-values are below a threshold. The threshold is scaled by 1/numFeatures, thus controlling the family-wise error rate of selection. By default, the selection method is numTopFeatures, with the default number of top features set to 50.

Annotations: @Since( "1.3.0" )
Source: ChiSqSelector.scala

Linear Supertypes

Serializable, Serializable, AnyRef, Any

Instance Constructors

new ChiSqSelector(numTopFeatures: Int)

The is the same to call this() and setNumTopFeatures(numTopFeatures)
The is the same to call this() and setNumTopFeatures(numTopFeatures)

Annotations
@Since( "1.3.0" )
new ChiSqSelector()

Annotations
@Since( "2.1.0" )

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
var fdr: Double
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
def fit(data: RDD[LabeledPoint]): ChiSqSelectorModel

Returns a ChiSquared feature selector.
Returns a ChiSquared feature selector.
data
an RDD[LabeledPoint] containing the labeled dataset with categorical features. Real-valued features will be treated as categorical for each distinct value. Apply feature discretizer before using this function.

Annotations
@Since( "1.3.0" )
var fpr: Double
var fwe: Double
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def hashCode(): Int

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
var numTopFeatures: Int
var percentile: Double
var selectorType: String
def setFdr(value: Double): ChiSqSelector.this.type

Annotations
@Since( "2.2.0" )
def setFpr(value: Double): ChiSqSelector.this.type

Annotations
@Since( "2.1.0" )
def setFwe(value: Double): ChiSqSelector.this.type

Annotations
@Since( "2.2.0" )
def setNumTopFeatures(value: Int): ChiSqSelector.this.type

Annotations
@Since( "1.6.0" )
def setPercentile(value: Double): ChiSqSelector.this.type

Annotations
@Since( "2.1.0" )
def setSelectorType(value: String): ChiSqSelector.this.type

Annotations
@Since( "2.1.0" )
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toString(): String

Definition Classes
AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Doc: package feature

class ChiSqSelector extends Serializable

Instance Constructors

new ChiSqSelector(numTopFeatures: Int)

new ChiSqSelector()

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def clone(): AnyRef

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

var fdr: Double

def finalize(): Unit

def fit(data: RDD[LabeledPoint]): ChiSqSelectorModel

var fpr: Double

var fwe: Double

final def getClass(): Class[_]

def hashCode(): Int

final def isInstanceOf[T0]: Boolean

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

var numTopFeatures: Int

var percentile: Double

var selectorType: String

def setFdr(value: Double): ChiSqSelector.this.type

def setFpr(value: Double): ChiSqSelector.this.type

def setFwe(value: Double): ChiSqSelector.this.type

def setNumTopFeatures(value: Int): ChiSqSelector.this.type

def setPercentile(value: Double): ChiSqSelector.this.type

def setSelectorType(value: String): ChiSqSelector.this.type

final def synchronized[T0](arg0: ⇒ T0): T0

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped