Class

com.lewuathe.dllib.solver

Solver

Related Doc: package solver

Permalink

abstract class Solver[FeaturesType, E <: Solver[FeaturesType, E, M], M <: SolverModel[FeaturesType, M]] extends Predictor[FeaturesType, E, M] with HasWeightCol

Solver implements distributed training algorithm for deep learning models. Currently this class is doing Back propagation under data parallelism schema.

Linear Supertypes
HasWeightCol, Predictor[FeaturesType, E, M], PredictorParams, HasPredictionCol, HasFeaturesCol, HasLabelCol, Estimator[M], PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Solver
  2. HasWeightCol
  3. Predictor
  4. PredictorParams
  5. HasPredictionCol
  6. HasFeaturesCol
  7. HasLabelCol
  8. Estimator
  9. PipelineStage
  10. Logging
  11. Params
  12. Serializable
  13. Serializable
  14. Identifiable
  15. AnyRef
  16. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Solver(network: Network)

    Permalink

Abstract Value Members

  1. abstract def copy(extra: ParamMap): E

    Permalink
    Definition Classes
    Predictor → Estimator → PipelineStage → Params
  2. abstract def train(dataset: Dataset[_]): M

    Permalink
    Attributes
    protected
    Definition Classes
    Predictor
  3. abstract val uid: String

    Permalink
    Definition Classes
    Identifiable

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. final def clear(param: Param[_]): Solver.this.type

    Permalink
    Definition Classes
    Params
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  9. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  12. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params
  13. def explainParams(): String

    Permalink
    Definition Classes
    Params
  14. def extractLabeledPoints(dataset: Dataset[_]): RDD[LabeledPoint]

    Permalink
    Attributes
    protected
    Definition Classes
    Predictor
  15. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params
  16. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params
  17. final val featuresCol: Param[String]

    Permalink
    Definition Classes
    HasFeaturesCol
  18. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  19. def fit(dataset: Dataset[_]): M

    Permalink
    Definition Classes
    Predictor → Estimator
  20. def fit(dataset: Dataset[_], paramMaps: Array[ParamMap]): Seq[M]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  21. def fit(dataset: Dataset[_], paramMap: ParamMap): M

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  22. def fit(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): M

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" ) @varargs()
  23. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  24. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  25. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  26. final def getFeaturesCol: String

    Permalink
    Definition Classes
    HasFeaturesCol
  27. final def getLabelCol: String

    Permalink
    Definition Classes
    HasLabelCol
  28. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params
  29. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params
  30. final def getPredictionCol: String

    Permalink
    Definition Classes
    HasPredictionCol
  31. final def getWeightCol: String

    Permalink

    Definition Classes
    HasWeightCol
  32. def gradient(form: Graph, model: Model, instance: Instance): (Model, Double)

    Permalink

    Calculate the gradient of Model parameter with given training instance.

    Calculate the gradient of Model parameter with given training instance.

    Attributes
    protected
  33. val graph: Graph

    Permalink
  34. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params
  35. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params
  36. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  37. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  38. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  39. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  40. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  41. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  42. final val labelCol: Param[String]

    Permalink
    Definition Classes
    HasLabelCol
  43. var learningRate: Double

    Permalink
  44. val learningRateDecay: Double

    Permalink
  45. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  46. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  47. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  48. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  49. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  50. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  51. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  52. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  53. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  54. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  55. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  56. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  57. var miniBatchFraction: Double

    Permalink
  58. val model: Model

    Permalink
  59. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  60. val network: Network

    Permalink
  61. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  62. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  63. var numIterations: Int

    Permalink
  64. val objective: Objective

    Permalink
  65. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params
  66. final val predictionCol: Param[String]

    Permalink
    Definition Classes
    HasPredictionCol
  67. final def set(paramPair: ParamPair[_]): Solver.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  68. final def set(param: String, value: Any): Solver.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  69. final def set[T](param: Param[T], value: T): Solver.this.type

    Permalink
    Definition Classes
    Params
  70. final def setDefault(paramPairs: ParamPair[_]*): Solver.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  71. final def setDefault[T](param: Param[T], value: T): Solver.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  72. def setFeaturesCol(value: String): E

    Permalink
    Definition Classes
    Predictor
  73. def setLabelCol(value: String): E

    Permalink
    Definition Classes
    Predictor
  74. def setPredictionCol(value: String): E

    Permalink
    Definition Classes
    Predictor
  75. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  76. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any
  77. def trainInternal(dataset: Dataset[_], model: Model): Model

    Permalink
    Attributes
    protected
  78. def transformSchema(schema: StructType): StructType

    Permalink
    Definition Classes
    Predictor → PipelineStage
  79. def transformSchema(schema: StructType, logging: Boolean): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()
  80. def validateAndTransformSchema(schema: StructType, fitting: Boolean, featuresDataType: DataType): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PredictorParams
  81. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  82. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  83. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  84. final val weightCol: Param[String]

    Permalink

    Param for weight column name.

    Param for weight column name. If this is not set or empty, we treat all instance weights as 1.0..

    Definition Classes
    HasWeightCol

Inherited from HasWeightCol

Inherited from Predictor[FeaturesType, E, M]

Inherited from PredictorParams

Inherited from HasPredictionCol

Inherited from HasFeaturesCol

Inherited from HasLabelCol

Inherited from Estimator[M]

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

getParam

param

Ungrouped