Version

com.microsoft.ml.spark:mmlspark_2.11:jar:0.18.1
spark= 2.4.3
scala=2.11.12

data (csv with header) https://gist.github.com/ttpro1995/69051647a256af912803c9a16040f43a

download data and save as csv file, put into folder /data/public/HIGGS/higgs.test.predictioncsv

val data = spark.read.option("header","true").option("inferSchema", "true").csv("/data/public/HIGGS

APIs

SparkSession

• python def getActiveSession(cls)
• scala def executeCommand(runner: String, command: String, options: Map[String, String]): DataFrame

DataFrame

• python def transform(self, func)
• python def tail(self, num)
  scala def tail(n: Int): Array[T]
• scala def printSchema(level: Int): Unit
• scala def explain(mode: String): U