MLflow seems to have a length limit of 5000 when setting tags (see below).

[...]
  File "/home/smay/miniconda3/envs/py38/lib/python3.8/site-packages/mlflow/utils/validation.py", line 136, in _validate_length_limit
    raise MlflowException(
mlflow.exceptions.MlflowException: Tag value '[0.8562690322984875, 0.8544098885636596, 0.8544098885636596, 0.8544098885636596, 0.85440988856365

APIs

SparkSession

• python def getActiveSession(cls)
• scala def executeCommand(runner: String, command: String, options: Map[String, String]): DataFrame

DataFrame

• python def transform(self, func)
• python def tail(self, num)
  scala def tail(n: Int): Array[T]
• scala def printSchema(level: Int): Unit
• scala def explain(mode: String): U