apache-spark
Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 1,250 public repositories matching this topic...
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
-
Updated
May 18, 2022 - Scala
-
Updated
Oct 19, 2021 - JavaScript
Follow up on #3520
Add a metadata entry with the KVs underlying DB type. This can be taken from the configuration and does not need a store specific implementation
-
Updated
Jun 22, 2022 - Jupyter Notebook
-
Updated
Jul 7, 2022 - Go
-
Updated
Aug 16, 2021 - Java
-
Updated
Jul 7, 2022 - Shell
Describe the bug
When the finalizer is called for CLR JvmObjectId objects, it calls the rm DotnetBackend method and this calls goes through the JvmBridge class. Because the rm call goes through [JvmBridge.CallJavaMethod](https://github.com/do
-
Updated
Mar 15, 2022 - Shell
-
Updated
Dec 31, 2020 - Python
-
Updated
Dec 3, 2019 - Python
-
Updated
Mar 9, 2020 - Python
-
Updated
Jun 22, 2022 - C#
-
Updated
Jul 8, 2022 - R
This is reported by Manjunath from Slack channel.
For work_dir: "dbfs:/feathr_getting_started"
The user was running jupyter notebook from windows.
without forward slash('dbfs:/feathr_getting_started') the job configs were coming as '--join-config', 'dbfs:/feathr_getting_started\feature_join.conf'
To fix this, the user need to add foward slash: `work
-
Updated
Mar 22, 2022 - Scala
-
Updated
Dec 12, 2021 - Scala
-
Updated
Feb 12, 2022
-
Updated
Jul 25, 2018 - Python
-
Updated
Jan 8, 2020 - Scala
-
Updated
Jun 20, 2022 - Python
-
Updated
Feb 23, 2022 - Java
-
Updated
Dec 21, 2021
-
Updated
Apr 27, 2022 - Scala
-
Updated
Oct 29, 2021 - Jupyter Notebook
-
Updated
Jun 21, 2022
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia
We currently use pylint 2.11.1. This is a bit old so we should upgrade it to the latest version (2.14.4):
https://github.com/mlflow/mlflow/blob/d40780be361f4bd2741c2e8fcbd428c1d693edcf/requirements/lint-requirements.txt#L1