Skip to content
#

spark

Here are 3,975 public repositories matching this topic...

gizmodus
gizmodus commented May 8, 2019

Hey Cube.Js team!
I get the following yarn warnings when installing dependencies. Can these be fixed? Thank you.

warning @cubejs-backend/server-core > @cubejs-backend/schema-compiler > joi@14.3.1: This module has moved and is now available at @hapi/joi. Please update your dependencies as this version is no longer maintained an may contain bugs and security issues.

warning @cubejs-backe

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

  • Updated Sep 23, 2019
  • 356 commits
  • 14 contributors
  • Python
fancellu
fancellu commented Dec 17, 2015

Currently they use sys.process to drop down to Linux command line.
Also there are manual steps where the user is expected to do things.

e.g. mllib/planes.snb talks about downloading a bz2 file, uncompressing, copying to correct destination.

All well and good, but doesn't work too well for Windows users.

Would be improved by instead keeping it pure JVM, e.g. use apache commons.io/compress calls

malleshjm
malleshjm commented Apr 30, 2018

Hello,

I was able to run python scripts in dev mode using the steps provided in documentation. but for production, I am not sure which all folders to keep and the process to follow. editing the local conf and local sh files and running the server_deploy script, I was able to generate the server jar. But still i had to manually add the python context and upload my egg file.
Can someone pleas

mmlspark
mathew5
mathew5 commented Aug 14, 2019

I am trying to explain the predictions made by my XGboost model using MMLSparks Lime package for scala. This is my first time using LIME library, I am able to perform a fit operation on the dataset and when I am trying to perform the transform operation, the program stops with an exception, "Caused by: java.lang.ClassCastException: org.apache.spark.ml.linalg.SparseVector cannot be cast to org.apac

You can’t perform that action at this time.