pipelines

Summary

If there is a global default-get-timeout set on the web node, it is not possible to override that timeout for the implicit get step that is used to pull the image_resource configured on a task.

Steps to reproduce

Start up Concourse with default-get-timeout set very low

$ wget https://concourse-ci.org/docker-compose.yml

$ echo "      CONCOURSE_DEFAULT_GET

We should do something like https://blog.questionable.services/article/kubernetes-deployments-configmap-change/ to ensure that if the pod sweeper has a different config map the underlying pod gets rolled.

Use case

Polyaxon tracking can be used to automatically log all information generated by Ludwig.

We should probably think about adding support for Polyaxon's tracking module in Ludwig contrib.

Problem
Some of our transformers & estimators are not thoroughly tested or not tested at all.

Solution
Use OpTransformerSpec and OpEstimatorSpec base test specs to provide tests for all existing transformers & estimators.

Is your feature request related to a problem? Please describe.
It's cumbersome to create the same step twice.

Describe the solution you'd like
Add a button to duplicate a step in the pipeline editor.

Ideas
We could combine this with some other ideas in a context menu (right click).

Credit to Serhii Ostapchuk for contributing this on Slack.

Contact Details [Optional]

support@zenml.io

Describe the feature you'd like

Currently our CLI offers a way to install the python packages that are required for a given integration. However, some of our integrations also have system requirements that are necessary to make them work (graphviz, kubectl, etc. ).
All system requirements should be listed on an integration level, just

When running tasks in a grid, a number is appended at the end of the tasks product names. For example, the following pipeline.yaml file:

- source: example_task.py
   name: example-task
   product:
       data: output/output_dataframe.csv
   grid:
       input_dataframe: ['birds.csv', 'fish.csv', 'flowers.csv']

would result in 3 products: output_dataframe-1.csv, output_datafram

Receive events from MSK with IAM auth config https://docs.aws.amazon.com/msk/latest/developerguide/iam-access-control.html

Is your feature request related to a problem? Please describe.
The Elyra distribution includes a set of system-owned runtime image configurations to make it easier for Visual Pipeline Editor users to get started with Jupyter notebooks, Python scripts, and R scripts. Many of those configuration were created mo

Hi!

When using the unprivileged image, it's not possible to load custom configurations.

# podman run -p 8080:8080 -e GITLAB_MONITOR_CONFIG=/tmp/config.json timoschwarzer/gitlab-monitor:unprivileged
/wrapper.sh: line 4: can't create /usr/share/nginx/html/config.json: Permission denied

Indeed, root is needed to create a new file in /usr/share/nginx/html, and it looks like wrapper.s