airflow

Description

Currently, when submitting AWS Glue jobs using Airflow, we are seeing the below in the log :-
Polling for AWS Glue Job <job_name> current run state with status <job_run_state>. This request is to enhance this by providing more detailed information about the Glue Job, show the same continuous logs from Glue/Cloudwatch into the Airflow logs. This avoids airflow users having

PodPriority should be deprecated from workflow spec since Kubernetes uses PodPriorityClass to indicate the importance and priority of a pod relative to others.

https://kubernetes.io/docs/concepts/scheduling-eviction/pod-priority-preemption/

https://github.com/argoproj/argo-workflows/blob/178bbbc31c594f9ded4b8a66b0beecbb16cfa949/pkg/apis/workflow/v1alpha1/workflow_types.go#L345-L346

Search before asking

• I had searched in the issues and found no similar issues.

What happened

Missing right click to start single task instance job's guide in workflow definition detail page

What you expected to happen

aboved.

How to reproduce

aboved.

Anything else

No response

Version

dev

Is your feature request related to a problem? Please describe.
The elyra-pipeline CLI displays a documentation link when help is invoked, e.g.

$ elyra-pipeline --help
Usage: elyra-pipeline [OPTIONS] COMMAND [ARGS]...

  Run Elyra pipelines in your local environment or submit them to an external
  service, such as Kubeflow Pipelines or Apache Airflow.

  Find more information at:

Sending a rest call to delete a job specification throws 404 where as grpc call works fine. Steps to reproduce

curl -X DELETE "http://localhost:9100/v1/project/my-project/namespace/kush/helloworld" -H  "accept: application/json"

Currently the env variables injected are specific to this docker image https://github.com/barney-s/docker-airflow

Align it with https://github.com/puckel/docker-airflow and make necessary changes in the operator to make it work with both.

related to GoogleCloudPlatform/airflow-operator#10