Skip to content
#

data-engineering

Here are 669 public repositories matching this topic...

superset
dcalde
dcalde commented Dec 17, 2020

Current behavior

All ShellTask logs are logged at DEBUG level, preventing showing the command output in the UI logs unless the agent's logging threshold is set to DEBUG. But this is undesired for production workloads, as this applies to all log messages

streaming logging for the ShellTask was introduced in #3584

Proposed behavior

change existing stream_logs parameter to `U

gardnerdev
gardnerdev commented Jan 16, 2021

Describe the bug
When trying to run scaffolding (profiling) command, it fails because of commas in columns.

To Reproduce
Steps to reproduce the behavior:

  1. Run great_expectations suite scaffold scaffold-name on datasource where commas are in column
  2. Bug pandas.errors.ParserError: Error tokenizing data. C error: Expected 1 fields in line 5323 saw 2

Expected behavior
D

Improve this page

Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."

Learn more