Skip to content
#

avro

Here are 461 public repositories matching this topic...

mausch
mausch commented Apr 2, 2020

The title might seem a bit vague but I don't know how to describe it any better tbh :-)

Anyway this is what happened: I got some 500 responses from the schema registry and all I could see in the logs was :

[2020-04-02 16:03:35,048] INFO 100.96.14.58 - - [02/Apr/2020:16:03:34 +0000] "PUT /config/some-topic-value HTTP/1.1" 500 69  502 (io.confluent.rest-utils.requests)

The logs di

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

  • Updated Nov 23, 2020
  • Python
idreeskhan
idreeskhan commented Dec 30, 2019

Over time we've had some things leak into the diff methods that make it more cumbersome to use BigDiffy via code instead of CLI.

For example diffAvro here https://github.com/spotify/ratatool/blob/master/ratatool-diffy/src/main/scala/com/spotify/ratatool/diffy/BigDiffy.scala#L284

User has to manually pass in schema otherwise we they receive a non-informative error regarding null schema, add

serras
serras commented Oct 12, 2020

If I execute nix-shell python-test.nix, I am welcomed with the following message:

error: expression does not evaluate to a derivation (or a set or list of those)

This is not great, because we cannot check for inconsistencies with the official implementations of Avro and Protocol Buffers.

It would be great too if this could be integrated as part of CI (it was at some point, but

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

  • Updated Feb 1, 2019
  • TypeScript
asoltysik
asoltysik commented Nov 26, 2020

If you tag a type that has a Numeric or Ordering your tagged type no is an instance of these typeclasses. Example solution for Numeric:

  implicit def taggedNumeric[A: Numeric, Tag]: Numeric[A @@ Tag] = new Numeric[A @@ Tag] {
    override def plus(x: A @@ Tag, y: A @@ Tag): A @@ Tag   = implicitly[Numeric[A]].plus(x, y).taggedWith[Tag]
    override def minus(x: A @@ Tag, y: A @@ T

Improve this page

Add a description, image, and links to the avro topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the avro topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.