Apache Arrow and Spark Committer
- Seattle
- http://www.viirya.org
Block or Report
Block or report viirya
Report abuse
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abusePopular repositories
-
-
eventsim Public
Forked from josephadler/eventsim
Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
-
-
-
1,644 contributions in the last year
Less
More
Contribution activity
April 2023
Created 11 commits in 3 repositories
Created 2 repositories
- viirya/qdrant Rust
- viirya/llama-rs Rust
Created a pull request in apache/arrow-datafusion that received 16 comments
Decimal multiply kernel should not cause precision loss
Which issue does this PR close? Closes #5674. Closes #3387. Closes #4024. Rationale for this change Currently decimal multiplication in DataFusion …
+1,005
−592
•
16
comments
Opened 7 other pull requests in 2 repositories
apache/arrow-datafusion
5
merged
apache/arrow-rs
1
open
1
merged
Reviewed 55 pull requests in 5 repositories
apache/arrow-rs
24 pull requests
- Document ChunkReader (#4118)
- Remove Type from NativeIndex
- Support fixed point multiplication for DictionaryArray of Decimals
- Return BooleanBuffer from BooleanBufferBuilder
- Display the file path in the error message when failed to open credentials file for GCS
- Fix object_store tests with latest aho_corasick
- Fix Docs Typos
- Add ByteArray constructors (#3879)
- optimize cast for same decimal type and same scale
- Increase minimum chrono version to 0.4.24
- Add PrimitiveArray::try_new (#3879)
- Improve JSON decoder errors (#4076)
- Shutdown parquet async writer
- feat: additional data type groups
- Add offsets accessors to variable length arrays (#3879)
- Use BufRead for JSON Schema Inference
- Use reqwest build_split
- Fix object_store CI
- Add RecordBatch::with_schema
- Minor: add methods "is_positive" and "signum" to i256
- Add Fields::contains
- feat: cast from/to interval and duration
- fix: f16::ZERO and f16::ONE are mixed up
- Update tonic 0.9.1
apache/spark
18 pull requests
-
[SPARK-43270][PYTHON] Implement
__dir__()inpyspark.sql.dataframe.DataFrameto include columns - [SPARK-43232][SQL] Improve ObjectHashAggregateExec performance for high cardinality
- [SPARK-43268][SQL] Use proper error classes when exceptions are constructed with a message
- [SPARK-41660][SQL][3.3] Only propagate metadata columns if they are used
- [SPARK-43183][SS] Introduce a new callback "onQueryIdle" to StreamingQueryListener
- [SPARK-40425][SQL] DROP TABLE does not need to do table lookup
- [SPARK-43190][SQL] ListQuery.childOutput should be consistent with child output
- [SPARK-37829][SQL][3.3] Dataframe.joinWith outer-join should return a null value for unmatched row
- [SPARK-37829][SQL] Dataframe.joinWith outer-join should return a null value for unmatched row
- [SPARK-43098][SQL] Fix correctness COUNT bug when scalar subquery has group by clause
- [SPARK-42151][SQL] Align UPDATE assignments with table attributes
-
[SPARK-42382][BUILD] Upgrade
cyclonedx-maven-pluginto 2.7.6 - [SPARK-43061][CORE][SQL] Introduce PartitionEvaluator for SQL operator execution
-
[SPARK-43069][BUILD] Use
sbt-eclipseinstead ofsbteclipse-plugin -
[SPARK-43021][SQL]
CoalesceBucketsInJoinnot work when using AQE - [SPARK-43051][CONNECTOR] Add option to materialize zero values for fields without presence information
- [SPARK-43030][SQL] Deduplicate relations with metadata columns
- [SPARK-42997][SQL] TableOutputResolver must use correct column paths in error messages for arrays and maps
apache/arrow-datafusion
7 pull requests
- Make decimal multiplication allow precision-loss in DataFusion
- Support DROP SCHEMA statements
- Use arrow kernels for bitwise operations
- Remove temporal to kernels_arrow
- Add test for handling precision overflow when casting from integer to decimal
- Decimal multiply kernel should not cause precision loss
- Add if function support
apache/spark-website
5 pull requests
apache/spark-docker
1 pull request
Created an issue in apache/arrow-rs that received 1 comment
Handle overflow precision when casting from integer to decimal
Describe the bug Although cast kernel uses CastOptions when casting from integer to decimal, its behavior on overflow-checking is incomplete.
For n…
1
comment




