Apache Arrow and Spark Committer
- Seattle
- http://www.viirya.org
Block or Report
Block or report viirya
Report abuse
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abusePopular repositories
-
-
-
-
-
puppet-hadoop Public
Puppet module for deploying Hadoop MapReduce Next Generation (MRv2)
1,073 contributions in the last year
Contribution activity
May 2022
Created 9 commits in 2 repositories
Created a pull request in apache/spark that received 19 comments
[SPARK-39134][SS] Add custom metric of skipped null values for stream join operator
What changes were proposed in this pull request? This proposes to add a custom metric of skipped null values for stream-stream join operator. Why …
+45
−9
•
19
comments
Opened 6 other pull requests in 1 repository
apache/arrow-rs
6
merged
Reviewed 36 pull requests in 4 repositories
apache/arrow-rs
21 pull requests
- Add type ids in Union datatype
-
Minor: Refine
OffsetSizeTraitto extendnum::Integer -
Fix: Null buffer accounts for
offsetinsubstringkernel. - Fix docs.rs build
- support duration in ffi
- Speed up the offsets checking
- fix bench command line options
- Fix generate_unions_case for Rust case
- Enable branch protection
- Add support for nested list arrays from parquet to arrow arrays (#993)
- Add dictionary array support for substring function
-
Rename
OffsetSize::fn is_largetoconst OffsetSize::IS_LARGE - Remove parquet dictionary converters (#1661)
-
Fix
generate_nested_dictionary_caseintegration test failure -
Pretty Print
UnionArrays -
Exclude
dict_idanddict_is_orderedfrom equality comparison ofField -
Remove
StringOffsetTraitandBinaryOffsetTrait -
Add
substringsupport forFixedSizeBinaryArray - Correct arrow-flight readme version
- Do not assume dictionaries exists in footer
- Fix UnionArray is_null
apache/spark
12 pull requests
- [SPARK-36718][SQL][FOLLOWUP] Improve the extract-only check in CollapseProject
- Revert "[SPARK-36837][BUILD] Upgrade Kafka to 3.1.0"
-
[SPARK-36718][SQL][FOLLOWUP] Fix the
isExtractOnlycheck in CollapseProject - [SPARK-39149][SQL] SHOW DATABASES command should not quote database names under legacy mode
- [SPARK-39134][SS] Add custom metric of skipped null values for stream join operator
- [SPARK-38918][SQL][3.2] Nested column pruning should filter out attributes that do not belong to the current relation
-
[SPARK-39124][BUILD] Upgrade
rocksdbjnito 7.1.2 - [SPARK-39106][SQL] Correct conditional expression constant folding
- [SPARK-39117][SQL][TESTS] Do not include number of functions in sql-expression-schema.md
- [SPARK-39105][SQL] Add ConditionalExpression trait
- [MINOR] Remove unused import
- [SPARK-38891][SQL] Skipping allocating vector for repetition & definition levels when possible
apache/spark-website
2 pull requests
apache/arrow-datafusion
1 pull request
Created an issue in apache/arrow-rs that received 1 comment
Keep type ids in Union datatype to follow Arrow spec and integrate with other implementations
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Related to #1404, generate_unions_case integr…
1
comment
Opened 7 other issues in 1 repository
apache/arrow-rs
6
closed
1
open
-
Fix
generate_unions_caseintegration test -
Add
DictionaryArraysupport forbit_lengthkernel -
Add
DictionaryArraysupport forlengthkernel - Add dictionary array support for current kernels
- flight_client_scenarios integration test should receive schema from flight data
-
Exclude dict_id and dict_is_ordered from equality comparison of
Field -
Fix
generate_nested_dictionary_caseintegration test failure for Rust cases