viirya
Follow
viirya
Follow
Popular repositories
1,063 contributions in the last year
Less
More
Contribution activity
July 2021
Created 8 commits in 2 repositories
Created 1 repository
- viirya/noria Rust
Created a pull request in apache/spark that received 18 comments
[SPARK-36030][SQL] Support DS v2 metrics at writing path
What changes were proposed in this pull request? We add the interface for DS v2 metrics in SPARK-34366. It is only added for reading path, though.…
+229
−39
•
18
comments
Opened 10 other pull requests in 3 repositories
apache/spark
6
closed
- [SPARK-35785][SS][FOLLOWUP] Remove ignored test from RocksDBSuite
- [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite
- [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite
- [SPARK-36109][SS][TEST] Check data after adding data to topic in KafkaSourceStressSuite
- [SPARK-35829][SQL][FOLLOWUP] Use subExprCode to avoid duplicate call of addNewFunction
- [SPARK-35785][SS][FOLLOWUP] Ignore concurrent update and cleanup test
delta-io/delta-rs
3
merged
apache/hive
1
open
Reviewed 41 pull requests in 2 repositories
apache/spark 38 pull requests
- [SPARK-36136][SQL][TESTS] Refactor PruneFileSourcePartitionsSuite etc to a different package
- [SPARK-36184][SQL] Use ValidateRequirements instead of EnsureRequirements to skip AQE rules that adds extra shuffles
- [SPARK-36194][SQL] Remove the aggregation from left semi/anti join if the same aggregation has already been done on left side
- [SPARK-35785][SS][FOLLOWUP] Remove ignored test from RocksDBSuite
- [SPARK-36128][SQL] Apply spark.sql.hive.metastorePartitionPruning for non-Hive tables that uses Hive metastore for partition management
- [SPARK-34893][SS] Support session window natively
- [SPARK-35972][SQL][3.1] When replace ExtractValue in NestedColumnAliasing we should use semanticEquals
- [SPARK-36137][SQL] HiveShim should fallback to getAllPartitionsOf even if directSQL is enabled in remote HMS
- [SPARK-36164][INFRA][FOLLOWUP] Add empty string check back
- [SPARK-36165][INFRA] Fix SQL doc generation in GitHub Action
- [SPARK-36157][SQL][SS] TimeWindow expression: apply filter before project
-
[SPARK-28266][SQL] convertToLogicalRelation should not interpret
pathproperty when reading Hive tables - [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently
- [SPARK-36123][SQL] Parquet vectorized reader doesn't skip null values correctly
- [SPARK-34891][SS] Introduce state store manager for session window in streaming query
- [SPARK-36109][SS][TEST] Check data after adding data to topic in KafkaSourceStressSuite
- [SPARK-35829][SQL][FOLLOWUP] Use subExprCode to avoid duplicate call of addNewFunction
- [SPARK-35829][SQL] Clean up evaluates subexpressions and add more flexibility to evaluate particular subexpressoin
- [SQL][MINOR] EquivalentExpressions.commonChildrenToRecurse should skip CodegenFallback
- Revert "[SPARK-35253][SPARK-35398][SQL][BUILD] Bump up the janino version to v3.1.4"
- [SPARK-35861][SS] Introduce "prefix match scan" feature on state store
- [SPARK-36073][SQL] EquivalentExpressions fixes and improvements
- [SPARK-36032][SQL] Use inputPlan instead of currentPhysicalPlan to initialize logical link
- [SPARK-35874][SQL] AQE Shuffle should wait for its subqueries to finish before materializing
- [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider
- Some pull request reviews not shown.