apache / flink Public

60 Pull requests merged by 28 people

• [FLINK-26994][ci] Merge Core/Libraries CI profiles

  #19337 merged Apr 2, 2022

• [FLINK-26739] Support Hive 2.3.8 and 2.3.9

  #19167 merged Apr 2, 2022

• [FLINK-26961][connectors][filesystems][formats] Update multiple Jacks…

  #19303 merged Apr 1, 2022

• [FLINK-26931][Connector/pulsar] Make the producer name and consumer name unique in Pulsar

  #19285 merged Apr 1, 2022

• [FLINK-26797][BP-1.14][runtime] Hardens ZKCheckpointIDCounterMultiServersTest

  #19320 merged Apr 1, 2022

• [FLINK-26797][BP-1.15][runtime] Hardens ZKCheckpointIDCounterMultiServersTest

  #19319 merged Apr 1, 2022

• [FLINK-26797][runtime] Hardens ZKCheckpointIDCounterMultiServersTest

  #19199 merged Apr 1, 2022

• [hotfix][test-utils-junit] Improve assertion errors

  #19185 merged Apr 1, 2022

• [FLINK-23399][state] Add a benchmark for rescaling

  #19177 merged Apr 1, 2022

• [hotfix][doc]There is a link redirection problem in the Chinese document of ‘custom_serialization’

  #18190 merged Apr 1, 2022

• [BP-1.15][FLINK-26928][connector/kafka] Remove unnecessary docker network creation in tests and close network on shutdown()

  #19296 merged Apr 1, 2022

• [FLINK-26798][1.14][runtime] Hardens test against unexpected heartbeat

  #19294 merged Apr 1, 2022

• [FLINK-26798][BP-1.15][runtime] Hardens JobManagerTest against unexpected heartbeat

  #19293 merged Apr 1, 2022

• [FLINK-26798][runtime] Hardens test against unexpected heartbeat

  #19195 merged Apr 1, 2022

• [BACKPORT 1.14]: [FLINK-25440][doc][pulsar] Stop and Start cursor now all uses publish…

  #19289 merged Apr 1, 2022

• [FLINK-11388][docs][oss]Update docs for OSS Recoverable writer

  #19292 merged Apr 1, 2022

• [BACKPORT 1.15][FLINK-25440][doc][pulsar] Stop and Start cursor now all uses publish…

  #19290 merged Mar 31, 2022

• [FLINK-26928][connector/kafka] Remove unnecessary Docker network creation in tests

  #19282 merged Mar 31, 2022

• [hotfix] Fix CsvRowDataDeserializationSchema constructor

  #19288 merged Mar 31, 2022

• [FLINK-26575][checkpoint] Improve the info message when restoring keyed state backend

  #19034 merged Mar 31, 2022

• [hotfix][runtime][tests] Modify spelling error in RestServerSSLAuthITCase.java

  #19265 merged Mar 30, 2022

• [FLINK-25961] [connectors/elasticsearch] Remove transport client from Elasticsearch/7 connectors (tests only)

  #18634 merged Mar 30, 2022

• [FLINK-26923] Do not trigger global failover if failed during commiting side-effects during stop-with-savepoint for adaptive scheduler

  #19281 merged Mar 30, 2022

• [FLINK-26281][BP 1.15][connectors/elasticsearch] Improve documentation

  #19277 merged Mar 30, 2022

• [FLINK-25440][doc][pulsar] Both stopCursor and startCursor now uses publish time instead of event time

  #18345 merged Mar 30, 2022

• [FLINK-25227][BP-1.15][table-planner] Fix LEAST/GREATEST to return primitives

  #19284 merged Mar 30, 2022

• [FLINK-26134][docs] Added table with Checkpoint/Savepoint guarantees …

  #18765 merged Mar 30, 2022

• [FLINK-26885][metrics][tests] Cleanup MetricRegistryImplTest

  #19260 merged Mar 30, 2022

• [FLINK-26887][tests] Drop Jepsen tests

  #19261 merged Mar 30, 2022

• [FLINK-25227][table-planner] Fix LEAST/GREATEST to return primitives

  #19270 merged Mar 30, 2022

• [FLINK-26882][tests] Fix unstable RescaleCheckpointManuallyITCase

  #19276 merged Mar 30, 2022

• [FLINK-26092][table-runtime] Fix `JSON_OBJECTAGG` when emitting `NULL`

  #19249 merged Mar 29, 2022

• [FLINK-25256][streaming] Externally induced sources replay barriers received over RPC instead of inventing them out of thin air.

  #19138 merged Mar 29, 2022

• [FLINK-26281][connectors/elasticsearch] Improve documentation

  #19200 merged Mar 29, 2022

• [hotfix] Fix CsvRowDataDeserializationSchema constructor

  #19255 merged Mar 29, 2022

• [FLINK-26673][changelog] Disable periodic materialization when periodi…

  #19174 merged Mar 29, 2022

• [FLINK-26794][tests] Use API to access job checkpoints in IT cases

  #19256 merged Mar 29, 2022

• [hotfix][doc] Modify spelling error in elastic_scaling.md

  #19266 merged Mar 29, 2022

• [BP-1.14][FLINK-26395][docs] Correct the wrong description of SQL function: RAND_INTEGER

  #19258 merged Mar 29, 2022

• [BP-1.15][FLINK-26395][docs] Correct the wrong description of SQL function: RAND_INTEGER

  #19257 merged Mar 29, 2022

• [Backport 1.15][FLINK-26028] Add pulsar sink documentation

  #19267 merged Mar 29, 2022

• [FLINK-26629][runtime] fix bug in code comment of SubtaskStateMapper.RANGE

  #19078 merged Mar 29, 2022

• [FLINK-26130][docs] Expanded the reason to increase network buffer si…

  #18754 merged Mar 29, 2022

• [FLINK-25256][streaming] Externally induced sources replay barriers received over RPC instead of inventing them out of thin air. [1.15]

  #19214 merged Mar 29, 2022

• [FLINK-26251][akka] Migrate test to JUnit5

  #18848 merged Mar 29, 2022

• [FLINK-26616][tests] Remove deadlines from CommonTestUtils

  #19116 merged Mar 29, 2022

• [FLINK-26028][Connector/pulsar] add sink documentation; change some source documentation

  #19056 merged Mar 29, 2022

• [FLINK-26780][coordination] Add option to force RPC serialization

  #19192 merged Mar 28, 2022

• [FLINK-26851][metrics] Properly model reporter options as ConfigOptions

  #19234 merged Mar 28, 2022

• [FLINK-26850][metrics] Add Metric#getMetricType

  #19231 merged Mar 28, 2022

• [FLINK-26849][metrics] Deduplicate metric (un)registration logic

  #19230 merged Mar 28, 2022

• [hotfix][task] Add task name to BufferDebloater logging

  #19243 merged Mar 28, 2022

• [FLINK-26842][python] Remove scala-bridge dependency

  #19221 merged Mar 28, 2022

• [BP-1.14][FLINK-26018][connector/common] Create per-split output on split addition in SourceOperator

  #19128 merged Mar 28, 2022

• [BP-1.15][FLINK-26018][connector/common] Create per-split output on split addition in SourceOperator

  #19110 merged Mar 28, 2022

• [FLINK-26799][Runtime/StateBackends] fix StateChangeFormat#read and e…

  #19225 merged Mar 28, 2022

• [FLINK-11388][fs] Add Aliyun OSS recoverable writer

  #19072 merged Mar 28, 2022

• [FLINK-26708] TimestampsAndWatermarksOperator should not propagate WatermarkStatus

  #19135 merged Mar 28, 2022

• [FLINK-26395][docs] Correct the wrong description of RAND_INTEGER.

  #19104 merged Mar 27, 2022

• [FLINK-26615][tests] Fix timings in BatchingStateChangeUploadSchedulerTest.testUploadTimeout

  #19063 merged Mar 27, 2022

53 Pull requests opened by 29 people

• [FLINK-26726][connector][hive]Hive enumerators do not assign splits to unregistered (failed) readers.

  #19250 opened Mar 27, 2022

• [hotfix] [docs] fix typos and language in topn example

  #19251 opened Mar 27, 2022

• [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

  #19252 opened Mar 28, 2022

• [hive] support nvl(null, null)

  #19253 opened Mar 28, 2022

• [BP-1.14][hotfix][table-runtime] Fix ArrayDataSerializer null fields writing

  #19254 opened Mar 28, 2022

• [FLINK-23890] impove cep operator timer register policy

  #19259 opened Mar 28, 2022

• [hotfix][table][tests] Improve code - use assertJ

  #19262 opened Mar 28, 2022

• [FLINK-21585][metrics] Add options for in-/excluding metrics

  #19263 opened Mar 28, 2022

• [FLINK-26886][metrics][docs] Documented pull/push tag/identifier reporter behavior

  #19264 opened Mar 28, 2022

• [FLINK-26033][BP-1.14][flink-connector-kafka]Fix the problem that robin does not take effect due to upgrading kafka client to 2.4.1 since Flink1.11

  #19268 opened Mar 29, 2022

• [FLINK-26033][BP-1.13][flink-connector-kafka]Fix the problem that robin does not take effect due to upgrading kafka client to 2.4.1 since Flink1.11

  #19269 opened Mar 29, 2022

• [FLINK-26710] fix TestLoggerResource

  #19272 opened Mar 29, 2022

• [FLINK-25256][streaming] Externally induced sources replay barriers received over RPC instead of inventing them out of thin air. [1.14]

  #19273 opened Mar 29, 2022

• [FLINK-24491][runtime] Make the job termination wait until the archiving of ExecutionGraphInfo finishes

  #19275 opened Mar 30, 2022

• [hotfix][docs] Fix naming to uppercase

  #19278 opened Mar 30, 2022

• [FLINK-25612][docs] Update the outdated illustration of ExecutionState in the documentation

  #19280 opened Mar 30, 2022

• [FLINK-27016][hive] Improve supporting for complex data type for Hive dialect

  #19283 opened Mar 30, 2022

• [FLINK-25931] Add projection pushdown support for CsvFormatFactory

  #19286 opened Mar 30, 2022

• (proposal) [runtime-web] Improve error message rendering

  #19287 opened Mar 30, 2022

• [FLINK-26927][testutils] Improve FlinkContainers to better support JM restarting

  #19291 opened Mar 31, 2022

• [FLINK-26941][cep] Support Pattern end with notFollowedBy with window

  #19295 opened Mar 31, 2022

• [FLINK-26848][JDBC]Support to write data when disable flush-interval and max-rows

  #19297 opened Mar 31, 2022

• [FLINK-27015][hive] Hive dialect supports cast timestamp to decimal implicitly while inserting

  #19298 opened Mar 31, 2022

• [hotfix] [connectors/hbase] Fix equal method of HBaseWriteOptions

  #19300 opened Mar 31, 2022

• [FLINK-17231][kubernetes]When using LB Service, the optimization of returning RestEndpoint

  #19301 opened Mar 31, 2022

• [FLINK-26810][connectors/elasticsearch] Use local timezone for TIMESTAMP_WITH_LOCAL_TIMEZONE fields in dynamic index

  #19302 opened Mar 31, 2022

• [FLINK-26957][runtime] Removes flush in FileSystemJobResultStore.createDirtyResultInternal

  #19304 opened Mar 31, 2022

• [FLINK-21649][state/heap] Allow extension of CopyOnWriteState classes

  #19305 opened Mar 31, 2022

• [FLINK-21783][state/heap] Allow snapshotting customization

  #19306 opened Mar 31, 2022

• [FLINK-21784][state/heap] Allow Restore Operation customization

  #19307 opened Mar 31, 2022

• [FLINK-26963][state/heap] Allow backend creation customization

  #19308 opened Mar 31, 2022

• [FLINK-26964][state/heap] Notify CheckpointStrategy about checkpoint completion/abortion

  #19309 opened Mar 31, 2022

• [FLINK-26967][state/heap] Fix race condition in CopyOnWriteStateMap

  #19310 opened Mar 31, 2022

• [FLINK-26968][state/heap] Bump CopyOnWriteStateMap entry version before write

  #19311 opened Mar 31, 2022

• [FLINK-26965][state] Allow reuse of PeriodicMaterializationManager

  #19312 opened Mar 31, 2022

• [WIP][FLINK-26966][heap/state] Implement incremental checkpoints

  #19313 opened Mar 31, 2022

• [FLINK-27013][hive] Hive dialect supports is_distinct_from

  #19315 opened Apr 1, 2022

• [FLINK-25238][table-runtime] Allow customized types for ArrayDataSerializer#copy

  #19316 opened Apr 1, 2022

• [FLINK-26772][runtime] Add flag to prevent job submission in Dispatcher if shutting down

  #19317 opened Apr 1, 2022

• [FLINK-26757][state] Change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold to 0

  #19324 opened Apr 1, 2022

• [FLINK-26943][table] Add DATE_ADD supported in SQL & Table API

  #19325 opened Apr 1, 2022

• [FLINK-26987][runtime] Fixes getAllAndLock livelock

  #19327 opened Apr 1, 2022

• [FLINK-22318][table] Support RENAME column name for ALTER TABLE statement

  #19329 opened Apr 1, 2022

• [FLINK-14998] [FileSystems] Remove FileUtils#deletePathIfEmpty

  #19330 opened Apr 1, 2022

• [FLINK-26985][runtime] Don't discard shared state of restored checkpoints

  #19331 opened Apr 1, 2022

• [FLINK-26987][BP-1.15][runtime] Fixes getAllAndLock livelock

  #19332 opened Apr 1, 2022

• [FLINK-26190][python] Remove getTableConfig from ExecNodeConfiguration

  #19333 opened Apr 2, 2022

• [FLINK-26998] Remove log-related configuration from predefined options in RocksDB state backend

  #19335 opened Apr 2, 2022

• FLINK-27014][hive] Hive dialect support select null literal in subquery

  #19336 opened Apr 2, 2022

• [FLINK-27006][planner] Support SingleValueAggFunction for Char data type

  #19338 opened Apr 2, 2022

• [FLINK-26961][BP-1.15][connectors][filesystems][formats] Update Jackson Databi…

  #19339 opened Apr 2, 2022

• [FLINK-26961][BP-1.14][connectors][filesystems][formats] Update Jackson Databi…

  #19340 opened Apr 2, 2022

• [FLINK-27024][build] Cleanup surefire configuration

  #19341 opened Apr 2, 2022

47 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [FLINK-25684][table] Support enhanced `show databases` syntax

  #18386 commented on Apr 2, 2022 • 23 new comments

• [FLINK-13785][table] Port time functions to new type inference

  #19190 commented on Mar 31, 2022 • 16 new comments

• [FLINK-25907][runtime][security] Add pluggable delegation token manager

  #18664 commented on Apr 1, 2022 • 14 new comments

• [FLINK-25379][connectors] Support limit push down in DATAGEN connector

  #18151 commented on Apr 2, 2022 • 13 new comments

• [FLINK-8518][Table SQL / API] Add support for extract Epoch

  #18179 commented on Mar 30, 2022 • 11 new comments

• [FLINK-24229][connectors/dynamodb] Added DynamoDB connector

  #18518 commented on Apr 2, 2022 • 9 new comments

• [FLINK-26162][docs]revamp security pages

  #18746 commented on Mar 31, 2022 • 8 new comments

• [FLINK-26835][serialization] Fix concurrent modification exception

  #19219 commented on Apr 2, 2022 • 7 new comments

• [FLINK-26519][table] Remove FlinkTypeFactory singleton

  #19113 commented on Mar 31, 2022 • 6 new comments

• [FLINK-26712][table-planner] Metadata keys should not conflict with physical columns

  #19236 commented on Apr 1, 2022 • 6 new comments

• [FLINK-25686][pulsar]: add schema evolution support for pulsar source connector

  #18406 commented on Mar 31, 2022 • 4 new comments

• [FLINK-25188][python][build] Support m1 chip.

  #18769 commented on Apr 1, 2022 • 3 new comments

• [FLINK-26645][Connector/Pulsar] Fix Pulsar source subscriber consume from all partitions when only subscribed to 1 partition

  #19092 commented on Apr 1, 2022 • 3 new comments

• [FLINK-26182][Connector/pulsar] Create a e2e tests for Pulsar sink.

  #19099 commented on Mar 31, 2022 • 3 new comments

• [FLINK-20628][connectors/rabbitmq2] RabbitMQ connector using new connector API

  #15140 commented on Mar 30, 2022 • 2 new comments

• [FLINK-23719] [connectors/hbase] Support switch WAL in Flink SQL DDL options for HBase sink

  #16859 commented on Apr 2, 2022 • 2 new comments

• [FLINK-19883][table] Support 'IF EXISTS' in DDL for ALTER TABLE

  #17155 commented on Apr 2, 2022 • 2 new comments

• [FLINK-25284][Table SQL / API] Add proportion of null values to generate with datagen

  #18109 commented on Mar 31, 2022 • 2 new comments

• [FLINK-25756] [connectors/opensearch] Dedicated Opensearch connectors

  #18541 commented on Mar 30, 2022 • 2 new comments

• [FLINK-25897][docs] Update gradle quickstart quide to gradle 7.3.3

  #18609 commented on Apr 1, 2022 • 2 new comments

• [FLINK-26027][pulsar] add sink metrics to pulsar sink

  #18816 commented on Apr 1, 2022 • 2 new comments

• [FLINK-26553][build] Configure scalafmt

  #19025 commented on Mar 30, 2022 • 2 new comments

• [FLINK-12639] Expand glossary

  #19107 commented on Mar 31, 2022 • 2 new comments

• [hotfix][test][formats] Detach TableCsvFormatITCase from JsonPlanTestBase

  #19224 commented on Mar 31, 2022 • 2 new comments

• [hotfix][connector/kafka] fix missing nullable annotion in createKafkaTableSink function

  #16571 commented on Mar 29, 2022 • 1 new comment

• [FLINK-24558][API/DataStream]make parent ClassLoader variable which c…

  #17521 commented on Mar 30, 2022 • 1 new comment

• [FLINK-25788][Table SQL / API] Add show connectors command

  #18487 commented on Mar 31, 2022 • 1 new comment

• [FLINK-26033][flink-connector-kafka]Fix the problem that robin does not take effect due to upgrading kafka client to 2.4.1 since Flink1.11

  #18863 commented on Mar 30, 2022 • 1 new comment

• [FLINK-26206][runtime-web] add service layer abstraction and refactor config service

  #18868 commented on Mar 28, 2022 • 1 new comment

• [FLINK-26351][k8s/web ui] After scaling a flink task running on k8s, …

  #18915 commented on Mar 29, 2022 • 1 new comment

• [FLINK-26368] [kafka] Add setProperty method to KafkaSinkBuilder

  #18933 commented on Mar 31, 2022 • 1 new comment

• [FLINK-15854][hive] Use the new type inference for Hive UDTF

  #18958 commented on Apr 2, 2022 • 1 new comment

• [FLINK-26542][hive] fix "schema of both sides of union should match" exception with Hive dialect

  #19017 commented on Apr 2, 2022 • 1 new comment

• [FLINK-25705][docs]Translate "Metric Reporters" page of "Deployment" …

  #19023 commented on Mar 28, 2022 • 1 new comment

• [FLINK-24862][Connectors / Hive][backport]Fix user-defined hive udaf/udtf cannot be used normally in hive dialect for flink1.14

  #19069 commented on Mar 29, 2022 • 1 new comment

• [FLINK-26756][table-planner] Fix the deserialization error for match recognize

  #19179 commented on Mar 28, 2022 • 1 new comment

• [FLINK-26813[SQL-API] Supports ADD/MODIFY column/watermark/constraint syntax parse for ALTER TABLE

  #19193 commented on Mar 28, 2022 • 1 new comment

• [FLINK-6573][Connectors/Common ] Flink MongoDB Connector

  #17847 commented on Mar 31, 2022 • 0 new comments

• [FLINK-24456][Connectors / Kafka,Table SQL / Ecosystem] Support bound…

  #17994 commented on Mar 31, 2022 • 0 new comments

• WIP: [FLINK-XXXXX] Task local recovery for the reactive mode.

  #18238 commented on Apr 1, 2022 • 0 new comments

• FLINK-25762 - [Deployment/kubernetes] Move JVM system properties args after log_settings

  #18447 commented on Mar 31, 2022 • 0 new comments

• [hotfix][connector/pulsar] Fix typo in JavaDocs example.

  #18454 commented on Mar 31, 2022 • 0 new comments

• [hotfix][docs] Fixed error for Hive ZH docs.

  #18499 commented on Mar 30, 2022 • 0 new comments

• [FLINK-26675][runtime] Parallelized heavy serialization in StreamingJ…

  #19108 commented on Mar 28, 2022 • 0 new comments

• [FLINK-27017][hive] hive dialect supports dividing by zero.

  #19216 commented on Apr 2, 2022 • 0 new comments

• hive dialect supports select current database

  #19218 commented on Apr 2, 2022 • 0 new comments

• [FLINK-26788][core] Add cause when AbstractDeserializationSchema throw exception

  #19241 commented on Mar 29, 2022 • 0 new comments