fix(deps): update dependency org.apache.pulsar:pulsar-client-original to v4 #603
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
3.3.2
->4.0.0
Release Notes
apache/pulsar (org.apache.pulsar:pulsar-client-original)
v4.0.0
2024-10-21
Changes in 4.0.0 release since 3.3.0 release preparation was started.
For the complete list, check the full changelog and full PR list.
What's New in Apache Pulsar 4.0? covers topics such as:
PIPs accepted since 3.0.0 release
PIPs accepted in 4.0.0 release
PIPs accepted in 3.3.0 release
PIPs accepted in 3.2.0 release
PIPs accepted in 3.1.0 release
Library updates and dependency changes
Broker
[feat] PIP-352: Event time based compaction (#22517)
[feat][broker] PIP-264: Add OpenTelemetry broker connection metrics (#22931)
[feat][broker] PIP-264: Add OpenTelemetry broker replicator metrics (#22972)
[feat][broker] PIP-264: Add OpenTelemetry consumer metrics (#22693)
[feat][broker] PIP-264: Add OpenTelemetry managed cursor metrics (#23000)
[feat][broker] PIP-264: Add OpenTelemetry managed ledger metrics (#22987)
[feat][broker] PIP-264: Add OpenTelemetry metadata store stats (#22952)
[feat][broker] PIP-264: Add OpenTelemetry producer metrics (#22882)
[feat][broker] PIP-264: Add broker web executor metrics (#22816)
[feat][broker] PIP-264: Add managed ledger cache metrics (#22898)
[feat][broker] PIP-264: Add replication subscription stats (#23026)
[feat][broker] PIP-264: Add schema registry metrics (#22624)
[feat][broker] PIP-264: Add transaction metrics (#22970)
[feat][broker] PIP-264: Enable OpenTelemetry reusable data memory mode (#22914)
[feat][broker] PIP-321 Introduce allowed-cluster at the namespace level (#22378)
[feat][broker] PIP-368: Support lookup based on the lookup properties (#23223)
[feat][client] PIP-374: Visibility of messages in receiverQueue for the consumers (#23303)
[feat][misc] PIP-264: Add OpenTelemetry HTTP rate limiting filter metric (#23042)
[feat][misc] PIP-264: Add OpenTelemetry authentication and token metrics (#23016)
[feat][misc] PIP-264: Add OpenTelemetry messaging rate limit metrics (#23035)
[feat][misc] PIP-264: Copy OpenTelemetry resource attributes to Prometheus labels (#23005)
[improve][broker] PIP-327: Support force topic loading for unrecoverable errors (#21759)
[improve][broker] PIP-347: Add role field in consumer's stat (#22562)
[improve][broker] PIP-355: Enhancing Broker-Level Metrics for Pulsar (#22779)
[improve][broker] PIP-356 Support Geo-Replication starts at earliest position (#22856)
[improve][broker] PIP-357: Correct the conf name in load balance module. (#22824)
[improve][broker] PIP-358: let resource weight work for OverloadShedder, LeastLongTermMessageRate, ModularLoadManagerImpl. (#22888)
[improve][broker] PIP-360 Add admin API to display Schema metadata (#22938)
[improve][broker] PIP-364: Introduce a new load balance algorithm AvgShedder (#22949)
[improve][broker] PIP-366: Support to specify different config for Configuration and Local Metadata Store (#23041)
[improve][broker] PIP-376: Make topic policies service pluggable (#23319)
[improve][broker] PIP-379: Enable the use of the classic implementation of Key_Shared / Shared with feature flag (#23424)
[improve][broker] PIP-379: Key_Shared Draining Hashes for Improved Message Ordering (#23352)
[improve][broker] PIP-379: Snapshot hash range assignments only in AUTO_SPLIT ordered mode (#23423)
[improve][broker] PIP-383: Support granting/revoking permissions for multiple topics (#23372)
[improve][broker] Phase 1 of PIP-370 support disable create topics on remote cluster through replication (#23169)
[improve][broker] Part 2 of PIP-370: add metrics "pulsar_replication_disconnected_count" (#23213)
[improve][broker] PIP-354: apply topK mechanism to ModularLoadManagerImpl (#22753)
[Fix][broker] Limit replication rate based on bytes (#22674)
[feat] Use producer name and sequence number as fallback key in Key_Shared implementation (#23219)
[fix] Key_Shared mode consumption latency when low traffic (#23340)
[fix] Make operations on
individualDeletedMessages
in lock scope (#22966)[fix] Remove blocking calls from BookieRackAffinityMapping (#22846)
[fix] Removing out of the box option for Java serde in functions (#22832)
[fix] StatsOutputStream: add string write function (#308) (#23227)
[fix][admin] Fix half deletion when attempt to topic with a incorrect API (#23002)
[fix][admin] Tenant AdminRoles can not contains whitespace in the beginning or end. (#22450)
[fix][admin][part-1] Clearly define REST API on Open API (#22774)
[fix][admin][part-2] Clearly define REST API on Open API for Namespaces@v2 (#22775)
[fix][admin][part-3]Clearly define REST API on Open API for Topics (#22782)
[fix][admin][part-4] Clearly define REST API on Open API (#22783)
[fix][broker] Add principal name into info log to enhance analysis and troubleshooting (#23257)
[fix][broker] Allow broker to handle non-recoverable schema error only if SchemaLedgerForceRecovery flag is enabled (#23428)
[fix][broker] Asynchronously return brokerRegistry.lookupAsync when checking if broker is active(ExtensibleLoadManagerImpl only) (#22899)
[fix][broker] Avoid introducing delay when there are delayed messages or marker messages (#23343)
[fix][broker] Avoid orphan ledgers in BucketDelayedDeliveryTracker (#22802)
[fix][broker] Can't connecte to non-persist topic when enable broker client tls (#22991)
[fix][broker] Cancel possible pending replay read in cancelPendingRead (#23384)
[fix][broker] Check the markDeletePosition and calculate the backlog (#22947)
[fix][broker] Do not try to clean owned bundles from inactive source brokers (ExtensibleLoadManagerImpl only) (#23064)
[fix][broker] Ensure that PulsarService is ready for serving incoming requests (#22977)
[fix][broker] EntryFilters fix NoClassDefFoundError due to closed classloader (#22767)
[fix][broker] Execute the pending callbacks in order before ready for incoming requests (#23266)
[fix][broker] Fail fast if the extensible load manager failed to start (#23297)
[fix][broker] Fix 'Disabled replicated subscriptions controller' logic and logging (#23142)
[fix][broker] Fix AvgShedder strategy check (#23156)
[fix][broker] Fix Broker was failing to create producer with broken schema ledger (#23395)
[fix][broker] Fix Broker was failing to load stats-internal with broken schema ledger (#22845)
[fix][broker] Fix MessageDeduplication replay timeout cause topic loading stuck (#23004)
[fix][broker] Fix NPE after publishing a tombstone to the service unit channel (#22859)
[fix][broker] Fix ProducerBusy issue due to incorrect userCreatedProducerCount on non-persistent topic (#22685)
[fix][broker] Fix ack hole in cursor for geo-replication (#20931)
[fix][broker] Fix authenticate order in AuthenticationProviderList (#23111)
[fix][broker] Fix broker OOM when upload a large package. (#22989)
[fix][broker] Fix brokers still retry start replication after closed the topic (#23237)
[fix][broker] Fix compatibility issues for PIP-344 (#23136)
[fix][broker] Fix configurationMetadataSyncEventTopic is marked supporting dynamic setting, but not implemented (#22684)
[fix][broker] Fix cursor should use latest ledger config (#22644)
[fix][broker] Fix delivery-test with unnecessary invocation-count (#23399)
[fix][broker] Fix doc of ThresholdShedder and remove useless method. (#22798)
[fix][broker] Fix geo-replication admin client url (#22584)
[fix][broker] Fix incomplete NAR file extraction which prevents broker from starting (#23274)
[fix][broker] Fix namespace unload might be blocked too long with extensible load manager (#23433)
[fix][broker] Fix nothing changed after removing dynamic configs (#22673)
[fix][broker] Fix out-of-order issues with ConsistentHashingStickyKeyConsumerSelector (#23327)
[fix][broker] Fix retry backoff for PersistentDispatcherMultipleConsumers (#23284)
[fix][broker] Fix shadow topics cannot be consumed when the entry is not cached (#23147)
[fix][broker] Fix stuck when enable topic level replication and build remote admin fails (#23028)
[fix][broker] Fix system topic can not be loaded up if it contains data offloaded (#23279)
[fix][broker] Fix the broker registering might be blocked for long time (#23371)
[fix][broker] Fix the broker registery cannot recover from the metadata node deletion (#23359)
[fix][broker] Fix the bug that elected leader thinks it's a follower (#23138)
[fix][broker] Fix thread unsafe access on the bundle range cache for load manager (#23217)
[fix][broker] Fix topic policies cannot be queried with extensible load manager (#23326)
[fix][broker] Fix topic status for oldestBacklogMessageAgeSeconds continuously increases even when there is no backlog. (#22907)
[fix][broker] Fix typo in PersistentTopicsBase (#22904)
[fix][broker] Fix typos in pulsar-broker and tiered-storage. (#23415)
[fix][broker] Fix unloadNamespaceBundlesGracefully can be stuck with extensible load manager (#23349)
[fix][broker] Fix updatePartitionedTopic when replication at ns level and topic policy is set (#22971)
[fix][broker] Handle BucketDelayedDeliveryTracker recover failed (#22735)
[fix][broker] Handle the case when
getOwnedServiceUnits
fails gracefully (#23119)[fix][broker] Immediately tombstone Deleted and Free state bundles (#22743)
[fix][broker] Internal reader of __change_events can not started after metadata store session rebuilt (#23018)
[fix][broker] Introduce the last sent position to fix message ordering issues in Key_Shared (PIP-282) (#21953)
[fix][broker] Let Pending ack handler can retry to init when encounters a metadata store error (#23153)
[fix][broker] Make ExtensibleLoadManagerImpl.getOwnedServiceUnits async (#22727)
[fix][broker] Messages lost on the remote cluster when using topic level replication (#22890)
[fix][broker] Partitioned shadow topic not work properly (#22797)
[fix][broker] PulsarStandalone started with error if --stream-storage-port is not 4181 (#22993)
[fix][broker] Remove blocking calls from Subscription.getStats (#23088)
[fix][broker] Replication stuck when partitions count between two clusters is not the same (#22983)
[fix][broker] Skip reading entries from closed cursor. (#22751)
[fix][broker] Support advertised listeners when gracefully transferring topics (ExtensibleLoadManagerImpl only) (#22862)
[fix][broker] Support large number of unack message store for cursor recovery (#9292)
[fix][broker] The topic might reference a closed ledger (#22860)
[fix][broker] Topic can never be loaded up due to broker maintains a failed topic creation future (#23184)
[fix][broker] Update init and shutdown time and other minor logic (ExtensibleLoadManagerImpl only) (#22930)
[fix][broker] broker log a full thread dump when a deadlock is detected in healthcheck every time (#22916)
[fix][broker] disable loadBalancerDirectMemoryResourceWeight by default (#22821)
[fix][broker] disable loadBalancerMemoryResourceWeight by default (#22820)
[fix][broker] fix can not cleanup heartbeat data if scaling down broker (#22750)
[fix][broker] fix compile error for PersistentStickyKeyDispatcherMultipleConsumers (#23055)
[fix][broker] fix deadlock when disable topic level Geo-Replication (#22738)
[fix][broker] fix exception may hidden and result in stuck when topic loading (#23102)
[fix][broker] fix pulsar-admin topics stats-internal caused a BK client thread a deadlock (#23258)
[fix][broker] fix replicated namespaces filter in filterAndUnloadMatchedNamespaceAsync (#23100)
[fix][broker] fix replicated subscriptions for transactional messages (#22452)
[fix][broker] fix the log format error in the AdminResource (#23278)
[fix][broker] fix topic partitions was expanded even if disabled topic level replication (#22769)
[fix][broker] fix typo and useless local variable. (#22704)
[fix][broker] fix unload bundle count metric. (#22895)
[fix][broker] maintain last active info in memory only. (#22794)
[fix][broker] normalize path (#23438)
[fix][broker] rename to changeMaxReadPositionCount (#22656)
[fix][broker] replace loadSheddingPipeline with loadSheddingStrategy. (#22786)
[fix][broker] response not-found error if topic does not exist when calling getPartitionedTopicMetadata (#22838)
[fix][broker] support peek-message for compressed and encrypted messages (#23234)
[fix][broker] timeout when broker registry hangs and monitor broker registry (ExtensibleLoadManagerImpl only) (#23382)
[fix][broker] topics failed to delete after remove cluster from replicated clusters set and caused OOM (#23360)
[fix][broker] type cast on exceptions in exceptionally can lead to lost calls (#23117)
[fix][broker] usedLocallySinceLastReport should always be reset (#22672)
[fix][broker] fix irregular method name (#23108)
[fix][broker] A failed consumer/producer future in ServerCnx can never be removed (#23123)
[fix][broker] Fix lookupService.getTopicsUnderNamespace can not work with a quote pattern (#23014)
[fix][meta] Check if metadata store is closed in RocksdbMetadataStore (#22852)
[fix][meta] Oxia metadta store: Convert error to MetadataStoreException if operation failed (#23154)
[fix][ml] Add entry fail due to race condition about add entry failed/timeout and switch ledger (#22221)
[fix][ml] Fix race conditions in RangeCache (#22789)
[fix][ml] Managed ledger should recover after open ledger failed (#23368)
[fix][ml] Remove duplicated field initialization of ML (#22676)
[fix][ml] Remove unnecessary return in ManagedLedgerImpl (#23418)
[fix][ml]Fix subscription props could be lost in case of missing ledger during recovery (#22637)
[fix][ml][PIP-327] fix recover from ledger when ledgerForceRecovery is true (#23426)
[fix][offload] Break the fillbuffer loop when met EOF (#22722)
[fix][offload] Fix OOM in tiered storage, caused by unbounded offsets cache (#22679)
[fix][schema] Error checking schema compatibility on a schema-less topic via REST API (#22720)
[improve][admin] PIP-369 Change default value of
unload-scope
inns-isolation-policy set
(#23253)[improve][admin] PIP-369 Introduce
unload
flag inns-isolation-policy set
call (#23120)[improve][broker] Add ServiceUnitStateTableView (ExtensibleLoadManagerImpl only) (#23301)
[improve][broker] Add additionalSystemCursorNames ignore list for TTL check (#22614)
[improve][broker] Add callback parameters to the SendCallback.sendComplete (#23196)
[improve][broker] Add limits for Key_Shared Subscription look ahead in dispatching (#23231)
[improve][broker] Add log to track issue when
handleGetTopicsOfNamespace
(#23434)[improve][broker] Add retry for start service unit state channel (ExtensibleLoadManagerImpl only) (#23230)
[improve][broker] Add subscription prefix for internal reader (#23044)
[improve][broker] Avoid subscription fenced error with consumer.seek whenever possible (#23163)
[improve][broker] Check max producers/consumers limitation first before other ops to save resources (#23074)
[improve][broker] Clear thread local BrokerEntryMetadata instance before reuse (#22752)
[improve][broker] Close protocol handlers before unloading namespace bundles (#22728)
[improve][broker] Decouple ManagedLedger interfaces from the current implementation (#23311)
[improve][broker] Do not call cursor.isCursorDataFullyPersistable if disabled dispatcherPauseOnAckStatePersistentEnabled (#22729)
[improve][broker] Don't use "recently joined consumers" rules for Key_Shared in STICKY mode (#23275)
[improve][broker] Explicitly close LB internal topics when playing a follower (ExtensibleLoadManagerImpl only) (#23144)
[improve][broker] Fail fast when it failed to create LoadSheddingStrategy instance (#22827)
[improve][broker] GetPartitionMetadata fail also can produce messages (#23050)
[improve][broker] Improve CPU resources usege of TopicName Cache (#23052)
[improve][broker] Improve exception for topic does not have schema to check (#22974)
[improve][broker] Improve pulsar_topic_load_failed metric to record correct failed time (#23199)
[improve][broker] Make cluster metadata init command support metadata config path (#23269)
[improve][broker] Optimize PersistentTopic.getLastDispatchablePosition (#22707)
[improve][broker] Optimize high CPU usage when consuming from topics with ongoing txn (#23189)
[improve][broker] Optimize message payload traffic for ShadowReplicator (#23236)
[improve][broker] Optimize performance for checking max topics when the topic is a system topic (#23185)
[improve][broker] Optimize the performance of individual acknowledgments (#23072)
[improve][broker] Reduce number of OpenTelemetry consumer attributes (#22837)
[improve][broker] Reduce the CPU pressure from the transaction buffer in rolling restarts (#23062)
[improve][broker] Reducing the parse of MessageMetadata in compaction (#23285)
[improve][broker] Register the broker to metadata store without version id compare (#23298)
[improve][broker] Remove ClassLoaderSwitcher to avoid objects allocations and consistent the codestyle (#22796)
[improve][broker] Remove ConcurrentOpenHashMap and ConcurrentOpenHashSet (#23329)
[improve][broker] Remove unused method CompactionRecord.reset (#22670)
[improve][broker] Replace ConcurrentOpenHashMap with ConcurrentHashMap in BrokerService (#23320)
[improve][broker] Replace ConcurrentOpenHashMap with ConcurrentHashMap in Topic classes (#23322)
[improve][broker] Reschedule reads with increasing backoff when no messages are dispatched (#23226)
[improve][broker] Reuse topic OpenTelemetry attributes (#22876)
[improve][broker] Should notify bundle ownership listener onLoad event when ServiceUnitState start (ExtensibleLoadManagerImpl only) (#23152)
[improve][broker] Support customized shadow managed ledger implementation (#23179)
[improve][broker] Support to specify auth-plugin, auth-parameters and tls-enable arguments when init cluster metadata (#23087)
[improve][broker] Trigger offload on topic load (#22652)
[improve][broker] Use RoaringBitmap in tracking individual acks to reduce memory usage (#23006)
[improve][broker] avoid creating new objects when intercepting (#22790)
[improve][broker] check system topic is used before configuring system topic (ExtensibleLoadManagerImpl only) (#23381)
[improve][broker] don't do load shedding when metadata service not available (#23040)
[improve][broker] high CPU usage caused by list topics under namespace (#23049)
[improve][broker] log exception in MessageDeduplication#takeSnapshot (#22994)
[improve][broker] make system topic distribute evenly. (#22953)
[improve][broker] Change the log level to reduce repeated error logs (#23192)
[improve][broker] Ensure namespace deletion doesn't fail (#22627)
[improve][broker]Reuse method getAvailableBrokersAsync (#23099)
[improve][broker][PIP-379] Add observability stats for "draining hashes" (#23429)
[improve][broker][PIP-379] Don't replace a consumer when there's a collision (#23441)
[improve][broker][PIP-379] Improve hash collision handling by restoring consumer when other leaves (#23447)
[improve][misc] Replace dependencies on PositionImpl with Position interface (#22891)
[improve][broker][PIP-384] Decouple Bookkeeper client from ManagedLedgerStorage and enable multiple ManagedLedgerFactory instances (#23313)
[improve][broker][break change] Do not create partitioned DLQ/Retry topic automatically (#22705)
[cleanup][broker] Remove PersistentSubscription.getStats (#23095)
[cleanup][broker] Remove warn logs when changing the state from Owned to Free (Extensible LB) (#22708)
[cleanup][broker] delete ConcurrentSortedLongPairSet. (#23202)
[cleanup][broker] remove DeviationShedder. (#22800)
[improve] Allow to construct Oxia metadata-store directly from a client instance (#22756)
[improve] Refactored BK ClientFactory to return futures (#22853)
[improve][meta] Fix invalid use of drain API and race condition in closing metadata store (#22585)
[improve][ml] RangeCache refactoring follow-up: use StampedLock instead of synchronized (#22818)
[improve][ml] RangeCache refactoring: test race conditions and prevent endless loops (#22814)
[improve][offload] Allow to disable the managedLedgerOffloadDeletionLagInMillis (#22689)
[improve][offload] Replace usage of shaded class in OffsetsCache (#22683)
[improve][schema] Improve Incompatible Schema Exception error message in ServerCnx.java (#23344)
[improve][txn] Take first snapshot before persisting the first transactional message (#21406)
Observability
Client
beforeConsume
for MultiTopicConsumer (#23141)Configuration
📅 Schedule: Branch creation - "after 10pm" in timezone Europe/Prague, Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.