Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

OSS Sync | Sun Jul 16 08:32:17 UTC 2023 #563

Open
wants to merge 28 commits into
base: master
Choose a base branch
from
Open

OSS Sync | Sun Jul 16 08:32:17 UTC 2023 #563

wants to merge 28 commits into from

Commits on Jul 16, 2023

  1. Ds scalafmt (#32485) 

    * format: data streams/

* format: iptf/

GitOrigin-RevId: a31eb0dc0eaff014511665e52497dea67a3f9ff1
    @leonbur @wix-oss
    leonbur authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    f6a505e View commit details
    Browse the repository at this point in the history

  2. Remove unused test deps (#33323) 

    * Remove unused test deps

* Remove unused imports

* Add runtime deps

* Initial cross-repo check

* Updating cross-repo check

* Updating cross-repo check

* Updating cross-repo check

---------

Co-authored-by: wixapiregistry <[email protected]>
GitOrigin-RevId: bd83b6b6f4ca9706f6b9e0f247a8cac8bd3f1292
    @wixapiregistry @wix-oss
    2 people authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    024f76d View commit details
    Browse the repository at this point in the history

  3. Blocking retries attempts tracking fix (#32757) 

    * Blocking retries attempts tracking fix #pr

* Factored out RetryAttempt logic, TODO tests

* Added RetryAttemptTest

* Reverted RetryHeader back

* Fixed retry test

GitOrigin-RevId: 7e0e8cbccdd4c5fe6446775262b6695697785b2b
    @atamurius @wix-oss
    atamurius authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    e0f2ba7 View commit details
    Browse the repository at this point in the history

  4. Revert "Blocking retries attempts tracking fix" (#33818) 

    Revert "Blocking retries attempts tracking fix (#32757)"

This reverts commit 7e0e8cbccdd4c5fe6446775262b6695697785b2b.

GitOrigin-RevId: eb859fcf70860c06a0bd0492b746ed3ff00bc8ac
    @natansil @wix-oss
    natansil authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    1292320 View commit details
    Browse the repository at this point in the history

  5. [greyhound] remove internal topic creation - wix adapter (#33820) 

    not create retry topics inside RecordConsumer builder, from wix adapter (it's already created). Removing last reference to an actual AdminClient in wix-adapter when asking to use proxy.

GitOrigin-RevId: fb1416141b6b05559b1b606576cc03556b6a78f4
    @berman7 @wix-oss
    berman7 authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    779acdd View commit details
    Browse the repository at this point in the history

  6. [greyhound] parallel consumer OffsetsAndGaps (#33605) 

    GitOrigin-RevId: f178c94663c7cbcb22bd7266c3e15919d8997d8c
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    84f38bd View commit details
    Browse the repository at this point in the history

  7. Blocking retries attempts tracking fix + fix transitive header bug (#… 

    …33827)

* Revert "Revert "Blocking retries attempts tracking fix" (#33818)"

This reverts commit eb859fcf70860c06a0bd0492b746ed3ff00bc8ac.

* fix bug on retryAttempt resolution - ignore propagated headers

* CR change

* fix test. change retry name to correctly structured one

GitOrigin-RevId: 53fb7cf3efa315f496a00ade574397e30f20eeaf
    @natansil @wix-oss
    natansil authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    a6ac30b View commit details
    Browse the repository at this point in the history

  8. [greyhound] expose internal kafka producer metrics (#34160) 

    GitOrigin-RevId: ab792e2227f389d5642802944a982f3a8d3587d8
    @berman7 @wix-oss
    berman7 authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    facbf92 View commit details
    Browse the repository at this point in the history

  9. [greyhound] Cooperative Rebalance fix (#34153) 

    * [greyhound] code cleanup #pr

* fix for paused partitions unrevoked in cooperative

GitOrigin-RevId: 7cf8fe80c2ac9108b3ebe72472355fe73158df9a
    @leonbur @wix-oss
    leonbur authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    7c7e562 View commit details
    Browse the repository at this point in the history

  10. code cleanup (#34171) 

    GitOrigin-RevId: c2a4d2c2de669eff3c98b2277be8502d834de3e4
    @leonbur @wix-oss
    leonbur authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    570205a View commit details
    Browse the repository at this point in the history

  11. [greyhound] parallel consumer implementation (#34061) 

    GitOrigin-RevId: 5c9cc1ea4fcc5935c6f905a5269ac17f6b82c294
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    596bc6c View commit details
    Browse the repository at this point in the history

  12. [gh-consumers-proxy] s3 bridge (#34839) 

    * [gh-consumers-proxy] s3 bridge #pr #skipreview

* .

* .

* .

* .

* .

* .

* .

* .

GitOrigin-RevId: fed83b505e4772a09ae189c6a01ac15368e60600
    @berman7 @wix-oss
    berman7 authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    be4bfc1 View commit details
    Browse the repository at this point in the history

  13. [greyhound] parallel consumer - add visibility (#34908) 

    GitOrigin-RevId: 611f9b35285657e84dfaf69cf2af1744b54672e8
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    141c7a6 View commit details
    Browse the repository at this point in the history

  14. [greyhound] parallel consumer visibility (#34926) 

    GitOrigin-RevId: 3cbafbea85e93a678fc7528f1b3f4bb75514b9f2
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    57343a5 View commit details
    Browse the repository at this point in the history

  15. [greyhound] parallel consumer - add offsets and gaps init (#35027) 

    GitOrigin-RevId: fe53459fd02e8e627356cbe68d71e4d4bc6b3d24
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    e0260ad View commit details
    Browse the repository at this point in the history

  16. [greyhound] parallel consumer - add grouping for no-key records (#35071) 

    GitOrigin-RevId: 9e6dc2bb61a9b56aa55640567702ecb66c67563a
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    a5a1bec View commit details
    Browse the repository at this point in the history

  17. make GreyhoundNG RetryConfig serializable (so can be sent over gRpc a… 

    …nd persisted) (#35207)

* make GreyhoundNG RetryConfig serializable (so can be sent over gRpc and persisted) #pr

* fix lp build

* full cross-repo

* Initial cross-repo check

* Updating cross-repo check

* Updating cross-repo check

* Updating cross-repo check

* Updating cross-repo check

* CR changes

---------

Co-authored-by: wixapiregistry <[email protected]>
GitOrigin-RevId: feaf45b3c77f9074a3445bffdd6f748d3df77056
    @natansil @wixapiregistry @wix-oss
    2 people authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    8de7d3e View commit details
    Browse the repository at this point in the history

  18. multi-tenant consumer proxy redesign - initial commit (#35244) 

    GitOrigin-RevId: e7a2532372964be70c34350951ca99bfc52f7684
    @berman7 @wix-oss
    berman7 authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    5111d43 View commit details
    Browse the repository at this point in the history

  19. [greyhound] parallel consumer - add gaps limit (#35313) 

    GitOrigin-RevId: af1fd4bede9f00146454b2f28657bc1c845ae682
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    c500ec9 View commit details
    Browse the repository at this point in the history

  20. Fixes in preparation for ZIO 2.0.15 (#35320) 

    * batch event loop fix

* fix worker timeout interruption. cleanup code

GitOrigin-RevId: 31023194ccc982dfe8720620bfbfe26dc274918c
    @leonbur @wix-oss
    leonbur authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    d7dfb03 View commit details
    Browse the repository at this point in the history

  21. [greyhound-consumer-proxy] start from latest offset when group doesn'… 

    …t exist (temporary until full config is done) (#35428)

* [greyhound-consumer-proxy] start from latest offset when group doesn't exist (temporary until full config is done) #automerge #skipreview

* .

GitOrigin-RevId: 34b953997eee3d167bb2beb23d50045daf03460f
    @berman7 @wix-oss
    berman7 authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    c50eb4c View commit details
    Browse the repository at this point in the history

  22. [greyhound] parallel consumer - compression and encoding for gaps lim… 

    …it (#35423)

GitOrigin-RevId: 10b761cb8fcd926178aebf586e99ed1a8829c734
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    1e98ca6 View commit details
    Browse the repository at this point in the history

  23. greyhound proxy non blocking retries (#35456) 

    * greyhound proxy retry: API + failing test + gh side

* extract and unit test current state

* remainder

* fix UT

* fix ITs

* try with increasing eventually

GitOrigin-RevId: e60cbb04d6d6b603e22954bbe4a8658ef594712a
    @natansil @wix-oss
    natansil authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    bbe27cf View commit details
    Browse the repository at this point in the history

  24. new kafka monitor server for proxy (currently) (#35598) 

    * new kafka monitor server for proxy (currently) #automerge #skipreview

* .

* .

* .

GitOrigin-RevId: 156ff1cbde2b11cfb35259600de00b47e1012367
    @berman7 @wix-oss
    berman7 authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    fe05e49 View commit details
    Browse the repository at this point in the history

  25. [greyhound] fix OffsetsInitializer metadata bug (#35684) 

    GitOrigin-RevId: d9758275c502278ed9fd845b3781cd92b7152f8a
    @ben-wattelman @wix-oss
    ben-wattelman authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    4262e58 View commit details
    Browse the repository at this point in the history

  26. ConsumerIT: add a test: allow to override offsetReset with autoResetO… 

    …ffset from extra properties (#35845)

ConsumerIT: add a test: allow to override offsetReset with autoResetOffset from extra properties #automerge
GitOrigin-RevId: a9159b9c15445daa243e84a0b4bcaeae8db8b29d
    @natansil @wix-oss
    natansil authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    a0f7288 View commit details
    Browse the repository at this point in the history

  27. gh RecordConsumer - add visibility to extra properties setup with aut… 

    …o.offset.reset (#35848)

GitOrigin-RevId: 7b878399acd1e25003ccae071e817ed22b2fba21
    @natansil @wix-oss
    natansil authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    39d1576 View commit details
    Browse the repository at this point in the history

  28. gh RecordConsumer - allow to override offsetReset with autoResetOffse… 

    …t from extra properties taking into account a non-zero rewindUncommittedOffsetsBy (#35863)

* gh RecordConsumer - allow to override offsetReset with autoResetOffset from extra properties taking into account a non-zero rewindUncommittedOffsetsBy #automerge

* fix tests depending on com.wixpress.greyhound.GreyhoundTestingSupport

* try another tactic to fix tests

* fix build file #automerge

GitOrigin-RevId: dcf84b5740a3f99e1a637fca84c0ef6059b0e1a9
    @natansil @wix-oss
    natansil authored and wix-oss committed Jul 16, 2023
    Configuration menu
    Copy the full SHA
    02064fc View commit details
    Browse the repository at this point in the history