Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Convert the evaluation from Redis pubsub to Redis Streams #677

Merged
merged 8 commits into from
Oct 7, 2024
Merged

Convert the evaluation from Redis pubsub to Redis Streams #677

merged 8 commits into from
Oct 7, 2024

Commits on Sep 10, 2024

  1. Updates to the job queuing and reading mechanism for evaluations to f… 

    …low through a redis queue rather than a redis pubsub
    @christophertubbs
    christophertubbs committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    95609c2 View commit details
    Browse the repository at this point in the history

  2. Refactored some of the stream handling code to simplify runner.py

    @christophertubbs
    christophertubbs committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    c8ea07a View commit details
    Browse the repository at this point in the history

  3. Updated the error counter to clear errors if they haven't occurred re… 

    …cently and added event handling to ensure that functions are when too many errors are hit. Fixed the parameters for the cleanup function and the return code for interrupt exits and added extra handling for keyboard interrupts that weren't being respected.
    @christophertubbs
    christophertubbs committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    7653041 View commit details
    Browse the repository at this point in the history

  4. Merged with the master branch, implemented suggestions such as the re… 

    …moval of an unneeded RLock, added more messaging and error handling, removed the now unncessary TimedOccurenceWatcher, removed unneeded logging configurations that caused extra logging, added handling to the evaluation service logger to ensure that logged messages don't propagate to the root logger, wrote documentation for the runner, and updated the runner to use redis streams instead of redis pubsub.
    @christophertubbs
    christophertubbs committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    4b57229 View commit details
    Browse the repository at this point in the history

  5. Updated pytest.ini to ignore the evaluation service and the gui to av… 

    …oid issues due to django service requirements and fixed a possible issue in the django test script.
    @christophertubbs
    christophertubbs committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    903bf73 View commit details
    Browse the repository at this point in the history

  6. Fixed an issue where logging names were not being used correctly, cho… 

    …se more appropriate messaging levels, and added a more complete resource cleanup mechanism
    @christophertubbs
    christophertubbs committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    fb76c69 View commit details
    Browse the repository at this point in the history

  7. Added a missing dependency, added a requested annotation, and updated… 

    … some version numbers.
    @christophertubbs
    christophertubbs committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    6a5c447 View commit details
    Browse the repository at this point in the history

  8. Fixed whitespace issues

    @christophertubbs
    christophertubbs committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    12cc42f View commit details
    Browse the repository at this point in the history