LIU-408: Add support for Python 3.11 and 3.12

[myxie]

This PR adds support for newer Python version, Python3.11 and 3.12.

As Python 3.8 and older version are no longer being maintained, it is useful to make sure we are working with new-er versions that are more likely to be installed on user's machines and shared computing facilities.

Summary by Sourcery

Add support for Python 3.11 and 3.12 by updating dependencies and CI configurations to ensure compatibility with these versions.

New Features:

• Add support for Python 3.11 and 3.12 in the project.

Enhancements:

• Update dependency versions for pyzmq and pydantic to ensure compatibility with Python 3.12.

CI:

• Update CI configuration to include testing for Python 3.11 and 3.12.

[coveralls]

coverage: 79.631% (-0.002%) from 79.633%
when pulling 877c4a4 on LIU-408
into d075337 on master.

[awicenec]

Good that is was so simple!

[sourcery-ai]

Reviewer's Guide by Sourcery

This PR updates the codebase to support Python 3.11 and 3.12 by making necessary dependency updates and modifying the entry points handling code to accommodate different Python versions. The changes include updating package dependencies, modifying the entry points loading mechanism, and extending CI workflow to test against new Python versions.

Sequence diagram for entry points loading mechanism

sequenceDiagram
    participant Tool as Tool
    participant EntryPoints as importlib.metadata.entry_points
    participant Sys as sys

    Tool->>Sys: Check Python version
    alt Python < 3.10
        Tool->>EntryPoints: entry_points()
        loop For each entry point in dlg.tool_commands
            EntryPoints->>Tool: Load and register commands
        end
    else
        Tool->>EntryPoints: entry_points(group="dlg.tool_commands")
        loop For each entry point in dlg.tool_commands
            EntryPoints->>Tool: Load and register commands
        end
    end

Loading

File-Level Changes

Change	Details	Files
Updated entry points handling to support different Python versions	Replaced pkg_resources with importlib.metadata for entry points handling Added version-specific logic to handle entry points differently for Python versions below and above 3.10 Added pylint disable comment for unexpected keyword argument	daliuge-common/dlg/common/tool.py
Extended CI workflow to include Python 3.11 and 3.12 testing	Added new test matrix entries for Python 3.11 and 3.12 Updated description labels to clarify Python versions Maintained full package testing configuration for new versions	.github/workflows/run-unit-tests.yml
Updated package dependencies to ensure compatibility	Upgraded pyzmq from 25.1.0 to 25.1.1 for Python 3.12 support Updated pydantic requirement to version 2.5 or higher Added comment explaining pyzmq version requirement for Python 3.12	daliuge-common/setup.py daliuge-engine/setup.py

---

Tips and commands

Interacting with Sourcery

• Trigger a new review: Comment @sourcery-ai review on the pull request.
• Continue discussions: Reply directly to Sourcery's review comments.
• Generate a GitHub issue from a review comment: Ask Sourcery to create an
  issue from a review comment by replying to it.
• Generate a pull request title: Write @sourcery-ai anywhere in the pull
  request title to generate a title at any time.
• Generate a pull request summary: Write @sourcery-ai summary anywhere in
  the pull request body to generate a PR summary at any time. You can also use
  this command to specify where the summary should be inserted.

Customizing Your Experience

Access your dashboard to:

• Enable or disable review features such as the Sourcery-generated pull request
  summary, the reviewer's guide, and others.
• Change the review language.
• Add, remove or edit custom review instructions.
• Adjust other review settings.

Getting Help

• Contact our support team for questions or feedback.
• Visit our documentation for detailed guides and information.
• Keep in touch with the Sourcery team by following us on X/Twitter, LinkedIn or GitHub.

[sourcery-ai]

Hey @myxie - I've reviewed your changes - here's some feedback:

Overall Comments:

• The upgrade to pydantic 2.5+ is a major version change that may introduce breaking changes. Please document any necessary migration steps and confirm compatibility testing has been performed.
• Consider explicitly documenting the full range of supported Python versions in the PR description, including the minimum supported version.

Here's what I looked at during the review

• 🟢 General issues: all looks good
• 🟢 Security: all looks good
• 🟢 Testing: all looks good
• 🟢 Complexity: all looks good
• 🟢 Documentation: all looks good

---

Sourcery is free for open source - if you like our reviews please consider sharing them ✨

• X
• Mastodon
• LinkedIn
• Facebook

_{Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.}