Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] More flexible networks #1137

Open
sash-a opened this issue Nov 13, 2024 · 0 comments
Open

[FEATURE] More flexible networks #1137

sash-a opened this issue Nov 13, 2024 · 0 comments
Labels
enhancement New feature or request refactor Improve or update code to conform to code standards

Comments

@sash-a
Copy link
Contributor

sash-a commented Nov 13, 2024

We recently got a PR #1099 to add the ability to chain torso's together. This would greatly increase the flexibility of creating the networks through config.

The goal would be for the main network class to look something like this:

class Network(nn.Module)
    torso: CompositeNetwork
    head: nn.Module

    def __call__(x, ...):
        x = do some stuff to the input  # each different network would do different stuff e.g centralized/decentralized etc
        return head(torso(x))

Then torsos and head can be defined easily through config and chained through the CompositeNetwork a similar system exists in stoix, which this change is inspired by.

@sash-a sash-a added enhancement New feature or request refactor Improve or update code to conform to code standards labels Nov 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request refactor Improve or update code to conform to code standards
Projects
None yet
Development

No branches or pull requests

1 participant