How to support nested list with config from sub-directories

[maheshkelkar]

I want to add config, with nested lists. Outer list is called pods. Each pod has list called containers (i.e. inner list). Instead of duplicating pods and containers config, I want to use it from their individual files in the sub-directories. I am not able to make it work.

I am using: hydra-core==1.3.2.

This blog post here uses dict to make lists work.

I couldn't find any recommendations or ways to make this work. Thank you in advance for ideas/thoughts/comments.

The directory structure for example/conf

├── config.yaml
└── pods
    ├── basic.yaml
    ├── plusone.yaml
    └── containers
        ├── foo.yaml
        ├── bar.yaml
        └── baz.yaml

config.yaml

defaults:
  - pods:
    - basic
    - plusone

pods/basic.yaml. I need to define "basic" here as mentioned in the blog post; or the config for plusone overwrites it

defaults:
  - containers:
    - foo
    - bar
basic:
  animal: cat
  containers: ${containers}

pods/plusone.yaml. This doesn't work. It simply adds config for "baz" to the overall "site" list (or dict).

defaults:
  - containers:
    - baz
plusone:
  animal: dog
  containers: ${containers}

pods/containers/foo.yaml

foo:
    color: brown

In the end I want to be able to override these pods and containers from the command line
E.g.

python -m example "pods=[plustwo]" "pods/basic/containers=[bar]"

[omry]

Composing lists in general is not supported.
There is a way to make a dict look like a list though. You can use the built in resolver oc.dict.values which takes a name of a dict node and return a list with the values.

Example from the OmegaConf docs:

cfg = OmegaConf.create(
    {
        "workers": {
            "node3": "10.0.0.2",
            "node7": "10.0.0.9",
        },
        "nodes": "${oc.dict.keys: workers}",
        "ips": "${oc.dict.values: workers}",
    }
)
# Keys are copied from the DictConfig:
show(cfg.nodes)
type: ListConfig, value: ['node3', 'node7']
# Values are dynamically fetched through interpolations:
show(cfg.ips)
type: ListConfig, value: ['${workers.node3}', '${workers.node7}']
assert cfg.ips == ["10.0.0.2", "10.0.0.9"]