Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(migration): metadata migration was incorrect #7525

Closed
wants to merge 6 commits into from

Conversation

tac0turtle
Copy link
Member

Description

this pr fixes an issue in which ibc was migrating metadata but not setting the values of the denom units, this has been breaking indexers and causing issues across users

closes: #XXXX


Before we can merge this PR, please make sure that all the following items have been
checked off. If any of the checklist items are not applicable, please leave them but
write a little note why.

  • Targeted PR against the correct branch (see CONTRIBUTING.md).
  • Linked to GitHub issue with discussion and accepted design, OR link to spec that describes this work.
  • Code follows the module structure standards and Go style guide.
  • Wrote unit and integration tests.
  • Updated relevant documentation (docs/).
  • Added relevant godoc comments.
  • Provide a conventional commit message to follow the repository standards.
  • Include a descriptive changelog entry when appropriate. This may be left to the discretion of the PR reviewers. (e.g. chores should be omitted from changelog)
  • Re-reviewed Files changed in the GitHub PR explorer.
  • Review SonarCloud Report in the comment section below once CI passes.

Copy link
Member

@damiannolan damiannolan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @tac0turtle

@damiannolan
Copy link
Member

There is some failing unit tests, I will try to look into later today if you don't have time

Copy link

sonarcloud bot commented Oct 30, 2024

@colin-axner
Copy link
Contributor

Is there a bug report we could link to this pr? I am having a hard time understanding the exact issue and the solution to it

Copy link
Member

@damiannolan damiannolan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looked at this for quite a while and tried to exhaust scenarios in which this can overwrite denom metadata. I don't understand how it could without some more info. I mentioned the only scenario I can think of which would allow possible overwrite resulting in reduced number of DenomUnits. It would require some underlying store error or corrupt state.

We can look at testing this e2e to 100% verify the code path, but rn its unclear to me how it would be any different to how we understand it.

Comment on lines +153 to +159
for _, dunit := range denomMetadata.DenomUnits {
du = append(du, &banktypes.DenomUnit{
Denom: dunit.Denom,
Exponent: dunit.Exponent,
Aliases: dunit.Aliases,
})
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't understand how this code is reachable.

Comment on lines -46 to -47
if !m.keeper.bankKeeper.HasDenomMetaData(ctx, dt.IBCDenom()) {
m.keeper.setDenomMetadataWithDenomTrace(ctx, dt)
Copy link
Member

@damiannolan damiannolan Oct 30, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If there exists a denom metadata we will not overwrite it.

The only scenario in which this can overwrite an existing denom metadata, entering the if branch here is:

  • Collections/Map.Has (ref) returns has == true but also hits an error for some reason out of our control, meaning that err != nil in HasDenomMetaData here. This would yield a falsey return value and we'd enter if and overwrite the underlying denom metadata

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if it is possible that the key constructed in an old version differs from the key constructed in a new version. We should verify that all non-ibc denom metadata's are queryable

@damiannolan
Copy link
Member

I have tested an e2e chain upgrade to ensure our migration code works as expected (specifically when existing metadata with denom units > 1 are stored in x/bank state).

I will link below code diffs and outline for anyone who would like to sanity check this.

Steps to reproduce:

  1. Prep a docker image of ibc-go/v7 code which sets denom metadata pre-upgrade.
  • The following diff from my branch edits the v7.8.x release branch to store denom metadata on RecvPacket (with two denom units for the IBC token denom) ref
  • Checkout the branch (damian/e2e-denom-metadata-migration-v7)
  • Build a docker image: docker build -t ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e . --build-arg IBC_GO_VERSION=latest
  1. Run an e2e upgrade test from ibc-go/v7 to ibc-go/v8, which will run the automatic transfer migration.
  • See the test diff here: https://github.com/cosmos/ibc-go/compare/damian/e2e-denom-metadata-migration-test?expand=1
  • Checkout branch (damian/e2e-denom-metadata-migration-test)
  • cd e2e && mkdir dev-configs
  • Drop the e2e config file pasted below into dev-configs and run make e2e-test from the e2e directory.
  • You will be prompted by fzf to select your config file. Search for TestV7ToV8ChainUpgrade
  • The config below is configured to run from the docker image we built in step 1 and upgrade to ibc-go:v8.5.0
E2E chain upgrade config
---
chains:
  # the entry at index 0 corresponds to CHAIN_A
  - chainId: chainA-1
    numValidators: 1
    numFullNodes: 1
    image: ghcr.io/cosmos/ibc-go-simd # override with CHAIN_IMAGE
    tag: v7.8.0-dev-e2e # override with CHAIN_A_TAG
    binary: simd # override with CHAIN_BINARY

    # the entry at index 1 corresponds to CHAIN_B
  - chainId: chainB-1
    numValidators: 1
    numFullNodes: 1
    image: ghcr.io/cosmos/ibc-go-simd # override with CHAIN_IMAGE
    tag: v7.8.0-dev-e2e # override with CHAIN_B_TAG
    binary: simd # override with CHAIN_BINARY

activeRelayer: hermes # override with RELAYER_ID
relayers:
  - id: hermes
    image: ghcr.io/informalsystems/hermes
    tag: "1.10.0"
  - id: rly
    image: ghcr.io/cosmos/relayer
    tag: "latest"
  - id: hyperspace
    image: ghcr.io/misko9/hyperspace
    tag: "20231122v39"

cometbft:
  logLevel: info

debug:
  # setting this value to true will force log collection even if the test passes.
  dumpLogs: false
  # settings this value to true will keep the containers running after the test finishes.
  keepContainers: true

# Required only for upgrade tests.
# Chain A will be upgraded the specified tag.
# The plan name must be registered as an upgrade handler in the given tag.
upgrade:
  planName: "v8" # override with CHAIN_UPGRADE_PLAN
  tag: "v8.5.0" # override with CHAIN_UPGRADE_TAG

Test passes successfully.

Test output
make e2e-test
./scripts/init.sh
using config file at /Users/damiannolan/.ibc-go-e2e-config.yaml for e2e test
./scripts/run-e2e.sh
Using configuration file at /Users/damiannolan/development/ibc-go/e2e/dev-configs/denom-metadata-migration.yaml
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.MsgStoreCode
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.MsgStoreCodeResponse
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.MsgRemoveChecksum
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.MsgRemoveChecksumResponse
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.MsgMigrateContract
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.MsgMigrateContractResponse
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.ClientState
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.ConsensusState
2024/11/04 13:47:47 proto: duplicate proto type registered: ibc.lightclients.wasm.v1.ClientMessage
=== RUN   TestUpgradeTestSuite
    testsuite.go:168: Setting up chains: TestUpgradeTestSuite
    setup.go:168: Keeping containers - Docker cleanup skipped
{"level":"info","msg":"Using embedded configured chains"}
{"level":"error","msg":"Failed to pull image","error":"Error response from daemon: manifest unknown","repository":"ghcr.io/cosmos/ibc-go-simd","tag":"v7.8.0-dev-e2e"}
{"level":"error","msg":"Failed to pull image","error":"Error response from daemon: manifest unknown","repository":"ghcr.io/cosmos/ibc-go-simd","tag":"v7.8.0-dev-e2e"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys add faucet --coin-type 118 --keyring-backend test --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-eqrwdt","container":"TestUpgradeTestSuite-eqrwdt"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys add faucet --coin-type 118 --keyring-backend test --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-xesnvq","container":"TestUpgradeTestSuite-xesnvq"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys show --address faucet --home /var/cosmos-chain/simapp-a-1 --keyring-backend test","hostname":"TestUpgradeTestSuite-trpgst","container":"TestUpgradeTestSuite-trpgst"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys show --address faucet --home /var/cosmos-chain/simapp-b-2 --keyring-backend test","hostname":"TestUpgradeTestSuite-dydcyz","container":"TestUpgradeTestSuite-dydcyz"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd init chainB-1-val-0-TestUpgradeTestSuite --chain-id chainB-1 --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-inmoky","container":"TestUpgradeTestSuite-inmoky"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd init chainB-1-fn-0-TestUpgradeTestSuite --chain-id chainB-1 --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-fwvjov","container":"TestUpgradeTestSuite-fwvjov"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd init chainA-1-val-0-TestUpgradeTestSuite --chain-id chainA-1 --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-eycryq","container":"TestUpgradeTestSuite-eycryq"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd init chainA-1-fn-0-TestUpgradeTestSuite --chain-id chainA-1 --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-vtbysp","container":"TestUpgradeTestSuite-vtbysp"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys add validator --coin-type 118 --keyring-backend test --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-mppsru","container":"TestUpgradeTestSuite-mppsru"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys add validator --coin-type 118 --keyring-backend test --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-rtjkeu","container":"TestUpgradeTestSuite-rtjkeu"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys show --address validator --home /var/cosmos-chain/simapp-a-1 --keyring-backend test","hostname":"TestUpgradeTestSuite-pifxyy","container":"TestUpgradeTestSuite-pifxyy"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys show --address validator --home /var/cosmos-chain/simapp-b-2 --keyring-backend test","hostname":"TestUpgradeTestSuite-dgypqo","container":"TestUpgradeTestSuite-dgypqo"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-evobbw","container":"TestUpgradeTestSuite-evobbw"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-hfhlbg","container":"TestUpgradeTestSuite-hfhlbg"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1elnraxcsq3vm3kwsclamqfmy3gvn299f5xdlyx 10000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-mltuwl","container":"TestUpgradeTestSuite-mltuwl"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos14aa7y9vd8nkh8060hdw5fhtrekcjgzndtks4s7 10000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-rpuxqe","container":"TestUpgradeTestSuite-rpuxqe"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-zbhnvg","container":"TestUpgradeTestSuite-zbhnvg"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-xybboh","container":"TestUpgradeTestSuite-xybboh"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd gentx validator 5000000000000atomb --gas-prices 0.00atomb --gas-adjustment 1.3 --keyring-backend test --chain-id chainB-1 --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-cmcpcf","container":"TestUpgradeTestSuite-cmcpcf"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd gentx validator 5000000000000atoma --gas-prices 0.00atoma --gas-adjustment 1.3 --keyring-backend test --chain-id chainA-1 --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-qbdmyz","container":"TestUpgradeTestSuite-qbdmyz"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-fetgzn","container":"TestUpgradeTestSuite-fetgzn"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-qbwtcl","container":"TestUpgradeTestSuite-qbwtcl"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1z0276xxzsxq6ykhmveccpcty7wrr44dz8vvpdh 100000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-gbyfws","container":"TestUpgradeTestSuite-gbyfws"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1ryjcpa086cqyrmwapv7jmpnutpneshq0mjfqyj 100000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-pyznva","container":"TestUpgradeTestSuite-pyznva"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-caeeoz","container":"TestUpgradeTestSuite-caeeoz"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-ransqf","container":"TestUpgradeTestSuite-ransqf"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1uqzjc2882d0qgan8q8mtt6m2cmy3lxkpsyh5az 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-tgbxbe","container":"TestUpgradeTestSuite-tgbxbe"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1evq9jvax7xz98xaazrxp5pagj66n00lvrtntku 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-tztqfl","container":"TestUpgradeTestSuite-tztqfl"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-torlct","container":"TestUpgradeTestSuite-torlct"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-fsbusd","container":"TestUpgradeTestSuite-fsbusd"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1vlh5gtrc5m46xa2uvd4mxt5q4ark77njkdxsu7 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-rvdoql","container":"TestUpgradeTestSuite-rvdoql"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1wqf9w45p5kzntfqfl00gwuk5jr5gj4m67xjy45 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-vemedb","container":"TestUpgradeTestSuite-vemedb"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-xgnaxj","container":"TestUpgradeTestSuite-xgnaxj"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-sdjllj","container":"TestUpgradeTestSuite-sdjllj"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1attswsgnqza223zgnyrtn7ljzqqf28cexfdypw 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-tysygw","container":"TestUpgradeTestSuite-tysygw"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1lvune9evr5hgxwxtk8u2pdsdl5crkplnytsv6k 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-gwpnre","container":"TestUpgradeTestSuite-gwpnre"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-dctsup","container":"TestUpgradeTestSuite-dctsup"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-tonaoy","container":"TestUpgradeTestSuite-tonaoy"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1ua2m5dtqxtkk4zzek48hve7nhsa4fptcj57t7v 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-mpwkih","container":"TestUpgradeTestSuite-mpwkih"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-xaoxct","container":"TestUpgradeTestSuite-xaoxct"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos14q6lj29s5dupraqmkgjpp7v8wtv40gh9ux2j4l 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-fgjkjg","container":"TestUpgradeTestSuite-fgjkjg"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos12cwwafs0te66lt3fw66x759kk5u84a4g9gqxh3 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-owpohj","container":"TestUpgradeTestSuite-owpohj"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-iwqpuk","container":"TestUpgradeTestSuite-iwqpuk"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-pwarus","container":"TestUpgradeTestSuite-pwarus"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1euznuna85xqu6qenwlmnlqm93sykczwe9e84r9 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-rwdrif","container":"TestUpgradeTestSuite-rwdrif"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1pz9vea7xhqmy50ykj3sx34a3muxunt6f5p94t4 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-mzuywf","container":"TestUpgradeTestSuite-mzuywf"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-xjyiud","container":"TestUpgradeTestSuite-xjyiud"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-jdnvxx","container":"TestUpgradeTestSuite-jdnvxx"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1k9083nwhua0zpmv2xzt3w7hjk8y8e8ecuvwzlk 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-phkltf","container":"TestUpgradeTestSuite-phkltf"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1xctx225drderp84raukxa9q92u9c7wl6cd3qa8 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-bhgahr","container":"TestUpgradeTestSuite-bhgahr"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-weczsk","container":"TestUpgradeTestSuite-weczsk"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-itwdhl","container":"TestUpgradeTestSuite-itwdhl"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1ar62ng0p6kxmdvv5dkn7zlff7m6wmusmckzpww 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-snrqld","container":"TestUpgradeTestSuite-snrqld"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1jl8jmel24enjx6y75jssr6stay93xcz9kuxxmr 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-yxjeyb","container":"TestUpgradeTestSuite-yxjeyb"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-xidfjn","container":"TestUpgradeTestSuite-xidfjn"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-onyusd","container":"TestUpgradeTestSuite-onyusd"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1ayhtc6s339tgj7w7vv24fhqf0vj8t9mmfh34hc 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-rbflns","container":"TestUpgradeTestSuite-rbflns"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1wcfgxqdprt5axkk6j329f0stt5acwttyfqxg22 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-zkgbfs","container":"TestUpgradeTestSuite-zkgbfs"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-rxjant","container":"TestUpgradeTestSuite-rxjant"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-qgugoq","container":"TestUpgradeTestSuite-qgugoq"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos199zerg6kk4atnpvyyu5s5z73a9u7pjuw4yxq2a 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-xhxchx","container":"TestUpgradeTestSuite-xhxchx"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos1z74gs9c4ygnq4srzh44y0vam3kyzp634cd2ny0 1000000000000atomb --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-jgyysf","container":"TestUpgradeTestSuite-jgyysf"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-kxvxel","container":"TestUpgradeTestSuite-kxvxel"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-flbrdz","container":"TestUpgradeTestSuite-flbrdz"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd add-genesis-account cosmos18gtaxedu6q0adj4388km59s4823asjs6kg356e 1000000000000atoma --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-yfvbsy","container":"TestUpgradeTestSuite-yfvbsy"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd collect-gentxs --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-dmhgll","container":"TestUpgradeTestSuite-dmhgll"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd genesis --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-rnqoru","container":"TestUpgradeTestSuite-rnqoru"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd collect-gentxs --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-kpxmvo","container":"TestUpgradeTestSuite-kpxmvo"}
{"level":"info","msg":"Genesis","chain_id":"chainB-1","test":"TestUpgradeTestSuite","hash":"075DC15AC8A5E4486E45B56CA6ECAB7F343E3B8291D669ECB15A56862F510164"}
{"level":"info","msg":"Genesis","chain_id":"chainB-1","test":"TestUpgradeTestSuite","hash":"075DC15AC8A5E4486E45B56CA6ECAB7F343E3B8291D669ECB15A56862F510164"}
{"level":"info","msg":"Will run command","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","container":"chainB-1-fn-0-TestUpgradeTestSuite","command":"simd start --home /var/cosmos-chain/simapp-b-2 --x-crisis-skip-assert-invariants"}
{"level":"info","msg":"Will run command","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","container":"chainB-1-val-0-TestUpgradeTestSuite","command":"simd start --home /var/cosmos-chain/simapp-b-2 --x-crisis-skip-assert-invariants"}
{"level":"info","msg":"Peering","chain_id":"chainB-1","test":"TestUpgradeTestSuite","host_name":"chainB-1-val-0-TestUpgradeTestSuite","peer":"02393ee44d113da5854633427ce0b27797b99263@chainB-1-val-0-TestUpgradeTestSuite:26656","container":"chainB-1-val-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Peering","chain_id":"chainB-1","test":"TestUpgradeTestSuite","host_name":"chainB-1-fn-0-TestUpgradeTestSuite","peer":"3811fc5ab7927fa83c7675e3bbbd44716a82dd8d@chainB-1-fn-0-TestUpgradeTestSuite:26656","container":"chainB-1-fn-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Starting container","container":"chainB-1-val-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Starting container","container":"chainB-1-fn-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Container started","container":"chainB-1-fn-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Container started","container":"chainB-1-val-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Genesis","chain_id":"chainA-1","test":"TestUpgradeTestSuite","hash":"8218AEEEF499525EA9F4DDF1C236802CF93760651EA01273C26158936B0168F4"}
{"level":"info","msg":"Genesis","chain_id":"chainA-1","test":"TestUpgradeTestSuite","hash":"8218AEEEF499525EA9F4DDF1C236802CF93760651EA01273C26158936B0168F4"}
{"level":"info","msg":"Will run command","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","container":"chainA-1-fn-0-TestUpgradeTestSuite","command":"simd start --home /var/cosmos-chain/simapp-a-1 --x-crisis-skip-assert-invariants"}
{"level":"info","msg":"Will run command","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","container":"chainA-1-val-0-TestUpgradeTestSuite","command":"simd start --home /var/cosmos-chain/simapp-a-1 --x-crisis-skip-assert-invariants"}
{"level":"info","msg":"Peering","chain_id":"chainA-1","test":"TestUpgradeTestSuite","host_name":"chainA-1-val-0-TestUpgradeTestSuite","peer":"df5126af43aee94e96faae5e5b49b575263fa3f1@chainA-1-val-0-TestUpgradeTestSuite:26656","container":"chainA-1-val-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Peering","chain_id":"chainA-1","test":"TestUpgradeTestSuite","host_name":"chainA-1-fn-0-TestUpgradeTestSuite","peer":"8b146c1f355bb502ef35426d02cf8a718bfaef3b@chainA-1-fn-0-TestUpgradeTestSuite:26656","container":"chainA-1-fn-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Starting container","container":"chainA-1-val-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Starting container","container":"chainA-1-fn-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Container started","container":"chainA-1-fn-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Container started","container":"chainA-1-val-0-TestUpgradeTestSuite"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-ffvbke","container":"TestUpgradeTestSuite-ffvbke"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-xzuste","container":"TestUpgradeTestSuite-xzuste"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-sioggw","container":"TestUpgradeTestSuite-sioggw"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-gascku","container":"TestUpgradeTestSuite-gascku"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-qfccmy","container":"TestUpgradeTestSuite-qfccmy"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-epodbf","container":"TestUpgradeTestSuite-epodbf"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-rpeiqp","container":"TestUpgradeTestSuite-rpeiqp"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-gusyxt","container":"TestUpgradeTestSuite-gusyxt"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-yconre","container":"TestUpgradeTestSuite-yconre"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-sztptz","container":"TestUpgradeTestSuite-sztptz"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-sjhqqd","container":"TestUpgradeTestSuite-sjhqqd"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-zpvkro","container":"TestUpgradeTestSuite-zpvkro"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-znppuc","container":"TestUpgradeTestSuite-znppuc"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-abdmsu","container":"TestUpgradeTestSuite-abdmsu"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-ibxahl","container":"TestUpgradeTestSuite-ibxahl"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-mmnsnb","container":"TestUpgradeTestSuite-mmnsnb"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-pqsuxu","container":"TestUpgradeTestSuite-pqsuxu"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-gwtpok","container":"TestUpgradeTestSuite-gwtpok"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-tdbgnv","container":"TestUpgradeTestSuite-tdbgnv"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-rmffzc","container":"TestUpgradeTestSuite-rmffzc"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-rmmqnb","container":"TestUpgradeTestSuite-rmmqnb"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-uulldy","container":"TestUpgradeTestSuite-uulldy"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-kvlhah","container":"TestUpgradeTestSuite-kvlhah"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-dxflwr","container":"TestUpgradeTestSuite-dxflwr"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-ztecpy","container":"TestUpgradeTestSuite-ztecpy"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-izyxap","container":"TestUpgradeTestSuite-izyxap"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-yxaxie","container":"TestUpgradeTestSuite-yxaxie"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-hvogwg","container":"TestUpgradeTestSuite-hvogwg"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-ffcmwk","container":"TestUpgradeTestSuite-ffcmwk"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-rkwjln","container":"TestUpgradeTestSuite-rkwjln"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-pxwzhl","container":"TestUpgradeTestSuite-pxwzhl"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-gfqoce","container":"TestUpgradeTestSuite-gfqoce"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-dbmpzr","container":"TestUpgradeTestSuite-dbmpzr"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-uozmng","container":"TestUpgradeTestSuite-uozmng"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-nbdtxd","container":"TestUpgradeTestSuite-nbdtxd"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-ybwcvu","container":"TestUpgradeTestSuite-ybwcvu"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-yrbepb","container":"TestUpgradeTestSuite-yrbepb"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainA-1 --mnemonic-file /home/hermes/chainA-1/mnemonic.txt --key-name chainA-1","hostname":"TestUpgradeTestSuite-svgqfh","container":"TestUpgradeTestSuite-svgqfh"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --config /home/hermes/.hermes/config.toml config validate","hostname":"TestUpgradeTestSuite-wkeumc","container":"TestUpgradeTestSuite-wkeumc"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes keys add --chain chainB-1 --mnemonic-file /home/hermes/chainB-1/mnemonic.txt --key-name chainB-1","hostname":"TestUpgradeTestSuite-ozqkvs","container":"TestUpgradeTestSuite-ozqkvs"}
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade
    testsuite.go:208: Setting up path for: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade
    testsuite.go:239: establishing path between chainA-1 and chainB-1 on path path-1
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --json create client --host-chain chainA-1 --reference-chain chainB-1","hostname":"TestUpgradeTestSuite-wctnnf","container":"TestUpgradeTestSuite-wctnnf"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --json create client --host-chain chainB-1 --reference-chain chainA-1","hostname":"TestUpgradeTestSuite-zzahfi","container":"TestUpgradeTestSuite-zzahfi"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --json create connection --a-chain chainA-1 --a-client 07-tendermint-0 --b-client 07-tendermint-0","hostname":"TestUpgradeTestSuite-lydrjy","container":"TestUpgradeTestSuite-lydrjy"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --json create channel --order unordered --a-chain chainA-1 --a-port transfer --b-port transfer --a-connection connection-0 --channel-version ics20-1","hostname":"TestUpgradeTestSuite-ythred","container":"TestUpgradeTestSuite-ythred"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --json query channels --chain chainA-1 --show-counterparty --verbose","hostname":"TestUpgradeTestSuite-hmkavb","container":"TestUpgradeTestSuite-hmkavb"}
{"level":"info","msg":"About to start container","image":"ghcr.io/informalsystems/hermes:1.10.0","test_name":"TestUpgradeTestSuite","command":"hermes --json query channels --chain chainB-1 --show-counterparty --verbose","hostname":"TestUpgradeTestSuite-cqeqiz","container":"TestUpgradeTestSuite-cqeqiz"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys add TestUpgradeTestSuite/TestV7ToV8ChainUpgrade-chainA-1-psr --coin-type 118 --keyring-backend test --home /var/cosmos-chain/simapp-a-1","hostname":"TestUpgradeTestSuite-ofulye","container":"TestUpgradeTestSuite-ofulye"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys show --address TestUpgradeTestSuite/TestV7ToV8ChainUpgrade-chainA-1-psr --home /var/cosmos-chain/simapp-a-1 --keyring-backend test","hostname":"TestUpgradeTestSuite-vabxaz","container":"TestUpgradeTestSuite-vabxaz"}
{"level":"info","msg":"About to start container","chain_id":"chainA-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd tx bank send faucet cosmos1xsl7844zh96zsnaq95t9dqp6deckppjn5pls4q 500000000000atoma --gas-prices 0.00atoma --gas-adjustment 1.3 --from faucet --keyring-backend test --output json -y --chain-id chainA-1 --home /var/cosmos-chain/simapp-a-1 --node tcp://chainA-1-val-0-TestUpgradeTestSuite:26657","hostname":"TestUpgradeTestSuite-urzoqz","container":"TestUpgradeTestSuite-urzoqz"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys add TestUpgradeTestSuite/TestV7ToV8ChainUpgrade-chainB-1-uew --coin-type 118 --keyring-backend test --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-nvarij","container":"TestUpgradeTestSuite-nvarij"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys show --address TestUpgradeTestSuite/TestV7ToV8ChainUpgrade-chainB-1-uew --home /var/cosmos-chain/simapp-b-2 --keyring-backend test","hostname":"TestUpgradeTestSuite-xvkbyu","container":"TestUpgradeTestSuite-xvkbyu"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd tx bank send faucet cosmos1fy7l0gygsl8wrz5wxp2cg2nndvl2y5vgjd48ke 500000000000atomb --gas-prices 0.00atomb --gas-adjustment 1.3 --from faucet --keyring-backend test --output json -y --chain-id chainB-1 --home /var/cosmos-chain/simapp-b-2 --node tcp://chainB-1-val-0-TestUpgradeTestSuite:26657","hostname":"TestUpgradeTestSuite-jtptyq","container":"TestUpgradeTestSuite-jtptyq"}
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/transfer_native_tokens_from_chainA_to_chainB
=== NAME  TestUpgradeTestSuite/TestV7ToV8ChainUpgrade
    tx.go:78: blocks created on chain chainA-1
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/tokens_are_escrowed
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/start_relayer
{"level":"info","msg":"Will run command","image":"ghcr.io/informalsystems/hermes:1.10.0","container":"hermes-path-1-qgcts","command":"hermes --config /home/hermes/.hermes/config.toml start"}
{"level":"info","msg":"Container started","container":"hermes-path-1-qgcts"}
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/packet_is_relayed
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/assert_ibc_denom_metadata
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/upgrade_chain
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys add TestUpgradeTestSuite/TestV7ToV8ChainUpgrade-chainB-1-vzk --coin-type 118 --keyring-backend test --home /var/cosmos-chain/simapp-b-2","hostname":"TestUpgradeTestSuite-mjmdlq","container":"TestUpgradeTestSuite-mjmdlq"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd keys show --address TestUpgradeTestSuite/TestV7ToV8ChainUpgrade-chainB-1-vzk --home /var/cosmos-chain/simapp-b-2 --keyring-backend test","hostname":"TestUpgradeTestSuite-ujvlau","container":"TestUpgradeTestSuite-ujvlau"}
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd tx bank send faucet cosmos16h8v8e8akwqa4v5u8rprs6r5heptyfzv2jxref 500000000000atomb --gas-prices 0.00atomb --gas-adjustment 1.3 --from faucet --keyring-backend test --output json -y --chain-id chainB-1 --home /var/cosmos-chain/simapp-b-2 --node tcp://chainB-1-val-0-TestUpgradeTestSuite:26657","hostname":"TestUpgradeTestSuite-vyukmw","container":"TestUpgradeTestSuite-vyukmw"}
=== NAME  TestUpgradeTestSuite/TestV7ToV8ChainUpgrade
    tx.go:78: blocks created on chain chainB-1
{"level":"info","msg":"About to start container","chain_id":"chainB-1","test":"TestUpgradeTestSuite","image":"ghcr.io/cosmos/ibc-go-simd:v7.8.0-dev-e2e","test_name":"TestUpgradeTestSuite","command":"simd tx gov vote 1 yes --gas auto --gas-prices 0.00atomb --gas-adjustment 1.3 --from validator --keyring-backend test --output json -y --chain-id chainB-1 --home /var/cosmos-chain/simapp-b-2 --node tcp://chainB-1-val-0-TestUpgradeTestSuite:26657","hostname":"TestUpgradeTestSuite-uyzkay","container":"TestUpgradeTestSuite-uyzkay"}
{"level":"info","msg":"Will run command","image":"ghcr.io/cosmos/ibc-go-simd:v8.5.0","container":"chainB-1-val-0-TestUpgradeTestSuite","command":"simd start --home /var/cosmos-chain/simapp-b-2 --x-crisis-skip-assert-invariants"}
{"level":"info","msg":"Will run command","image":"ghcr.io/cosmos/ibc-go-simd:v8.5.0","container":"chainB-1-fn-0-TestUpgradeTestSuite","command":"simd start --home /var/cosmos-chain/simapp-b-2 --x-crisis-skip-assert-invariants"}
{"level":"info","msg":"Container started","container":"chainB-1-fn-0-TestUpgradeTestSuite"}
{"level":"info","msg":"Container started","container":"chainB-1-val-0-TestUpgradeTestSuite"}
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/assert_ibc_denom_metadata_is_unchanged_post_upgrade
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/IBC_token_transfer_from_chainA_to_chainB,_to_make_sure_the_upgrade_did_not_break_the_packet_flow
=== NAME  TestUpgradeTestSuite/TestV7ToV8ChainUpgrade
    tx.go:78: blocks created on chain chainA-1
=== RUN   TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/packets_are_relayed
=== NAME  TestUpgradeTestSuite
    testsuite.go:644: test passed, not uploading logs
    setup.go:168: Keeping containers - Docker cleanup skipped
--- PASS: TestUpgradeTestSuite (298.17s)
    --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade (251.62s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/transfer_native_tokens_from_chainA_to_chainB (12.65s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/tokens_are_escrowed (0.00s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/start_relayer (20.06s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/packet_is_relayed (0.00s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/assert_ibc_denom_metadata (0.00s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/upgrade_chain (95.28s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/assert_ibc_denom_metadata_is_unchanged_post_upgrade (0.00s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/IBC_token_transfer_from_chainA_to_chainB,_to_make_sure_the_upgrade_did_not_break_the_packet_flow (13.49s)
        --- PASS: TestUpgradeTestSuite/TestV7ToV8ChainUpgrade/packets_are_relayed (0.00s)
PASS
ok  	github.com/cosmos/ibc-go/e2e/tests/upgrades	298.928s

@DimitrisJim
Copy link
Contributor

this has been breaking indexers and causing issues across users

could we get a bug report/slack message that explains how they are breaking? Is it possible the issue is elsewhere?

@tac0turtle
Copy link
Member Author

in testing it seems this is not where the issue is coming from

@tac0turtle tac0turtle closed this Nov 4, 2024
@tac0turtle tac0turtle deleted the marko/fix_migation branch November 4, 2024 13:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants