CHANGELOG.md

dre Changelog

0.4.0 - 2024-05-24

Compare with first commit

Features

• log active versions when reconcilling (#413) (b02ad5f by Saša Tomić).
• [REL-1517] Auto-pick automation neuron for updating unassigned nodes (#416) (20640cd by Saša Tomić).
• Add a proposals subcommand to get a single proposal by id (#412) (5bfb885 by Saša Tomić).
• Update the DRE cli tool to work with the new IC-OS proposals (#411) (125b147 by Saša Tomić).
• Include more info in the registry dump (#410) (e651338 by Saša Tomić).
• adding hostos release notes script (#407) (a99cdb7 by Nikola Milosavljevic).
• Automatically update k8s vector container versions (#399) (47557dc by Saša Tomić).
• DRE-120 Lazily check for HSM/private key auth (#386) (cb7be54 by Saša Tomić).
• Better listing proposals (#382) (649719d by Nikola Milosavljevic).
• listing proposals (#372) (44261a2 by Nikola Milosavljevic).
• Bazel remote cache on s3 (#369) (7ed7fc4 by Saša Tomić).
• Improve the bazel cache optimization (#368) (e7b3a8d by Saša Tomić).
• adding using of public dashboard for mainnet for health statuses (#362) (70b4c5f by Nikola Milosavljevic).
• adding v1 structure for node labels in dre repo (#361) (f6bda6e by Nikola Milosavljevic).
• adding api boundary nodes to registry dump command (#357) (42de821 by Nikola Milosavljevic).
• adding elastic backup job (#343) (8ba3f20 by Nikola Milosavljevic).
• implemented automatic updates for dre tool (#341) (cd60325 by Nikola Milosavljevic).
• Automation script for removing nodes from subnets (#328) (535d731 by Saša Tomić).
• implementing completions (#319) (b8bb7e0 by Nikola Milosavljevic).
• Support for targetting arbitrary IC network on the cli (#302) (d1ac15b by Saša Tomić).
• Maintain up to 1 open MR in the k8s repo per DRE branch (#298) (e99dd08 by Saša Tomić).
• If possible reuse the MR in the k8s repo to update container images (#290) (127ef28 by Saša Tomić).
• adding job for building dashboard (#278) (0abe44a by Nikola Milosavljevic).

Bug Fixes

• Show DC in the node label/name (#406) (f48e685 by Saša Tomić).
• Add compatibility in fetching trustworthy metrics from old subnet versions (#401) (77e39d2 by Saša Tomić).
• Set the default socket timeout to 60s (55c2abb by Saša Tomić).
• [DRE-166] use requests instead of urllib, to handle timeouts (#398) (4838df8 by Saša Tomić).
• [DRE-166] Add timeouts to the URL requests (#395) (ec25f69 by Saša Tomić).
• Only update posts if different and can_edit (#391) (846345a by Saša Tomić).
• adding missing mapping for unassigned status from public dashboard (#379) (2e14819 by Nikola Milosavljevic).
• Do not check the health of the force-included nodes (#377) (2ab31fb by Saša Tomić).
• Ensure "interface-owners" changes are included (#366) (f517739 by Saša Tomić).
• build dashboard on PR only if it was referenced in the branch (#308) (c072728 by Nikola Milosavljevic).
• Openssl missing and dry run in CI (#303) (b8bc57e by Nikola Milosavljevic).
• fixing condition for pushing of dashboard image (#296) (283e346 by Nikola Milosavljevic).
• k8s repo make MR (#297) (2c0e676 by Saša Tomić).
• Fix bin/mk-release to not tag versions with "vv" in some cases (#288) (d9dd38c by Saša Tomić).

Code Refactoring

• migrating from using gitlab for node labels to using github (#384) (dee7f89 by Nikola Milosavljevic).

0.3.2 - 2024-04-03

Compare with first commit

Added

• Add features for release rc--2024-03-20_23-01 (#257) (a89c182 by Luka Skugor).

Fixed

• fix (f0c44d7 by Saša Tomić).
• fix command order (f3d6ea9 by Saša Tomić).
• fix docker image run issues (#268) (bb9acec by Luka Skugor).

Changed

• Changes by create-pull-request action (#245) (278cc64 by sa-github-api).

v0.3.1 (2024-3-21)

feat

• cli: Check that there are two download URLs for elect proposals (#236) (1ac8581)
• rollout: Rollout controller refactoring part 1 - fetcher logic (#237) (bf0b89a)
• rollout-controller: Implementing action taking and refactoring tests (#249) (6e6a377)

chore

• Update dependencies (#225) (820266c)
• Update dependencies (#240) (996a004)
• Update dependencies (#244) (4a6db31)

fix

• dre: DRE-147 Do not require neuron id for fetching trustworthy metrics (#251) (03dfe1f)

v0.3.0 (2024-3-6)

docs

• Replace the version in the download URL with the "latest" (#137) (765a35b)
• Update the Jupyter runbook and data for Trustworthy metrics (#138) (af1ef6d)

fix

• ci: Use a GitHub PAT when creating PR automatically (#144) (e1d36bc)
• sns-downloader: fixing limit and better hashing (#190) (8584071)
• log-fetcher: binary fields that end with \n are not parsed correctly (#213) (2d96e38)
• ci: Fix case of github_token variable (#217) (9940fdf)
• downloader: multiservice discovery should filter boundary nodes based on target name (#219) (5251ab9)

feat

• dre: implementing a protection method for updating unassigned nodes (#151) (c4205d2)
• ci: Bump up the actions/cache to v4, and force overwriting the cache (#164) (f204cdc)
• registry-dump: Interpret vec data in registry structs as corresponding types (#175) (3be2000)
• release-notes: Show start and end commit in the release notes (#186) (4adbc7d)
• msd: metrics (#171) (a480f59)
• release: Proposing release index shema (#211) (31e9076)
• dre: Migrated firewall rules from release repo to dre tool (#221) (72ec3b3)
• rc: started work on rollout-controller (#224) (c6933c1)

chore

• deps: bump ipython from 8.20.0 to 8.21.0 (#157) (2778165)
• deps: bump ansible from 9.1.0 to 9.2.0 (#156) (d9d5eef)
• Update dependencies (#160) (edbbdc0)
• Update dependencies (#168) (308f707)
• pre-commit: remove the legacy filter of the ic submodule (#177) (350bd58)
• dashboard: Update the version of prometheus-http-client (#178) (989ca8d)
• deps: bump the npm_and_yarn group across 1 directories with 1 update (#163) (bb86e0d)
• deps: bump pre-commit from 3.6.0 to 3.6.1 (#184) (6f8eec2)
• deps: bump mkdocs-material from 9.5.7 to 9.5.9 (#183) (761a6ac)
• deps: bump atlassian-python-api from 3.41.9 to 3.41.10 (#182) (9aa3dfd)
• deps: bump the cargo-dependencies group with 8 updates (#185) (20d654e)
• msd: Improvements and cleanup (#188) (9425eba)
• deps: bump mkdocs-material from 9.5.9 to 9.5.11 (#210) (d2ca785)
• Update dependencies (#199) (a8ee432)
• deps-dev: bump black from 24.1.1 to 24.2.0 (#201) (0411fd7)
• Update dependencies (#223) (8d45d43)
• deps: bump poetry from 1.8.1 to 1.8.2 (#226) (ed7142b)

refactor

• MSD: migrate warp to axum (#162) (096ed24)

v0.2.1 (2024-1-30)

fix

• k8s: adding timeout option (#79) (5842d80)
• k8s: migrating to using gitlab api (#87) (5ebed78)
• ci: Run CI actions on PR and merge queues as well (#94) (e11a3a2)
• docs: Update the links for running the trustworthy metrics notebook online (#92) (c676c03)
• dashboard: Automatically update the internal dashboard k8s deployment (#96) (d6db5ee)
• ci: Update the reference to the gitlab api token (#98) (fb5c3dc)
• ci: Cloning k8s repo to the correct directory (#103) (0eab50d)
• dashboard: Use Debian Slim base image for OCI images by default (#105) (a93c44b)
• dashboard: Use OCI images that have ca-certs and new glibc (#108) (0ec6e76)
• dashboard: go back to the bitnami git image as distroless has no git :/ (#112) (f76f58c)
• ci: Correctly pass secrets to the k8s-deployments composite actions (#120) (41f0ce3)
• bazel: Update build configuration and version information (#121) (c85c81f)
• ci: Prepare releases as a GH composite action instead of a workflow (#134) (d1fe2c7)

feat

• ci: nightly job to completely clean up bazel caches (9d8593d)
• ci: nightly job to completely clean up bazel caches (258e3b8)
• ci: Enable grouping of dependabot PRs (#101) (997d01f)
• ci: Nightly update dependencies and cache (#102) (54491c6)
• ci: Create a PR on nightly CI runs instead of pushing to main directly (#114) (53c2def)
• release-notes: Migrate the release notes script to the DRE repo (#119) (19c0c08)

chore

• ci: Remove a duplicate step from the bazel workflow (#109) (9dd26cb)
• deps: bump ansible from 8.7.0 to 9.1.0 (#84) (71e0f91)
• deps-dev: bump black from 23.12.1 to 24.1.1 (#124) (3c8c45c)
• deps: bump clickhouse-connect from 0.6.23 to 0.7.0 (#125) (617335e)
• deps: bump mkdocs-material from 9.5.4 to 9.5.6 (#123) (53bed11)

docs

• Add some tips and tricks for our k8s ops (#115) (fd165ed)
• Update the readme and some more docs (#117) (3f78296)

v0.2.0 (2024-1-19)

fix

• mark jq as executable after downloading (575d214)
• cd to the ic repo when checking the newest revision (02d39bb)
• accept non-blessed binaries by default (a2f210e)
• Decentralization: 1/3 limit is a strict 1/3, not 1/3-1 (51eb5e5)
• backend: Make registry polling less frequent to improve robustness (d86a0a2)
• Increase timeout for the qualification test (8265432)
• cli: Handle missing commit hash in the release notes (d151a74)
• Minor adjustments in the IC-OS verification instructions (7ac6a08)
• Dashboard releases only from master (b234fae)
• Release qualification should not wait block on dashboard publish (38f27ac)
• Build verification instructions should work with existing old image (aacbcad)
• cli: Do not inject dry-run and confirmation if --help provided (85fc786)
• cli: Do not supply auth args to ic-admin get commands (c4a1705)
• cli: Fix auth for proposals to staging (937a643)
• cli: Fix instructions for verifying sha256 of the update image (68cd941)
• dashboard: Correctly show nodes as decentralized even if they are not in FactsDB (b83be5a)
• dashboard: Fix //rs code path references (f6d4a11)
• dashboard: Sort subnets deterministically in the release rollout dashboard (9b71f7b)
• cli: Use zip_longest when showing a diff of node changes (db04589)
• backend: Retireable versions should not include actively used versions (2cf0f98)
• backend: Make more operations deterministic (c4f7745)
• Relax the p8s alert query, to include tickets and info alerts (f194640)
• cli: Ensure ic-admin version string does not have a newline (1d8291c)
• cli: Make --simulate a global arg and enable it for all subcommands (91aaf0b)
• ci: Variable name (a6b76be)
• backend: Only show node as degraded if ALERT is firing (2c5de64)
• backend: Show the correct number of nodes replaced instead of requested (d91e613)
• dashboard: Fix subnet id showing and searching (154478e)
• dashboard: tsc was complaining about types (60d587b)
• README: git hook install (8bf7611)
• cli: Verify the download URLs before submitting a proposal (0e71882)
• cli: Version unelect code fixed and cleaned up (17c839a)
• qualification: Brought back to life qualification on staging and factsdb (29f654a)
• backend: Unconditionally make a full clone of the IC repo (c2d1a31)
• scripts: The IC CDN does not have openssl-static-binaries anymore (42e6e60)
• backend: Only remove dead nodes from the registry by default (938d675)
• **bazel //:**mkdocs (294730a)
• ci: Use git repo cache in /tmp (51677d2)
• ci: git test for the ic repo does not work within bazel (fb5fdd6)
• ci: revert unnecessary change (bd51781)
• ci: Use older Ubuntu image to use older GLIBC (#49) (24e8cd9)
• multiservice-discovery: registry sync returns on missing nns_public_key and msd pings nns before adding the definition (#48) (deb0dfa)
• ci: Set the DRE cli version based on the tag or git rev (a741f80)
• k8s: setting larger python image for cursor-initializator-elastic (#75) (cd5d96d)

chore

• Update the staging bootstrap for the latest IC version (f9c8b65)
• bump up a few dependency versions (1d3e6cd)
• BOUN-525: setup config for certificate issuance (251c0c8)
• update neuron id for Ege -> Maksims (5cd9ec4)
• Update neuron 60 mapping to Andre Popovitch (4778970)
• Update the default ic-admin version used by the release_cli (3cc4859)
• Stop sending notifications to #eng-testing for ic-versions update (40b8e3a)
• Minor refactor in the IC version retire, no functional change (7177fa8)
• Hide neuron 20 in the NNS proposal notifications in slack (c53e03e)
• Update the neuron slack mapping (4051f9b)
• Another minor adjustment of the bless proposal summary (c1dc347)
• Do not mention @release-engs on automation proposals (116ba49)
• Update IC dependency and rustc version (093f701)
• Update the submodule update in the README.md (2bfbb09)
• Further adjust/restrict when some CI jobs run (6caee38)
• slack: Update the slack-neuron mappings (fc25887)
• Bump up a few more dependencies (aa875ad)
• cli: Update the instructions for verifying the IC image sha256 (630756c)
• cli: Fix retire version message (6fe9998)
• Bump up the IC dependency version (8528ba0)
• decentralization: Count and try to reduce the number of nodes of dominant actors in a subnet (54fedb8)
• cli: Show the used ic-admin version, for clarity (16e9629)
• slack: Update neuron 42 mapping from Raghav to David (9729f2a)
• slack: Update neuron mapping Yvonne-Anne -> Maksym (8a6d4af)
• decentralization: Minor optimization in the calc of the Nakamoto Coefficients (29cbcb4)
• decentralization: Remove unused dependency (1af2cf4)
• dashboard: A few more subnet labels (39509d5)
• cli: Use short git versions in the elect version proposal title (56ce8a8)
• dashboard: Remove non-working dialog to Create Subnet (35c45cc)
• backend: Remove unnecessary serde_as usage (1a7e81b)
• cli: Remove the separate subcommand to retire replica versions (17aad3b)
• dashboard: Bump multiple dependency versions (IC and crates) (4e474a7)
• backend: Separate and simplify the function for displaying proposed subnet changes (73109b3)
• backend: Refactor backend and some other code, no functional change (9efc6e4)
• qualification: Remove unused elasticsearch data ingestion from qualification (a85c5eb)
• staging: Updating scripts for bootstrapping staging (cd34e17)
• Allow Python >3.8 and <4 in the repo (dc7e35f)
• Update neuron id -> slack id mappings (310cfed)
• factsdb: Publish factsdb results as public gitlab snippets (3f9123c)
• audit: Remove tracing-futures (4709c6f)
• cli: Minor improvements in argument parsing (74c85ef)
• cli: Improve voting robustness (583280b)
• Update neurons-slack-mapping.yaml to remove Marin and Luis (a15adb9)
• Update the Python to 3.11 and pre-commit config (9d332f5)
• backend: Remove erroneous prinln (7f64667)
• Update the Python to 3.11 and pre-commit config (b2b4603)
• canisters: Move canisters from //rs to separate dir (#44) (b22c357)
• deps: bump the pip group across 1 directories with 2 updates (#55) (b97ce2e)
• deps: bump the npm_and_yarn group across 2 directories with 1 update (#57) (75b6adb)
• Consolidate and deduplicate cargo deps (#64) (31bb6df)
• Bump multiple versions and prepare for a new release (#78) (c112389)

feat

• Accept min Nakamoto Coefficient for subnet create (73d17d0)
• Add an endpoint to query subnet decentralization (43bf059)
• cli: Add verbose option to print the node replacement search (fd3089d)
• Use decentralized nodes for replacements (5769778)
• dashboard: split lines in the subnet replace penalty explanations (445b165)
• slack: Add a link to the internal dashboard for the subnet membership changes (b2166c3)
• Random best Nakamoto score node choice (0676b19)
• cli: Adding ability to resize a subnet by adding or removing nodes (cd097f6)
• cli: Add support for excluding features or nodes when removing (36d0715)
• Increase verbosity if parsing refs fails, to aid debugging (5196692)
• backend: Support running with GITLAB_API_TOKEN env var (8ca3b25)
• backend: Improve the Nakamoto comparison (9d7149a)
• dashboard: CLI instructions for healing a subnet (6e1574a)
• a git hook to update ic submodule on git pull (b0e0c99)
• cli: Add github URL to the proposals for new IC version (4ab357a)
• cli: Support for a stand-alone CLI binary, part 1 (ed4cbc1)
• backend: Clone public IC repo instead of depending on private gitlab (e490a1d)
• dashboard: Support setting the ic repo cache dir from env (f649f18)
• cli: Include R2 download links into the elect proposals (d435d59)
• cli: Replace unhealthy nodes based on ALERTS (8febdea)
• staging: Make staging deployment less dependent on factsdb (1afebd8)
• cli: Strip md/html comments from release notes (1c809d6)
• backend: Add special handling for the European subnet (036c0ba)
• docs: Added mkdocs for documentation (9d9f184)
• observability: migrating code from IC repo (#46) (e9a363b)
• cargo: consolidate versions and project organization (#35) (dbf0cc3)
• ci: Make github releases on git tag push (#53) (378dcf3)
• ci: Automatically push containers if branch name starts with "container" (#65) (97b98ef)
• k8s: Moving k8s python scripts to our repo (#70) (e72e874)
• k8s: adding missing script for creating tables in clickhouse (#72) (eed35d8)

docs

• mkdocs: deploy mkdocs (#66) (cdbe31f)
• adding some content (#67) (fe3941d)
• Add docs for trustworthy node metrics (#71) (7df6bb4)
• Update docs and dependencies for trustworthy metrics (#76) (4b7d594)
• Update docs and dependencies for trustworthy metrics (9b17936)
• Add architectural doc for trustworthy node metrics (#77) (d20c679)

::> 1000 commits in 5 version tags, last considered commit: e6229b71100b863829e292fa3e28957572572f26