Algorand BetaNet 3.12.2

Overview

Bugfixes related to catchpoints, performance enhancements, and additional logging.

Changelog

New Features

• Catchpoint Dump Utility: catchpointdump now supports tar.gz (#4743)

Enhancements

• API: Update oapi-codegen version to v1.12.0 of our fork (#4707)
• Accountdb: add migration 8 for resetting accounthashes on betanet (#4822)
• Algod: Consolidate models (#4714)
• Algod: Delete v1 usage from client and remove V2 prefix from APIs (#4767)
• Algod: Migrate internal uses of v1 algod API to v2 (#4684)
• Alphanet: update vAlpha5 to point to v36 (#4729)
• Catchpoints: Enrich catchpoint generation and status with KV metadata (#4808)
• Ci: Notify when CircleCI build failures for master and rel branches only (#4789)
• Ci: Notify when GHA workflow fails on master (#4791)
• Docs: Update SECURITY.md (#4782)
• Goal: Add URL to goal asset info. (#4731)
• Metrics: add TransactionGroupTxSyncHandled (#4815)
• Metrics: split out /Transaction/AssembleBlock metrics (#4795)
• Netgoal: start with at least 20GB RootStorage (#4779)
• Performance: turn cache misses during assembly into cache hits during eval (#4617)
• Performance: Don't preallocate rarely used maps in MakeStateDelta (#4715)
• Tech Debt: Reduce number of dependencies. (#4750)
• Telemetry: add TCP RTT info collection (#4745)
• Tests: Squelch macOS accept incoming network connections notifications (#4814)
• Tests: large generated accountdb cluster test (#4772)
• Tests: Fix txid-string comparison (#4792)
• Tests: Move box test artifacts to a temp directory (#4771)
• Tests: Lint for unparallelized tests without explicit reason (#4746)
• Tools: update catchpointdump 'database' and 'database check' commands to handle staging tables and KVs (#4802)
• Txhandler: add more metric (#4786)

Bugfixes

• Catchpoints: Add the kv hashes into the trie (#4812)
• Ci: Fix GHA failure notification trigger condition (#4810)
• Cow: always process KvMods to add OldData to mods when building StateDeltas (#4804)
• Daemon: pool error messages and old txn expiration (#4755)
• Goal: Change asset commands to use AccountAssetInformation (#4758)
• Tests: Fix resolver test endpoint (#4784)
• Tests: Fix types in assertions and change to using libgoal client when getting PendingTransaction information (#4754)
• Tests: disable TestWebsocketNetworkTelemetryTCP on CI (#4827)
• Txhandler: service does not restart after node catching up (#4809)
• Txsyncer: service does not start after node catching up (#4768)

Protocol Upgrade

This release does not contain a protocol upgrade.

Additional Resources

• Algorand Forum
• Developer Documentation

Algorand 3.11.3

Changelog

Bugfixes

• Check for large Topics length

Protocol Upgrade

This release does not contain a protocol upgrade.

Additional Resources

• Algorand Forum
• Developer Documentation

Algorand AlphaNet 3.12.0

IMPORTANT This is a DEVELOPER PREVIEW This release should not be deployed to a live network (e.g. BetaNet, TestNet, or MainNet)

Summary

New release of feature/alphanet branch for the alphanet network.

Test Plan

Build and deploy to the alphanet network.

Algorand BetaNet 3.12.0

IMPORTANT This release requires a protocol upgrade. This release contains a consensus protocol upgrade, which implements the following spec: https://github.com/algorandfoundation/specs/tree/44fa607d6051730f5264526bf3c108d51f0eadb6

IMPORTANT The keys used to sign the release packages have been renewed. See the instructions below on how to update for a specific system.

What's New

• AVM: box storage is now available. Apps can create an unlimited number of boxes for storing unstructured data.
• AVM: switch, match, and frame pointer opcodes are now available. These enable more efficient TEAL programs in terms of program length and computation.

Protocol Upgrade

This release contains a protocol upgrade.

Changelog

New Features

• AVM: match, pushints, and pushbytess opcodes (#4645)
• AVM: Add support for Boxes (#4149)

Enhancements

• API: bump max size of teal source and dryrun (#4633)
• Perf Test: Transaction group handle/verify (#4652)
• Consensus: v36 upgrade (#4722)
• Lint: enable go vet printf format arg checks for logging (#4679)
• Logging: demote LeaseInLedgerError from warn to info level (#4685)
• Netgoal: Update netgoal generate flags and variables (#4656)
• Performance: Agreement state serialization using msgp (#4644)
• Performance: don't create child cow in TestTransactionGroup (#4706)
• Prefetcher: enable prefetcher for assets and apps (#4352)
• Tests: 20221012 improvements (#4639)
• Tools: Allow specification of Reward Pool Account Balance in Genesis (#4643)

Bugfixes

• AVM: fix early eval exits for Debugger (#4719)
• Bug-fix: Blank Import Needs Commenting for Indexer's Lint (#4720)
• Bug-fix: return v2 spec from swagger endpoint (#4697)
• Catchpoint: actualize limit constants and fix txtail table init (#4703)
• Devops: update docker container for docker hub (#4723)
• Dispenser: add input validation (#4713)
• Network: align duplicateFilterCount to prevent panic on 32-bit platforms (#4702)

Activations (previously in vFuture)

• AVM: Switch opcode (#4458)

Additional Resources

• Algorand Forum
• Developer Documentation

How to Update Signing Key

Debian/Ubuntu

curl -o - https://releases.algorand.com/key.pub | sudo tee /etc/apt/trusted.gpg.d/algorand.asc

RHEL/RPM

curl -O https://releases.algorand.com/rpm/rpm_algorand.pub
sudo rpmkeys --import rpm_algorand.pub

Algorand 3.11.2

Overview

• This release disables cadaver file generation by default. This is a performance enhancement.
• This release fixes the issue of when an account had many resources, it could break catching up from a catchpoint.
• This release contains improvements to network propagation, through opportunistic compression.

Changelog

Enhancements

• Algod: turn off cadaver trace file by default (#4676)
• Pingpong: add genaccountsoffset flag and tool to print test account addresses (#4628)
• Tests: Consistent resource/account struct tests (#4669)
• V1 Deprecation: Remove algod and kmd client affinity and consolidate APIs to use newest version (#4641)
• Batch-verify: Return failed sig indexes (#4614)
• Cicd: reduce mmnet LastPartKeyRound to 50k (#4625)
• Devops: Update betanet model recipe, move NPN hosts to regions not shared by hosts for relays and nodes (#4588)
• Goal: don't mark app-arg as hidden for account command (#4629)
• Metrics: Remove labels from gauge metrics (#4606)
• Network: proposal payload compression (#4589)
• Tests: extend transactions signature verification testing (#4623)

Bugfixes

• Batchverifier: preserve the memory until the end (#4672)
• Catchpoints: don't make duplicate account hashes in prepareNormalizedBalances (#4668)
• Pingpong: fix config check for GeneratedAccountsMnemonics (#4662)
• Tools: fix lagging cinfo.AppParams data structure in PingPong (#4613)

Protocol Upgrade

This release does not contain a protocol upgrade.

Additional Resources

• Algorand Forum
• Developer Documentation

Algorand BetaNet 3.11.2

Overview

This release disables cadaver file generation by default. This is a performance enhancement.

Changelog

Enhancements

• Algod: turn off cadaver trace file by default (#4676)
• Tests: Consistent resource/account struct tests (#4669)

Protocol Upgrade

This release does not contain a protocol upgrade.

Additional Resources

• Algorand Forum
• Developer Documentation

Algorand BetaNet 3.11.1

Overview

When an account had many resources, it could break catching up from a catchpoint. This release fixes this issue.

What's New

• Bug fix for catchpoint catchup
• Fix for garbage collection in batch verifier
• Other small enhancements and fixes

Changelog

Enhancements

• Pingpong: add genaccountsoffset flag and tool to print test account addresses (#4628)
• V1 Deprecation: Remove algod and kmd client affinity and consolidate APIs to use newest version (#4641)

Bugfixes

• Batchverifier: preserve the memory until the end (#4672)
• Catchpoints: don't make duplicate account hashes in prepareNormalizedBalances (#4668)
• Pingpong: fix config check for GeneratedAccountsMnemonics (#4662)

Protocol Upgrade

This release does not contain a protocol upgrade.

Additional Resources

• Algorand Forum
• Developer Documentation

Algorand BetaNet 3.11.0

Overview

This release contains improvements to network propagation, through opportunistic compression.

What's New

• Proposal payload compression

Changelog

Enhancements

• Batch-verify: Return failed sig indexes (#4614)
• Cicd: reduce mmnet LastPartKeyRound to 50k (#4625)
• Devops: Update betanet model recipe, move NPN hosts to regions not shared by hosts for relays and nodes (#4588)
• Goal: don't mark app-arg as hidden for account command (#4629)
• Metrics: Remove labels from gauge metrics (#4606)
• Network: proposal payload compression (#4589)
• Tests: extend transactions signature verification testing (#4623)

Bugfixes

• Tools: fix lagging cinfo.AppParams data structure in PingPong (#4613)

Protocol Upgrade

This release does not contain a protocol upgrade.

Additional Resources

• Algorand Forum
• Developer Documentation

Algorand 3.10.0

Overview

What's New

• Fix for excess warning logging related to fetching stateproof secrets
• REST API changes:
  • Add GetBlockHash API to algod v2
  • Return a 404 instead of a 500 when /v2/blocks/{round} fails due to a missing block
• Miscellaneous other small fixes
• Test improvements

Changelog

New Features

• AVM: Add Semicolon Parsing (#4363)
• REST API: Add GetBlockHash API to algod v2 (#4580)

Enhancements

• Alphanet: merge build changes and consensus params (#4431)
• Batchverifier: Rename and unexport local functions in verify/txn (#4578)
• Build: Remove mac_amd64 from our default triggered builds. (#4397)
• Build: adding valid_nightly_branch var to upload_binaries step (#4459)
• Catchpoint: Optimize catchpoint (#4254)
• Ci: Ensure algod_expect_test.go tests run by avoiding double partitioning (#4421)
• Ci: Expose configuration to ignore parent E2E expect test runner invocations (#4422)
• Ci: Four missing partiontest calls. And minor doc update. (#4394)
• Ci: Increase parallelism without changing resource_class for faster builds (#4448)
• Ci: Re-introduce build_nightly workflow to persist artifacts for upload_binaries (#4457)
• Ci: Speed up CircleCI by folding build workflow downstream (#4426)
• Ci: make windows build faster (#4443)
• Ci: optimize caches used by CircleCI and GHA (#4461)
• Ci: use GHA for codegen_verification (#4412)
• Cicd: Macos11 support (#4399)
• Cicd: Reordering circleci config (#4564)
• Codec: new TxHandler byte decoder (#4266)
• E2e Tests: tag e2e test data with commit hash (#4481)
• Lint: Update linter version (#4434)
• Lint: fix linter errors and update CI to require passing (#4241)
• Lint: ioutil is deprecated, I have the power of search and replace (#4440)
• Metrics: network tag filtering test (#4526)
• Performance: Update two transaction verification benchmarks (#4552)
• Performance: block validation benchmark (#4522)
• Quality: Switch from golint to golangci-lint. (#4418)
• REST API: Return a 404 when a block is not found. (#4479)
• Stateproof: always set StateProofNextRound in metric (#4475)
• Telemetry: add BlockAcceptedEventDetails.ReceivedAt to complement ValidatedAt (#4583)
• Telemetry: add StartupEventDetails.Overrides (#4563)
• Telemetry: Count and report the number of duplicate proposals and MsgDigestSkipTag messages received (#4605)
• Tests: Bump py-algorand-sdk to v1.17.0 (#4530)
• Tests: Get rid of references and uses of go lint and go vet (#4444)
• Tests: add debug output to e2e_basic_start_stop (#4396)
• Tests: add timestamps to some expect common operations (#4437)
• Tests: benchmark assemble / transaction pool's uses of recomputeBlockEvaluator (#3138)
• Tests: betanet-2 extended recipe (#4572)
• Tests: fix TestAttestorsChange (#4510)
• Tests: improve logging in expect tests (#4405)
• Tests: ledger reload accessing txtail history (#4473)
• Tests: script improvements for recent testing (#4474)
• Tests: skip db concurrent Read/Write tests if test.short is set (#4533)
• Tests: stop network before reading logs (#4429)
• Tools: netgoal generate add -X, --non-participating-nodes int (#4574)
• Tools: pingpong improvements (#4294)
• Tools: tool to dump blocks to directory (#4595)
• Typo Fix: "Transcation" to "Transaction" (#4248)

Bugfixes

• AVM: Handle Teal programs with manual constant blocks better (#4442)
• Algod: changed state proof message to no longer be embedded (#4395)
• Algod: fix nil deref while fetching stateproof secrets (#4554)
• Bugfix: download more block to recover old state proofs (#4392)
• Catchpoint: fix peer ranking (#4535)
• Catchup: increase HTTPFetcher fetcherMaxBlockBytes for larger block size (#4569)
• Cicd: Fixing golangci-lint and github action (#4483)
• E2e Tests: remove unused e2e artifact (#4487)
• Ledger: Initialize the accountUpdatesLedgerEvaluator properly (#4456)
• Ledger: do not shadow db error in account lookup (#4425)
• Ledger: extend catchpoint blocks lookback (#4463)
• Ledger: fix TestCatchpointReadDatabaseOverflowSingleAccount (#4579)
• Ledger: fix accounts cache ordering (#4611)
• Ledger: fix catchpoint test (#4480)
• Ledger: fix txtail restoring from catchpoints (#4460)
• Ledger: fix typo in evalbench_test.go (#4450)
• Loadgenerator: correctly handle AccountMnemonicList (#4454)
• State Proofs: update state proof totals calculation (#4445)
• Stateproofs: Make SP e2e tests easier for arm. (#4402)
• Tech Debt: Remove unused/empty algod API spec (#4420)
• Tests: Acquire locks when logging start and stop. (#4408)
• Tests: Add logging to libgoal fixture on failure (#4384)
• Tests: Convert goal app info expect test to e2e (#4449)
• Tests: Fix restClientFixture test flaking (#4484)
• Tests: Fix voterTracker tests (#4441)
• Tests: TestSlowPeerDisconnect less flakey (#4453)
• Tests: deprecate TestAsyncRecord (#4407)
• Tests: deterministic rand seed for stable unit test (#4447)
• Tests: fix TestBasicCatchpointCatchup (#4390)
• Tests: fix logged panics in reproducible labels test (#4446)
• Tests: fix method name after typo correction (#4561)
• Tests: fix network metrics race condition in tests (#4529)
• Tests: fix top online warning in TestAcctUpdatesCachesInitialization (#4451)
• Tests: stabilize TestAssetCreateWaitRestartDelete (#4400)
• Tests: wait until new block is committed to BlockQueue...

Algorand BetaNet 3.10.0

Overview

What's New

• Fix for excess warning logging related to fetching stateproof secrets
• REST API changes:
  • Add GetBlockHash API to algod v2
  • Return a 404 instead of a 500 when /v2/blocks/{round} fails due to a missing block
• Miscellaneous other small fixes
• Test improvements

Changelog

New Features

• AVM: Add Semicolon Parsing (#4363)
• REST API: Add GetBlockHash API to algod v2 (#4580)

Enhancements

• Alphanet: merge build changes and consensus params (#4431)
• Batchverifier: Rename and unexport local functions in verify/txn (#4578)
• Build: Remove mac_amd64 from our default triggered builds. (#4397)
• Build: adding valid_nightly_branch var to upload_binaries step (#4459)
• Catchpoint: Optimize catchpoint (#4254)
• Ci: Ensure algod_expect_test.go tests run by avoiding double partitioning (#4421)
• Ci: Expose configuration to ignore parent E2E expect test runner invocations (#4422)
• Ci: Four missing partiontest calls. And minor doc update. (#4394)
• Ci: Increase parallelism without changing resource_class for faster builds (#4448)
• Ci: Re-introduce build_nightly workflow to persist artifacts for upload_binaries (#4457)
• Ci: Speed up CircleCI by folding build workflow downstream (#4426)
• Ci: make windows build faster (#4443)
• Ci: optimize caches used by CircleCI and GHA (#4461)
• Ci: use GHA for codegen_verification (#4412)
• Cicd: Macos11 support (#4399)
• Cicd: Reordering circleci config (#4564)
• Codec: new TxHandler byte decoder (#4266)
• E2e Tests: tag e2e test data with commit hash (#4481)
• Lint: Update linter version (#4434)
• Lint: fix linter errors and update CI to require passing (#4241)
• Lint: ioutil is deprecated, I have the power of search and replace (#4440)
• Metrics: network tag filtering test (#4526)
• Performance: Update two transaction verification benchmarks (#4552)
• Performance: block validation benchmark (#4522)
• Quality: Switch from golint to golangci-lint. (#4418)
• REST API: Return a 404 when a block is not found. (#4479)
• Stateproof: always set StateProofNextRound in metric (#4475)
• Telemetry: add BlockAcceptedEventDetails.ReceivedAt to complement ValidatedAt (#4583)
• Telemetry: add StartupEventDetails.Overrides (#4563)
• Telemetry: Count and report the number of duplicate proposals and MsgDigestSkipTag messages received (#4605)
• Tests: Bump py-algorand-sdk to v1.17.0 (#4530)
• Tests: Get rid of references and uses of go lint and go vet (#4444)
• Tests: add debug output to e2e_basic_start_stop (#4396)
• Tests: add timestamps to some expect common operations (#4437)
• Tests: benchmark assemble / transaction pool's uses of recomputeBlockEvaluator (#3138)
• Tests: betanet-2 extended recipe (#4572)
• Tests: fix TestAttestorsChange (#4510)
• Tests: improve logging in expect tests (#4405)
• Tests: ledger reload accessing txtail history (#4473)
• Tests: script improvements for recent testing (#4474)
• Tests: skip db concurrent Read/Write tests if test.short is set (#4533)
• Tests: stop network before reading logs (#4429)
• Tools: netgoal generate add -X, --non-participating-nodes int (#4574)
• Tools: pingpong improvements (#4294)
• Tools: tool to dump blocks to directory (#4595)
• Typo Fix: "Transcation" to "Transaction" (#4248)

Bugfixes

• AVM: Handle Teal programs with manual constant blocks better (#4442)
• Algod: changed state proof message to no longer be embedded (#4395)
• Algod: fix nil deref while fetching stateproof secrets (#4554)
• Bugfix: download more block to recover old state proofs (#4392)
• Catchpoint: fix peer ranking (#4535)
• Catchup: increase HTTPFetcher fetcherMaxBlockBytes for larger block size (#4569)
• Cicd: Fixing golangci-lint and github action (#4483)
• E2e Tests: remove unused e2e artifact (#4487)
• Ledger: Initialize the accountUpdatesLedgerEvaluator properly (#4456)
• Ledger: do not shadow db error in account lookup (#4425)
• Ledger: extend catchpoint blocks lookback (#4463)
• Ledger: fix TestCatchpointReadDatabaseOverflowSingleAccount (#4579)
• Ledger: fix accounts cache ordering (#4611)
• Ledger: fix catchpoint test (#4480)
• Ledger: fix txtail restoring from catchpoints (#4460)
• Ledger: fix typo in evalbench_test.go (#4450)
• Loadgenerator: correctly handle AccountMnemonicList (#4454)
• State Proofs: update state proof totals calculation (#4445)
• Stateproofs: Make SP e2e tests easier for arm. (#4402)
• Tech Debt: Remove unused/empty algod API spec (#4420)
• Tests: Acquire locks when logging start and stop. (#4408)
• Tests: Add logging to libgoal fixture on failure (#4384)
• Tests: Convert goal app info expect test to e2e (#4449)
• Tests: Fix restClientFixture test flaking (#4484)
• Tests: Fix voterTracker tests (#4441)
• Tests: TestSlowPeerDisconnect less flakey (#4453)
• Tests: deprecate TestAsyncRecord (#4407)
• Tests: deterministic rand seed for stable unit test (#4447)
• Tests: fix TestBasicCatchpointCatchup (#4390)
• Tests: fix logged panics in reproducible labels test (#4446)
• Tests: fix method name after typo correction (#4561)
• Tests: fix network metrics race condition in tests (#4529)
• Tests: fix top online warning in TestAcctUpdatesCachesInitialization (#4451)
• Tests: stabilize TestAssetCreateWaitRestartDelete (#4400)
• Tests: wait until new block is committed to BlockQueue...