Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DB Sig failed to download messages make it harder to see in the logs if there's something wrong. #112

Closed
haydonryan opened this issue Jul 16, 2024 · 3 comments · Fixed by #120

Comments

@haydonryan
Copy link

Thank you for your work on pacoloco. Love it, love that it exists and it's a great tool, especially the prefetch component.

I recently had a problem where I wasn't getting any updates. While scanning the logs I saw a bunch of db.sigs failed to download - normal I thought, then realized that the .db was also failing.

Would it be possible to put behind a flag (or just an if) to not download sigs for the DBs? It would make the logs much easier to find errors, and also to setup logging rules and alerting (to indicate when there is a problem)

@anatol
Copy link
Owner

anatol commented Jul 16, 2024

Could you please post the logs:

  • from pacman operation that failed for you. please add --debug flag and it will print a lot of useful information
  • from pacoloco when the failure happened

@haydonryan
Copy link
Author

let me try that again....

If you could add a flag that doesn't attempt to download (or doesn't show failures of downloading sigs.)

I had a problem where the dbs were failing to download (was a problem with the mirror) but the logs have been rotated already.

But to give you an idea - there's just a lot of 404s, it'd be really nice to suppress them.

Don't need help debugging what the issue was - I moved to a different mirror, but the 404s in the logs don't help.

pacoloco  | pacoloco.go:98: Reading config file from /etc/pacoloco.yaml
pacoloco  | prefetch.go:45: The prefetching routine will be run on 2024-07-17 03:00:00.003341699 -0500 CDT m=+69590.483171915
pacoloco  | pacoloco.go:141: Starting server at port 9129
pacoloco  | pacoloco.go:98: Reading config file from /etc/pacoloco.yaml
pacoloco  | prefetch.go:45: The prefetching routine will be run on 2024-07-17 03:00:00.000121745 -0500 CDT m=+69580.316519682
pacoloco  | pacoloco.go:141: Starting server at port 9129
pacoloco  | downloader.go:111: downloading http://mirror.lty.me/archlinux//core/os/x86_64/core.db
pacoloco  | pacoloco.go:273: serving cached file for archlinux/core/os/x86_64/core.db
pacoloco  | downloader.go:111: downloading http://mirror.lty.me/archlinux//core/os/x86_64/core.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/core/os/x86_64/core.db.sig: unable to download url http://mirror.lty.me/archlinux//core/os/x86_64/core.db.sig, status code is 404
pacoloco  | downloader.go:111: downloading http://mirrors.bjg.at/arch//core/os/x86_64/core.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/core/os/x86_64/core.db.sig: unable to download url http://mirrors.bjg.at/arch//core/os/x86_64/core.db.sig, status code is 404
pacoloco  | downloader.go:360: unable to download file archlinux/core/os/x86_64/core.db.sig
pacoloco  | pacoloco.go:168: unable to download file archlinux/core/os/x86_64/core.db.sig
pacoloco  | downloader.go:111: downloading http://mirror.lty.me/archlinux//extra/os/x86_64/extra.db
pacoloco  | pacoloco.go:273: serving cached file for archlinux/extra/os/x86_64/extra.db
pacoloco  | downloader.go:111: downloading http://mirror.lty.me/archlinux//extra/os/x86_64/extra.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/extra/os/x86_64/extra.db.sig: unable to download url http://mirror.lty.me/archlinux//extra/os/x86_64/extra.db.sig, status code is 404
pacoloco  | downloader.go:111: downloading http://mirrors.bjg.at/arch//extra/os/x86_64/extra.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/extra/os/x86_64/extra.db.sig: unable to download url http://mirrors.bjg.at/arch//extra/os/x86_64/extra.db.sig, status code is 404
pacoloco  | downloader.go:360: unable to download file archlinux/extra/os/x86_64/extra.db.sig
pacoloco  | pacoloco.go:168: unable to download file archlinux/extra/os/x86_64/extra.db.sig
pacoloco  | downloader.go:111: downloading http://mirror.lty.me/archlinux//community/os/x86_64/community.db
pacoloco  | pacoloco.go:273: serving cached file for archlinux/community/os/x86_64/community.db
pacoloco  | downloader.go:111: downloading http://mirror.lty.me/archlinux//community/os/x86_64/community.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/community/os/x86_64/community.db.sig: unable to download url http://mirror.lty.me/archlinux//community/os/x86_64/community.db.sig, status code is 404
pacoloco  | downloader.go:111: downloading http://mirrors.bjg.at/arch//community/os/x86_64/community.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/community/os/x86_64/community.db.sig: unable to download url http://mirrors.bjg.at/arch//community/os/x86_64/community.db.sig, status code is 404
pacoloco  | downloader.go:360: unable to download file archlinux/community/os/x86_64/community.db.sig
pacoloco  | pacoloco.go:168: unable to download file archlinux/community/os/x86_64/community.db.sig
pacoloco  | downloader.go:111: downloading http://mirror.lty.me/archlinux//core/os/x86_64/core.db
pacoloco  | pacoloco.go:273: serving cached file for archlinux/core/os/x86_64/core.db
pacoloco  | downloader.go:111: downloading http://mirror.lty.me/archlinux//core/os/x86_64/core.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/core/os/x86_64/core.db.sig: unable to download url http://mirror.lty.me/archlinux//core/os/x86_64/core.db.sig, status code is 404
pacoloco  | downloader.go:111: downloading http://mirrors.bjg.at/arch//core/os/x86_64/core.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/core/os/x86_64/core.db.sig: unable to download url http://mirrors.bjg.at/arch//core/os/x86_64/core.db.sig, status code is 404
pacoloco  | downloader.go:360: unable to download file archlinux/core/os/x86_64/core.db.sig
pacoloco  | pacoloco.go:168: unable to download file archlinux/core/os/x86_64/core.db.sig
pacoloco  | pacoloco.go:98: Reading config file from /etc/pacoloco.yaml
pacoloco  | prefetch.go:45: The prefetching routine will be run on 2024-07-17 03:00:00.002371331 -0500 CDT m=+69279.226566743
pacoloco  | pacoloco.go:141: Starting server at port 9129
pacoloco  | downloader.go:111: downloading https://mirror.osbeck.com/archlinux//core/os/x86_64/core.db
pacoloco  | downloader.go:111: downloading https://mirror.osbeck.com/archlinux//core/os/x86_64/core.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/core/os/x86_64/core.db.sig: unable to download url https://mirror.osbeck.com/archlinux//core/os/x86_64/core.db.sig, status code is 404
pacoloco  | downloader.go:111: downloading https://america.mirror.pkgbuild.com//core/os/x86_64/core.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/core/os/x86_64/core.db.sig: unable to download url https://america.mirror.pkgbuild.com//core/os/x86_64/core.db.sig, status code is 404
pacoloco  | downloader.go:360: unable to download file archlinux/core/os/x86_64/core.db.sig
pacoloco  | pacoloco.go:168: unable to download file archlinux/core/os/x86_64/core.db.sig
pacoloco  | downloader.go:111: downloading https://mirror.osbeck.com/archlinux//extra/os/x86_64/extra.db
pacoloco  | downloader.go:111: downloading https://mirror.osbeck.com/archlinux//extra/os/x86_64/extra.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/extra/os/x86_64/extra.db.sig: unable to download url https://mirror.osbeck.com/archlinux//extra/os/x86_64/extra.db.sig, status code is 404
pacoloco  | downloader.go:111: downloading https://america.mirror.pkgbuild.com//extra/os/x86_64/extra.db.sig
pacoloco  | downloader.go:77: unable to download file archlinux/extra/os/x86_64/extra.db.sig: unable to download url https://america.mirror.pkgbuild.com//extra/os/x86_64/extra.db.sig, status code is 404
pacoloco  | downloader.go:360: unable to download file archlinux/extra/os/x86_64/extra.db.sig
pacoloco  | pacoloco.go:168: unable to download file archlinux/extra/os/x86_64/extra.db.sig

@Jan64X
Copy link

Jan64X commented Nov 4, 2024

I'd like to do this aswell, the 404 downloads for the *.db.sig are very annoying in the log. Is there a flag that can be set to not download the .sig files?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants