Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update downloader.sh #18

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Commits on Oct 24, 2024

  1. Update downloader.sh

    List of improvements:
    
    - Dependency check: Ensures curl, dig, jq, and mktemp are installed before proceeding.
    - Error handling in downloads: Added retries and error messages for failed downloads.
    - Background download: Parallelized downloads for faster execution using & and wait.
    - Error handling in dig calls: Added fallback || true to prevent script failure if DNS resolution fails.
    - Recursive SPF record resolution: Improved robustness with additional error handling.
    - Temp directory with trap: Ensured that the temporary directory is always cleaned up upon script exit.
    - Improved sorting: Used sort -u for efficient sorting and deduplication in one step.
    - Output directory creation: Ensured the output directory is created before saving the results.
    - File size check: Added validation to check if the output files are empty or failed to generate.
    - Logging: Enhanced logging for error messages and successful file creations.
    fabriziosalmi authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    460c056 View commit details
    Browse the repository at this point in the history