-
Notifications
You must be signed in to change notification settings - Fork 762
Build Box
H1 and H3 builds occur automatically soon after new commits on our Jenkins-based build system. Following the link to Heritrix 3 (distribution bundles) will show the standard distributable bundles of a build.
Builds are also uploaded to our Maven2 repository:
http://builds.archive.org:8080/maven2/org/archive/heritrix/heritrix/
Development build version artifact names start with the version number they're approaching, and end "-SNAPSHOT". The actual development build products begin with the version number, and include a timestamp. So, for example, the latest H3 development build at the time of this writing, approaching a 3.1.0 final release, is made up of the latest-timestamped files available in the 3.1.0-SNAPSHOT directory.
Certain exact builds leading up to a final release may be named "-alpha", "-beta", "-RC1", "-RC2", etc. instead of "-SNAPSHOT" as necessary. The final release build is simply the version number, with no suffix, and will also be made available for download at Sourceforge.
Structured Guides:
User Guide
- Introduction
- New Features in 3.0 and 3.1
- Your First Crawl
- Checkpointing
- Main Console Page
- Profiles
- Heritrix Output
- Common Heritrix Use Cases
- Jobs
- Configuring Jobs and Profiles
- Processing Chains
- Credentials
- Creating Jobs and Profiles
- Outside the User Interface
- A Quick Guide to Creating a Profile
- Job Page
- Frontier
- Spring Framework
- Multiple Machine Crawling
- Heritrix3 on Mac OS X
- Heritrix3 on Windows
- Responsible Crawling
- Adding URIs mid-crawl
- Politeness parameters
- BeanShell Script For Downloading Video
- crawl manifest
- JVM Options
- Frontier queue budgets
- BeanShell User Notes
- Facebook and Twitter Scroll-down
- Deduping (Duplication Reduction)
- Force speculative embed URIs into single queue.
- Heritrix3 Useful Scripts
- How-To Feed URLs in bulk to a crawler
- MatchesListRegexDecideRule vs NotMatchesListRegexDecideRule
- WARC (Web ARChive)
- When taking a snapshot Heritrix renames crawl.log
- YouTube
- H3 Dev Notes for Crawl Operators
- Development Notes
- Spring Crawl Configuration
- Build Box
- Potential Cleanup-Refactorings
- Future Directions Brainstorming
- Documentation Wishlist
- Web Spam Detection for Heritrix
- Style Guide
- HOWTO Ship a Heritrix Release
- Heritrix in Eclipse