This project is a simple web scraper that extracts posts from Instagram in real-time based on a specified hashtag. The scraper retrieves posts containing the hashtag and stores relevant information, such as text, code, and timestamp, for further processing or analysis.
- Real-time scraping: Continuously monitors Instagram for new posts related to a specified hashtag.
- Hashtag-based filtering: Only fetch posts that include the requested hashtag.
- Post data extraction: Extracts the post text, associated code, and timestamp.
- Efficient data storage: Stores posts in a structured format (e.g., JSON) for further use.
- Error handling: Handles potential network or rate limit errors.
- Go (Golang): Backend programming language.
- Instagram Web Scraping: Uses Instagram’s web page structure to fetch posts.
- JSON: Data format for storing and transferring post details.
- GORM: ORM used for database interaction if needed for storing data.
- Clone the repository:
cd instagram-scraper