A simple scraper for TripAdvisor (Hotel, Restaurant, Airline) reviews.

Build & Push [Container Provisioner]

Build & Push [Scraper]

Build & Push [VPN Worker]

CodeQL

• TripAdvisor-Review-Scraper
• Current Issues
  • Table of Contents
  • Requirements
    • How to Install Docker:
  • Project Layout
    • Scraper
    • Container Provisioner
    • Proxy Pool

1. Go +v1.21
2. Make [Optional]
3. Docker [Optional]
4. Docker Compose [Optional]
5. Node.js +18 [Optional. Only required if you want to use the scraper written in Node.js, which is deprecated.]

1. Windows
2. Mac
3. Linux

There are 2 scrapers available:

1. Scraper written in Go
2. Scraper written in Node.js [Deprecated]

The scraper written in Go is preferred because it calls the API directly and is much faster than the scraper written in Node.js which goes the traditional way of parsing HTML. The instructions of how to use them are located in their separate folders.

Automates the process of provisioning containers for the scraper.

Please read more about the container provisioner here

Provides a pool of proxies for the scraper to use.

Please read more about the proxy pool here