Skip to content

Latest commit

 

History

History
33 lines (18 loc) · 933 Bytes

README.md

File metadata and controls

33 lines (18 loc) · 933 Bytes

URL Scraper 🔨

Tiny project to help collect URLs from pages banning autmated data collection.

Setup

  1. Clone the GitHub repo or download from the GitHub page and extract to your prefered location.

    git clone git@github.com:agnesk92/URLScraper.git
    
  2. On Chrome: Manage Extensions

  3. Set the mode to Developer on the top right corner

  4. Select the option 'Load unpacked', and choose the directory you downloaded the project in the first step.

  5. Now you can enable the extension.

Usage

To copy URL's: push shift+c.

When you release these keys, the extension will stop the collection.

Repeat to continue.

When you are ready, you can click on the extension icon and select the option 'Export to CSV' to download the results.

Refs

Icons made by Freepik from www.flaticon.com