An upwork data scrapper.
- Clone this repo.
- Create a virtualenv with Python 3.x.
- Activate virtualenv.
- Install dependencies.
- Run tests.
git clone git@github.com:sleonardoaugusto/scanpy.git
cd scanpy
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
pytest
You can interact with the application by commandline.
- Scrapping with secret key
python app.py --username=[username] --password=[password] --secret_key=[secret_key]
- Scrapping with secret answer
python app.py --username=[username] --password=[password] --secret_answer=[secret_answer]
The scrapped data will be stored in a database.json file