McGill Course Scraper

A tiny CLI for scraping McGill's course information into JSON. Pulls information directly from McGill's public course website.

Usage

Simply run the scraper.js file with Node.js, along with an optional year flag (defaults to the current school year).

node scraper.js [-y <year>]

The scraper will find all courses offered in the Fall semester of the specified year, as well as the Winter and Summer semesters of the following year.

Once complete, the program will output a list of courses to a file in the data directory in JSON format. For example:

{
  "link": "/study/2018-2019/courses/comp-251",
  "name": "Algorithms and Data Structures",
  "department": "COMP",
  "courseNumber": 251,
  "numCredits": 3,
  "faculty": "Faculty of Science",
  "departmentName": "Computer Science",
  "level": [
    "Undergraduate"
  ],
  "termsOffered": [
    "Fall 2018",
    "Winter 2019"
  ]
}