my.sc.edu has an absolutely terrible web interface. This is a repository to download courses for viewing offline. Support is available for an SQL database. Work on a web interface is ongoing.
- GNU
make
(gmake
for BSD users) python3
pip
and modules fromrequirements.txt
. if not using a packaged version oflxml
, you will need- a working C compiler
- the
python-dev
library libxml2-dev
libxslt-dev
pdftotext
(part ofpoppler-utils
)chromedriver
tidy
- have all the information needed or useful to register on one page. this includes
- RateMyProfessor
- past grade distributions
- schedule planner or an equivalent
- degreeworks
- required textbooks
- parse_bookstore has yet to be implemented either in the makefile or in
parse sections
- all the
parse
functions should take a booleancreate
- if true, assert the output file does not exist
- if false, don't write headers
- the submit button for
index.html
is broken - add rules in the makefile for courses in past years.
- registering automatically. this would require storing the university
usernames and passwords of anyone who used the service. this is acceptable
for personal use (and feel free to do this,
login.py
is file you're looking for), but absolutely unacceptable for other users.
- SQL database:
make
- Web server:
make web
ormake server
- Dump of everything:
make dump
- Unit tests (the few we have):
make test
git clone https://github.com/jyn514/gradeforge
&& cd gradeforge- ln -s ../../scripts/pre-commit .git/hooks
- (optional) run
make data
to pre-populate the HTML
parse_section
does not parse days met properly if the times are different on different days. runmake
on branchbroken
for an example.- course['attributes'] is a tuple on
broken
; this crashescreate_sql.py
- please do not try to use gradeforge directly for parsing, the dependencies will drive you mad. use the beautiful makefile instead.
- data for grades is available back until 2008, but data for sections is only available until 2013.
- columns in grades ending in
_GF
stand for 'Grade Forgiveness' - png_for won't work for this semester (because the grades haven't been published). this sounds stupid but I was wracking my brains trying to figure out why it was broken.
- semester: a date in YYYYMM format, where MM is one of 01, 05, 08 and YYYY >= 2008; for example, 201608
- department: a department name which matches the regex [A-Z]{4}; for example, CSCE
- code: a class name which matches the regex [A-Z]?[0-9]{3}; for example, 145
- section: a section identifier which identifies an instance of a class; for example 001
- uid: a section identifier which is unique within a semester; matches the regex [0-9]{5}. for example, 84495