Predicting flight delays with weather data.
Database initialization files are located in the dataset-and-model
branch, under the design folder in all.sql.
Note!! Due to an error with the weather prediction website during the presentation, another method was temporarily used. You'll need to add the same attributes from departureweather
(year, month, day, normal_prob, mild_prob, moderate_prob, serious_prob
) to the arriveweather
table and delete the date
attribute.
Next, you need to INSERT data into the airline
and airport
tables, which are located in the delay-master
branch's modelTrain/predict/dict_id.csv
and the dataset-and-model
branch's dataset/airport.csv
, respectively.
Finally, don't forget to reconfigure your (cloud) database in API/algorithm.py
and API/loginAndRegister.py
.
During the defense, the weather site being scraped was temporarily down, so weather predictions were replaced with data from the same day in previous years. It can now be used again. If you need to reintegrate weather predictions, you can restore the weather prediction function in algorithm.py (if I recall correctly).
A flight delay prediction system based on previous years' flight and weather information.
Data Cleaning Project:
- First, manually create an airport-city code reference dictionary based on the original flight information data. Only a selection of airports is chosen.
- Fill in the corresponding airport longitude and latitude.
- First, clean: remove items where the departure and arrival airports are not in the provided reference airport dictionary.
- Second cleaning: remove duplicated items for the same flight route (i.e., where departure and arrival points are the same).
- The handling of the most original dataset also includes:
- Calculate the planned departure, arrival, actual departure, and arrival times from the original timestamp.
- Calculate the distance between different airports based on their longitude and latitude and integrate it into the corresponding flight information column.
- Scrape and fill in weather information using the constructed airport-city reference dictionary.
- First, construct daily weather information files for different cities in .CSV format.
- Scrape data through web crawlers and write to the city weather file.
- Use the city to locate the file to access; the estimated departure date to locate the specific item to fill.
- Finally, save the input to get the initially cleaned dataset.
Thanks goes to these wonderful people (emoji key):
npm install echarts@4.9 npm install --save-dev less-loader less
Routhleck Ekalesor 🔣 💻 |
是小柴同学吖 💻 🐛 🚇 |
Shichao 📖 🤔 📆 |
chenzefeng33 🎨 📦 |
hanjiang1073 🎨 📦 |
1avish 💻 |
This project follows the all-contributors specification. Contributions of any kind welcome!