webscraping/sales-vg-sw.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Web scraping the weekly Japanese software videogame sales\n",
    "\n",
    "First I want to obtain a dataframe for the top 30 videogame sales using only one week, in order to test the code previous to the data minning.\n",
    "\n",
    "In the block below I am going to import the libraries that I'm using:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "from bs4 import BeautifulSoup\n",
    "import requests\n",
    "import pandas as pd\n",
    "import re\n",
    "import time\n",
    "import datetime\n",
    "import matplotlib.pyplot as plt\n",
    "import numpy as np\n",
    "import seaborn as sns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I'm going to use a week where there is at least one new release, as the row structure is different, as we will see. \n",
    "\n",
    "Below, using `requests` and `BeautifulSoup` I will obtain all the text from the first post.\n",
    "\n",
    "I will print it in screen to see the structure."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "url_tab = 'https://www.resetera.com/threads/media-create-sales-week-46-2018-nov-12-nov-18.82357/'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " \n",
      "Media Create Sales: Week 46, 2018 (Nov 12 - Nov 18) \n",
      "\n",
      "01./00.  [NSW] Pokemon: Let's Go, Pikachu! / Let's Go, Eevee! # <RPG> (Pokemon Co.) {2018.11.16} (¥5.980) - 661.240 / NEW \n",
      "02./00.  [PS4] Fallout 76 # <RPG> (Bethesda Softworks) {2018.11.15} (¥7.980) - 73.489 / NEW \n",
      "03./03. [NSW] Super Mario Party <ETC> (Nintendo) {2018.10.05} (¥5.980) - 20.942 / 345.627 (-10%)\n",
      "04./02. [PS4] Call of Duty: Black Ops IIII <ACT> (Sony Interactive Entertainment) {2018.10.12} (¥7.900) - 17.159 / 460.890 (-33%)\n",
      "05./00.  [PS4] Hitman 2 <ADV> (Warner Entertainment Japan) {2018.11.15} (¥7.800) - 10.162 / NEW \n",
      "06./01. [3DS] Luigi's Mansion <ACT> (Nintendo) {2018.11.08} (¥4.980) - 9.320 / 36.689 (-66%)\n",
      "07./05. [NSW] Mario Kart 8 Deluxe <RCE> (Nintendo) {2017.04.28} (¥5.980) - 9.319 / 1.836.063 (+10%)\n",
      "08./04. [PS4] Red Dead Redemption II # <ACT> (Take-Two Interactive Japan) {2018.10.26} (¥8.800) - 8.120 / 192.181 (-52%)\n",
      "09./07. [NSW] Splatoon 2 # <ACT> (Nintendo) {2017.07.21} (¥5.980) - 7.992 / 2.698.886 (+18%)\n",
      "10./06. [NSW] Minecraft <ADV> (Microsoft Game Studios) {2018.06.21} (¥3.600) - 7.449 / 365.347 (-1%)\n",
      "11./08. [NSW] The Legend of Zelda: Breath of the Wild # <ADV> (Nintendo) {2017.03.03} (¥6.980) - 6.215 / 1.159.398 (+9%)\n",
      "12./00.  [PS4] Yuuna and the Haunted Hot Springs: Steam Dungeon # <RPG> (FuRyu) {2018.11.15} (¥7.980) - 5.025 / NEW \n",
      "13./10. [NSW] Super Mario Odyssey # <ACT> (Nintendo) {2017.10.27} (¥5.980) - 3.990 / 1.845.682 (+6%)\n",
      "14./12. [3DS] Pokemon Ultra Sun / Ultra Moon <RPG> (Pokemon Co.) {2017.11.17} (¥4.980) - 3.493 / 1.760.304 (+4%)\n",
      "15./11. [PS4] Marvel's Spider-Man # <ADV> (Sony Interactive Entertainment) {2018.09.07} (¥6.900) - 3.134 / 305.030 (-17%)\n",
      "16./14. [NSW] Kirby Star Allies <ACT> (Nintendo) {2018.03.16} (¥5.980) - 2.958 / 642.205 (+0%)\n",
      "17./00.  [NSW] RPG Maker MV Trinity <ETC> (Kadokawa Games) {2018.11.15} (¥7.800) - 2.641 / NEW \n",
      "18./16. [NSW] Taiko no Tatsujin: Drum 'n' Fun! <ACT> (Bandai Namco Games) {2018.07.19} (¥6.100) - 2.181 / 225.417 (-12%)\n",
      "19./00.  [PS4] RPG Maker MV Trinity <ETC> (Kadokawa Games) {2018.11.15} (¥7.800) - 2.090 / NEW \n",
      "20./00.  [PSV] Shiro to Kuro no Alice: Twilight Line # <ADV> (Idea Factory) {2018.11.15} (¥6.300) - 2.087 / NEW \n",
      "21./21. [NSW] Mario Tennis Aces <SPT> (Nintendo) {2018.06.22} (¥5.980) \n",
      "22./15. [PS4] Assassin's Creed: Odyssey # <RPG> (Ubisoft) {2018.10.05} (¥8.400) \n",
      "23./22. [3DS] Animal Crossing: New Leaf - Welcome amiibo # <ETC> (Nintendo) {2016.11.23} (¥2.700) \n",
      "24./23. [PS4] Winning Eleven 2019 <SPT> (Konami) {2018.08.30} (¥7.600) \n",
      "25./17. [NSW] Cats Together <ETC> (Bandai Namco Games) {2018.11.01} (¥5.700) \n",
      "26./19. [PS4] Kingdom Hearts HD I.5 + II.5 ReMIX <Kingdom Hearts HD I.5 ReMIX <Kingdom Hearts \\ Kingdom Hearts Re:Chain of Memories> \\ Kingdom Hearts HD II.5 ReMIX <Kingdom Hearts II \\ Kingdom Hearts II: Final Mix+ \\ Kingdom Hearts: Birth by Sleep>> <RPG> (Square Enix) {2017.03.09} (¥6.800) \n",
      "27./25. [NSW] Captain Toad: Treasure Tracker <ADV> (Nintendo) {2018.07.13} (¥3.980) \n",
      "28./30. [NSW] FIFA 19 # <SPT> (Electronic Arts) {2018.09.28} (¥5.800) \n",
      "29./26. [NSW] Nintendo Labo Toy-Con 03: Drive Kit <EDU> (Nintendo) {2018.09.14} (¥6.980) \n",
      "30./18. [PS4] Warriors Orochi 4 # <ACT> (Koei Tecmo) {2018.09.27} (¥7.800) \n",
      "31./27. [NSW] Dragon Ball FighterZ <FTG> (Bandai Namco Games) {2018.09.27} (¥6.800) \n",
      "32./24. [PS4] The Legend of Heroes: Trails of Cold Steel IV - The End of Saga # <RPG> (Nihon Falcom) {2018.09.27} (¥7.800) \n",
      "33./31. [3DS] WarioWare Gold <ETC> (Nintendo) {2018.08.02} (¥4.980) \n",
      "34./35. [NSW] Pro Baseball Famista Evolution <SPT> (Bandai Namco Games) {2018.08.02} (¥6.100) \n",
      "35./28. [PS4] FIFA 19 # <SPT> (Electronic Arts) {2018.09.28} (¥7.800) \n",
      "36./00.  [NSW] Legendary Fishing <SPT> (Ubisoft) {2018.11.15} (¥4.800) \n",
      "37./09. [PS4] Tetris Effect <PZL> (Sony Interactive Entertainment) {2018.11.09} (¥4.167) \n",
      "38./29. [NSW] Dark Souls Remastered <Dark Souls \\ Dark Souls: Artorias of the Abyss> <RPG> (From Software) {2018.10.18} (¥4.800) \n",
      "39./38. [3DS] Mario Kart 7 # <RCE> (Nintendo) {2011.12.01} (¥4.571) \n",
      "40./00.  [NSW] Monster Hunter Generations Ultimate [Best Price] <ACT> (Capcom) {2018.11.15} (¥3.990) \n",
      "41./39. [NSW] Sumikko Gurashi: Atsumare! Sumikko Town <ETC> (Nippon Columbia) {2018.10.04} (¥5.800) \n",
      "42./20. [PS4] Soul Calibur VI <FTG> (Bandai Namco Games) {2018.10.18} (¥7.600) \n",
      "43./37. [3DS] Captain Toad: Treasure Tracker <ADV> (Nintendo) {2018.07.13} (¥3.980) \n",
      "44./47. [NSW] Pokken Tournament DX <FTG> (Pokemon Co.) {2017.09.22} (¥5.980) \n",
      "45./36. [PS4] Gran Turismo Sport # <RCE> (Sony Interactive Entertainment) {2017.10.19} (¥6.900) \n",
      "46./00. [PS4] Street Fighter 30th Anniversary Collection <Street Fighter \\ Street Fighter II \\ Street Fighter II: Champion Edition \\ Street Fighter II: Hyper Fighting \\ Super Street Fighter II \\ Super Street Fighter II Turbo \\ Street Fighter Alpha \\ Street Fighter Alpha 2 \\ Street Fighter Alpha 3 \\ Street Fighter III \\ Street Fighter III: 2nd Impact \\ Street Fighter III: 3rd Strike> # <FTG> (Capcom) {2018.10.25} (¥4.990) \n",
      "47./33. [NSW] Nintendo Labo Toy-Con 01: Variety Kit <EDU> (Nintendo) {2018.04.20} (¥6.980) \n",
      "48./40. [NSW] Warriors Orochi 4 # <ACT> (Koei Tecmo) {2018.09.27} (¥7.800) \n",
      "49./49. [3DS] Mario Party: The Top 100 <ETC> (Nintendo) {2017.12.28} (¥4.980) \n",
      "50./13. [PS4] Deracine |PlayStation VR| # <ADV> (Sony Interactive Entertainment) {2018.11.08} (¥3.000) \n",
      "\n",
      " Top 50 \n",
      "\n",
      "NSW - 24\n",
      "PS4 - 18\n",
      "3DS - 7\n",
      "PSV - 1\n",
      "\n",
      " SOFTWARE \n",
      "\n",
      "\n",
      "Code:\n",
      "\n",
      "\n",
      "+-------+------------+------------+------------+------------+------------+\n",
      "|System |  This Week |  Last Week |  Last Year |     YTD    |  Last YTD  |\n",
      "+-------+------------+------------+------------+------------+------------+\n",
      "|  ALL  |    959.000 |    259.000 |  1.345.000 | 21.524.000 | 26.051.000 |\n",
      "+-------+------------+------------+------------+------------+------------+\n",
      "\n",
      "HARDWARE\n",
      "\n",
      "\n",
      "Code:\n",
      "\n",
      "\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "|System |  This Week |  Last Week |  Last Year |     YTD    |  Last YTD  |     LTD     |\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "|  NSW  |    200.850 |     54.235 |     86.999 |  2.289.338 |  2.252.328 |   5.601.957 |\n",
      "| PS4 # |     17.789 |     16.081 |     26.302 |  1.376.944 |  1.465.880 |   7.269.347 |\n",
      "| 3DS # |      6.599 |      6.218 |     43.480 |    440.648 |  1.372.373 |  24.263.427 |\n",
      "| PSV # |      1.877 |      1.869 |      3.090 |    161.598 |    293.179 |   5.949.478 |\n",
      "| XB1 # |        164 |        406 |        247 |     13.345 |      8.071 |     101.781 |\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "|  ALL  |    227.279 |     78.809 |    160.207 |  4.281.873 |  5.427.250 |  43.185.990 |\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "| XB1 X |        119 |        360 |        143 |      8.953 |      1.487 |      11.127 |\n",
      "|  XB1  |         45 |         46 |        104 |      4.392 |      6.584 |      90.654 |\n",
      "|PS4 Pro|      8.867 |      7.927 |      8.176 |    382.143 |    302.708 |     922.449 |\n",
      "|  PS4  |      8.922 |      8.154 |     18.126 |    994.801 |  1.163.172 |   6.346.898 |\n",
      "|  PSV  |      1.877 |      1.869 |      3.090 |    161.598 |    293.179 |   5.764.027 |\n",
      "|n-2DSLL|      4.189 |      4.243 |     29.013 |    266.821 |    390.840 |     823.179 |\n",
      "|  2DS  |        622 |        294 |      3.113 |     31.326 |    181.821 |     525.549 |\n",
      "|n-3DSLL|      1.788 |      1.681 |     11.074 |    142.501 |    746.273 |   4.815.375 |\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "\n",
      "\n",
      " Famitsu Sales: Week 46, 2018 (Nov 12 - Nov 18) \n",
      "\n",
      "01./00.  [NSW] Pokemon: Let's Go, Pikachu! / Let's Go, Eevee! # <RPG> (Pokemon Co.) {2018.11.16} (¥5.980) - 664.198 / NEW <40-60%> \n",
      "02./00.  [PS4] Fallout 76 # <RPG> (Bethesda Softworks) {2018.11.15} (¥7.980) - 60.222 / NEW <60-80%> \n",
      "03./02. [NSW] Super Mario Party <ETC> (Nintendo) {2018.10.05} (¥5.980) - 17.486 / 326.510 <80-100%> (-15%)\n",
      "04./03. [PS4] Call of Duty: Black Ops IIII <ACT> (Sony Interactive Entertainment) {2018.10.12} (¥7.900) - 13.868 / 442.995 <80-100%> (-32%)\n",
      "05./01. [3DS] Luigi's Mansion <ACT> (Nintendo) {2018.11.08} (¥4.980) - 10.716 / 40.121 <40-60%> (-64%)\n",
      "06./00.  [PS4] Hitman 2 <ADV> (Warner Entertainment Japan) {2018.11.15} (¥7.800) - 10.688 / NEW <20-40%> \n",
      "07./05. [NSW] Mario Kart 8 Deluxe <RCE> (Nintendo) {2017.04.28} (¥5.980) - 9.948 / 1.849.467 <80-100%> (+14%)\n",
      "08./04. [PS4] Red Dead Redemption II # <ACT> (Take-Two Interactive Japan) {2018.10.26} (¥8.800) - 7.642 / 189.465 <80-100%> (-48%)\n",
      "09./06. [NSW] Minecraft <ADV> (Microsoft Game Studios) {2018.06.21} (¥3.600) - 7.504 / 366.272 <80-100%> (-2%)\n",
      "10./07. [NSW] Splatoon 2 # <ACT> (Nintendo) {2017.07.21} (¥5.980) - 7.482 / 2.736.533 <80-100%> (+11%)\n",
      "11./08. [NSW] The Legend of Zelda: Breath of the Wild # <ADV> (Nintendo) {2017.03.03} (¥6.980) - 5.463 / 1.121.636 <80-100%> (+12%)\n",
      "12./00.  [PS4] Yuuna and the Haunted Hot Springs: Steam Dungeon # <RPG> (FuRyu) {2018.11.15} (¥7.980) - 5.325 / NEW <40-60%> \n",
      "13./09. [3DS] Pokemon Ultra Sun / Ultra Moon # <RPG> (Pokemon Co.) {2017.11.17} (¥4.980) - 4.049 / 2.395.774 <80-100%> (+1%)\n",
      "14./10. [NSW] Super Mario Odyssey # <ACT> (Nintendo) {2017.10.27} (¥5.980) - 3.630 / 1.836.141 <80-100%> (-6%)\n",
      "15./00.  [PSV] Shiro to Kuro no Alice: Twilight Line # <ADV> (Idea Factory) {2018.11.15} (¥6.300) - 3.068 / NEW <40-60%> \n",
      "16./00.  [NSW] RPG Maker MV Trinity <ETC> (Kadokawa Games) {2018.11.15} (¥7.800) - 3.015 / NEW <20-40%> \n",
      "17./11. [PS4] Marvel's Spider-Man # <ADV> (Sony Interactive Entertainment) {2018.09.07} (¥6.900) - 2.849 / 294.847 <80-100%> (-13%)\n",
      "18./00.  [PS4] RPG Maker MV Trinity <ETC> (Kadokawa Games) {2018.11.15} (¥7.800) - 2.243 / NEW <20-40%> \n",
      "19./12. [NSW] Taiko no Tatsujin: Drum 'n' Fun! <ACT> (Bandai Namco Games) {2018.07.19} (¥6.100) - 2.188 / 224.930 <80-100%> (-5%)\n",
      "20./13. [NSW] Kirby Star Allies <ACT> (Nintendo) {2018.03.16} (¥5.980) - 2.049 / 619.949 <80-100%> (-4%)\n",
      "21./17. [PS4] Winning Eleven 2019 <SPT> (Konami) {2018.08.30} (¥7.600) - 1.841 / 137.378 <80-100%> (+3%)\n",
      "22./16. [PS4] Kingdom Hearts HD I.5 + II.5 ReMIX <Kingdom Hearts HD I.5 ReMIX <Kingdom Hearts \\ Kingdom Hearts Re:Chain of Memories> \\ Kingdom Hearts HD II.5 ReMIX <Kingdom Hearts II \\ Kingdom Hearts II: Final Mix+ \\ Kingdom Hearts: Birth by Sleep>> <RPG> (Square Enix) {2017.03.09} (¥6.800) - 1.728 / 215.144 <80-100%> (-12%)\n",
      "23./23. [NSW] Mario Tennis Aces <SPT> (Nintendo) {2018.06.22} (¥5.980) - 1.649 / 351.946 <80-100%> (+9%)\n",
      "24./22. [NSW] FIFA 19 # <SPT> (Electronic Arts) {2018.09.28} (¥5.800) - 1.524 / 36.375 <60-80%> (-6%)\n",
      "25./20. [PS4] FIFA 19 # <SPT> (Electronic Arts) {2018.09.28} (¥7.800) - 1.385 / 93.924 <80-100%> (-19%)\n",
      "26./25. [NSW] Dragon Ball FighterZ <FTG> (Bandai Namco Games) {2018.09.27} (¥6.800) - 1.254 / 44.146 <60-80%> (-13%)\n",
      "27./27. [3DS] Animal Crossing: New Leaf - Welcome amiibo # <ETC> (Nintendo) {2016.11.23} (¥2.700) - 1.239 / 407.238 <80-100%> (-3%)\n",
      "28./19. [PS4] Tetris Effect <PZL> (Sony Interactive Entertainment) {2018.11.09} (¥4.167) - 1.238 / 3.016 <20-40%> (-30%)\n",
      "29./14. [PS4] Assassin's Creed: Odyssey # <RPG> (Ubisoft) {2018.10.05} (¥8.400) - 1.237 / 83.996 <80-100%> (-39%)\n",
      "30./21. [NSW] Cats Together <ETC> (Bandai Namco Games) {2018.11.01} (¥5.700) - 1.202 / 5.979 <20-40%> (-26%)\n",
      "\n",
      " Top 30 \n",
      "\n",
      "NSW - 14\n",
      "PS4 - 12\n",
      "3DS - 3\n",
      "PSV - 1\n",
      "\n",
      "HARDWARE\n",
      "\n",
      "\n",
      "Code:\n",
      "\n",
      "\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "|System |  This Week |  Last Week |  Last Year |     YTD    |  Last YTD  |     LTD     |\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "|  NSW  |    180.585 |     53.385 |     90.303 |  2.210.304 |  2.280.094 |   5.617.462 |\n",
      "| PS4 # |     15.890 |     16.216 |     31.862 |  1.345.825 |  1.594.776 |   7.202.688 |\n",
      "| 3DS # |      6.056 |      6.041 |     40.582 |    481.959 |  1.538.817 |  24.220.503 |\n",
      "| PSV # |      1.818 |      1.668 |      2.716 |    167.213 |    347.156 |   5.810.839 |\n",
      "| XB1 # |        202 |        473 |        161 |     12.947 |      8.371 |     100.539 |\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "|  ALL  |    204.551 |     77.783 |    165.698 |  4.220.252 |  5.806.710 |  46.255.590 |\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "| XB1 X |        169 |        416 |         94 |      9.164 |      1.733 |      11.467 |\n",
      "| XB1 S |         33 |         57 |         67 |      3.783 |      1.856 |      17.070 |\n",
      "|PS4 Pro|      7.581 |      7.933 |      8.397 |    364.627 |    296.668 |     879.571 |\n",
      "|  PS4  |      8.309 |      8.283 |     23.465 |    981.198 |  1.298.108 |   6.323.117 |\n",
      "|  PSV  |      1.818 |      1.668 |      2.716 |    167.213 |    347.156 |   5.810.839 |\n",
      "|n-2DSLL|      3.719 |      3.724 |     28.004 |    300.123 |    405.149 |     887.674 |\n",
      "|  2DS  |        335 |        228 |      2.316 |     19.804 |    253.815 |     582.494 |\n",
      "| n-3DS |      2.002 |      2.089 |     10.262 |    162.032 |    879.853 |   5.830.058 |\n",
      "+-------+------------+------------+------------+------------+------------+-------------+\n",
      "\n",
      "Media Create / Famitsu database\n",
      "version 1.0.1 (2016 update) <-download it here\n",
      "\n",
      "Previous Threads\n",
      "2017 | 2018\n",
      "\n",
      "Media Create Sales: Week 45, 2018 (Nov 05 - Nov 11)\n"
     ]
    }
   ],
   "source": [
    "def obtain_post(url):\n",
    "    # With request and with the BeautifulSoup class we obtain the code of the page of the URL.\n",
    "    post = requests.get(url)\n",
    "    soup = BeautifulSoup(post.text)\n",
    "    # Divide the code in posts\n",
    "    post_data=soup.findAll(\"div\", {\"class\": \"bbWrapper\"})\n",
    "    # Obtain the text inside the first post\n",
    "    return post_data[0].text\n",
    "\n",
    "\n",
    "tab_top30=obtain_post(url_tab)\n",
    "print(tab_top30)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I want to obtain the Famitsu Sales, as the Media Create no longer share the data. So I need to identify where the Famitsu numbers begin and divide the rows. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[\"01./00.  [NSW] Pokemon: Let's Go, Pikachu! / Let's Go, Eevee!<RPG> (Pokemon Co.) {2018.11.16} (¥5.980) - 664.198 / NEW <40-60%> \",\n",
       " '02./00.  [PS4] Fallout 76<RPG> (Bethesda Softworks) {2018.11.15} (¥7.980) - 60.222 / NEW <60-80%> ',\n",
       " '03./02. [NSW] Super Mario Party <ETC> (Nintendo) {2018.10.05} (¥5.980) - 17.486 / 326.510 <80-100%> (-15%)',\n",
       " '04./03. [PS4] Call of Duty: Black Ops IIII <ACT> (Sony Interactive Entertainment) {2018.10.12} (¥7.900) - 13.868 / 442.995 <80-100%> (-32%)',\n",
       " \"05./01. [3DS] Luigi's Mansion <ACT> (Nintendo) {2018.11.08} (¥4.980) - 10.716 / 40.121 <40-60%> (-64%)\",\n",
       " '06./00.  [PS4] Hitman 2 <ADV> (Warner Entertainment Japan) {2018.11.15} (¥7.800) - 10.688 / NEW <20-40%> ',\n",
       " '07./05. [NSW] Mario Kart 8 Deluxe <RCE> (Nintendo) {2017.04.28} (¥5.980) - 9.948 / 1.849.467 <80-100%> (+14%)',\n",
       " '08./04. [PS4] Red Dead Redemption II<ACT> (Take-Two Interactive Japan) {2018.10.26} (¥8.800) - 7.642 / 189.465 <80-100%> (-48%)',\n",
       " '09./06. [NSW] Minecraft <ADV> (Microsoft Game Studios) {2018.06.21} (¥3.600) - 7.504 / 366.272 <80-100%> (-2%)',\n",
       " '10./07. [NSW] Splatoon 2<ACT> (Nintendo) {2017.07.21} (¥5.980) - 7.482 / 2.736.533 <80-100%> (+11%)',\n",
       " '11./08. [NSW] The Legend of Zelda: Breath of the Wild<ADV> (Nintendo) {2017.03.03} (¥6.980) - 5.463 / 1.121.636 <80-100%> (+12%)',\n",
       " '12./00.  [PS4] Yuuna and the Haunted Hot Springs: Steam Dungeon<RPG> (FuRyu) {2018.11.15} (¥7.980) - 5.325 / NEW <40-60%> ',\n",
       " '13./09. [3DS] Pokemon Ultra Sun / Ultra Moon<RPG> (Pokemon Co.) {2017.11.17} (¥4.980) - 4.049 / 2.395.774 <80-100%> (+1%)',\n",
       " '14./10. [NSW] Super Mario Odyssey<ACT> (Nintendo) {2017.10.27} (¥5.980) - 3.630 / 1.836.141 <80-100%> (-6%)',\n",
       " '15./00.  [PSV] Shiro to Kuro no Alice: Twilight Line<ADV> (Idea Factory) {2018.11.15} (¥6.300) - 3.068 / NEW <40-60%> ',\n",
       " '16./00.  [NSW] RPG Maker MV Trinity <ETC> (Kadokawa Games) {2018.11.15} (¥7.800) - 3.015 / NEW <20-40%> ',\n",
       " \"17./11. [PS4] Marvel's Spider-Man<ADV> (Sony Interactive Entertainment) {2018.09.07} (¥6.900) - 2.849 / 294.847 <80-100%> (-13%)\",\n",
       " '18./00.  [PS4] RPG Maker MV Trinity <ETC> (Kadokawa Games) {2018.11.15} (¥7.800) - 2.243 / NEW <20-40%> ',\n",
       " \"19./12. [NSW] Taiko no Tatsujin: Drum 'n' Fun! <ACT> (Bandai Namco Games) {2018.07.19} (¥6.100) - 2.188 / 224.930 <80-100%> (-5%)\",\n",
       " '20./13. [NSW] Kirby Star Allies <ACT> (Nintendo) {2018.03.16} (¥5.980) - 2.049 / 619.949 <80-100%> (-4%)',\n",
       " '21./17. [PS4] Winning Eleven 2019 <SPT> (Konami) {2018.08.30} (¥7.600) - 1.841 / 137.378 <80-100%> (+3%)',\n",
       " '22./16. [PS4] Kingdom Hearts HD I.5 + II.5 ReMIX <Kingdom Hearts HD I.5 ReMIX <Kingdom Hearts \\\\ Kingdom Hearts Re:Chain of Memories> \\\\ Kingdom Hearts HD II.5 ReMIX <Kingdom Hearts II \\\\ Kingdom Hearts II: Final Mix+ \\\\ Kingdom Hearts: Birth by Sleep>> <RPG> (Square Enix) {2017.03.09} (¥6.800) - 1.728 / 215.144 <80-100%> (-12%)',\n",
       " '23./23. [NSW] Mario Tennis Aces <SPT> (Nintendo) {2018.06.22} (¥5.980) - 1.649 / 351.946 <80-100%> (+9%)',\n",
       " '24./22. [NSW] FIFA 19<SPT> (Electronic Arts) {2018.09.28} (¥5.800) - 1.524 / 36.375 <60-80%> (-6%)',\n",
       " '25./20. [PS4] FIFA 19<SPT> (Electronic Arts) {2018.09.28} (¥7.800) - 1.385 / 93.924 <80-100%> (-19%)',\n",
       " '26./25. [NSW] Dragon Ball FighterZ <FTG> (Bandai Namco Games) {2018.09.27} (¥6.800) - 1.254 / 44.146 <60-80%> (-13%)',\n",
       " '27./27. [3DS] Animal Crossing: New Leaf - Welcome amiibo<ETC> (Nintendo) {2016.11.23} (¥2.700) - 1.239 / 407.238 <80-100%> (-3%)',\n",
       " '28./19. [PS4] Tetris Effect <PZL> (Sony Interactive Entertainment) {2018.11.09} (¥4.167) - 1.238 / 3.016 <20-40%> (-30%)',\n",
       " \"29./14. [PS4] Assassin's Creed: Odyssey<RPG> (Ubisoft) {2018.10.05} (¥8.400) - 1.237 / 83.996 <80-100%> (-39%)\",\n",
       " '30./21. [NSW] Cats Together <ETC> (Bandai Namco Games) {2018.11.01} (¥5.700) - 1.202 / 5.979 <20-40%> (-26%)']"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "def obtain_top30_text(post_text):\n",
    "    tab_top=post_text.split(\"Famitsu Sales: Week\")[1]\n",
    "    tab_top=tab_top.replace(\" # \",\"\").split(\"\\n\")\n",
    "    return tab_top[2:32]\n",
    "\n",
    "clean_tab=obtain_top30_text(tab_top30)\n",
    "clean_tab"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now I need to create the most important function, the one that takes a row of the table in string form as an input and returns a list of formated data. I need to identify for each datapoint a regular rexpression that allows me to collect the desired information.\n",
    "\n",
    "The structure is different if it is a new release or not. Take a look for example *Fallout 76* and *Super Mario Party*. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "def mine_sw_info(temp):\n",
    "    row = []\n",
    "    # Postition and previous week position\n",
    "    row.append(int(re.findall(r\"[0-9].\",temp)[0]))\n",
    "    row.append(int(re.findall(r\"[0-9].\",temp)[1]))\n",
    "    # Find all things between [ ] and obtain the first one to get the system\n",
    "    row.append(re.findall(r\"\\[(.*?)\\]\",temp)[0])\n",
    "    # Find all things between < > and obtain the penultimate one to get the genre\n",
    "    row.append(re.findall(r\"\\<(.*?)\\>\",temp)[-2])\n",
    "    # Find all things between { } and obtain the last one to get the day of release\n",
    "    row.append(re.findall(r\"\\{(.*?)\\}\",temp)[-1])\n",
    "\n",
    "\n",
    "\n",
    "    if re.findall(r\"\\((.*?)\\)\",temp)[-1].find(\"%\") >= 0: # Not a new release\n",
    "        # Company\n",
    "        row.append(re.findall(r\"\\((.*?)\\)\",temp)[-3])\n",
    "        # Price\n",
    "        row.append(  int(re.findall(r\"\\((.*?)\\)\",temp)[-2].replace(\".\",\"\").replace(\"¥\",\"\")))\n",
    "        # Units this week\n",
    "        row.append(  int(re.findall(r\"\\)\\ \\-(.*?)\\/\",temp)[-1].replace(\".\",\"\")))\n",
    "        # Total units\n",
    "        row.append(  int(re.findall(r\"\\/(.*?)\\<\",temp)[-1].replace(\".\",\"\")))\n",
    "        # Percentage of sales\n",
    "        row.append(re.findall(r\"\\<(.*?)\\>\",temp)[-1])\n",
    "        # Change with respect to the last week in percentage\n",
    "        row.append(  int(re.findall(r\"\\((.*?)\\)\",temp)[-1].replace(\"%\",\"\").replace(\" \",\"\")))\n",
    "        # Add a boolean to indicate this is not a new release\n",
    "        row.append(  False )\n",
    "    else:\n",
    "        # Company\n",
    "        row.append(re.findall(r\"\\((.*?)\\)\",temp)[-2])\n",
    "        # Price\n",
    "        row.append(int(re.findall(r\"\\((.*?)\\)\",temp)[-1].replace(\".\",\"\").replace(\"¥\",\"\")))\n",
    "        # Units this week\n",
    "        row.append(int(re.findall(r\"\\)\\ \\-(.*?)\\/\",temp)[-1].replace(\".\",\"\")))\n",
    "        # Total Units = Units this week\n",
    "        row.append(int(re.findall(r\"\\)\\ \\-(.*?)\\/\",temp)[-1].replace(\".\",\"\")))\n",
    "        # Percentage of sales\n",
    "        row.append(re.findall(r\"\\<(.*?)\\>\",temp)[-1])\n",
    "        # Change with respect to the last week in percentage, so put 0 to indicate new\n",
    "        row.append(0)\n",
    "        # Add a boolean to indicate this is not a new release\n",
    "        row.append(  True )\n",
    "    \n",
    "    # Lastly, the name of the game\n",
    "    name=temp.split(f\"[{row[2]}]\")[-1].split(f\"<{row[3]}>\")[0]\n",
    "    row.append(name.lstrip().rstrip())\n",
    "    return row"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "With the previous function, now I can iterate through all the rows in the top 30 video game sales. I need to include a header to keep track of what is each column and to convert. Finally I convert it to a Pandas DataFrame and include the year, the number of week and the days range in the week."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "def create_top30_list(table_in,year,week,days,date):\n",
    "    # need to create the header and append the rows in the top 30 game list\n",
    "    header = [\"Position\", \"Position Last Week\",\"System\",\"Genre\",\"Launch Date\",\"Company\",\"Price\",\"Sales (this week)\",\n",
    "              \"LTD Sales\",\"Range Sales\",\"Change from last week\",\"Launch this week\",\"Game Title\"]\n",
    "    table_out=[header]\n",
    "    # For each row in the top 30 game list, it appends the formated info in the list\n",
    "    for row in table_in:\n",
    "        table_out.append(mine_sw_info(row))\n",
    "    \n",
    "    # Converting the list to a Pandas DataFrame\n",
    "    df = pd.DataFrame(table_out[1:],columns=table_out[0])\n",
    "    # Adds in this dataframe a column with the year, the week number,\n",
    "    # and the range of days in the week\n",
    "    df[\"Year\"]=year\n",
    "    df[\"Week\"]=week\n",
    "    df[\"Days\"]=days  \n",
    "    df[\"Date\"]=date\n",
    "    return df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now I'm going to check that everything works as it should..."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Position</th>\n",
       "      <th>Position Last Week</th>\n",
       "      <th>System</th>\n",
       "      <th>Genre</th>\n",
       "      <th>Launch Date</th>\n",
       "      <th>Company</th>\n",
       "      <th>Price</th>\n",
       "      <th>Sales (this week)</th>\n",
       "      <th>LTD Sales</th>\n",
       "      <th>Range Sales</th>\n",
       "      <th>Change from last week</th>\n",
       "      <th>Launch this week</th>\n",
       "      <th>Game Title</th>\n",
       "      <th>Year</th>\n",
       "      <th>Week</th>\n",
       "      <th>Days</th>\n",
       "      <th>Date</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>NSW</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2018.11.16</td>\n",
       "      <td>Pokemon Co.</td>\n",
       "      <td>5980</td>\n",
       "      <td>664198</td>\n",
       "      <td>664198</td>\n",
       "      <td>40-60%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Pokemon: Let's Go, Pikachu! / Let's Go, Eevee!</td>\n",
       "      <td>2018</td>\n",
       "      <td>46</td>\n",
       "      <td>nov 12 / nov 18</td>\n",
       "      <td>12/11/2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>PS4</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2018.11.15</td>\n",
       "      <td>Bethesda Softworks</td>\n",
       "      <td>7980</td>\n",
       "      <td>60222</td>\n",
       "      <td>60222</td>\n",
       "      <td>60-80%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Fallout 76</td>\n",
       "      <td>2018</td>\n",
       "      <td>46</td>\n",
       "      <td>nov 12 / nov 18</td>\n",
       "      <td>12/11/2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>NSW</td>\n",
       "      <td>ETC</td>\n",
       "      <td>2018.10.05</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>5980</td>\n",
       "      <td>17486</td>\n",
       "      <td>326510</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-15</td>\n",
       "      <td>False</td>\n",
       "      <td>Super Mario Party</td>\n",
       "      <td>2018</td>\n",
       "      <td>46</td>\n",
       "      <td>nov 12 / nov 18</td>\n",
       "      <td>12/11/2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>3</td>\n",
       "      <td>PS4</td>\n",
       "      <td>ACT</td>\n",
       "      <td>2018.10.12</td>\n",
       "      <td>Sony Interactive Entertainment</td>\n",
       "      <td>7900</td>\n",
       "      <td>13868</td>\n",
       "      <td>442995</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-32</td>\n",
       "      <td>False</td>\n",
       "      <td>Call of Duty: Black Ops IIII</td>\n",
       "      <td>2018</td>\n",
       "      <td>46</td>\n",
       "      <td>nov 12 / nov 18</td>\n",
       "      <td>12/11/2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>1</td>\n",
       "      <td>3DS</td>\n",
       "      <td>ACT</td>\n",
       "      <td>2018.11.08</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>4980</td>\n",
       "      <td>10716</td>\n",
       "      <td>40121</td>\n",
       "      <td>40-60%</td>\n",
       "      <td>-64</td>\n",
       "      <td>False</td>\n",
       "      <td>Luigi's Mansion</td>\n",
       "      <td>2018</td>\n",
       "      <td>46</td>\n",
       "      <td>nov 12 / nov 18</td>\n",
       "      <td>12/11/2018</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Position  Position Last Week System Genre Launch Date  \\\n",
       "0         1                   0    NSW   RPG  2018.11.16   \n",
       "1         2                   0    PS4   RPG  2018.11.15   \n",
       "2         3                   2    NSW   ETC  2018.10.05   \n",
       "3         4                   3    PS4   ACT  2018.10.12   \n",
       "4         5                   1    3DS   ACT  2018.11.08   \n",
       "\n",
       "                          Company  Price  Sales (this week)  LTD Sales  \\\n",
       "0                     Pokemon Co.   5980             664198     664198   \n",
       "1              Bethesda Softworks   7980              60222      60222   \n",
       "2                        Nintendo   5980              17486     326510   \n",
       "3  Sony Interactive Entertainment   7900              13868     442995   \n",
       "4                        Nintendo   4980              10716      40121   \n",
       "\n",
       "  Range Sales  Change from last week  Launch this week  \\\n",
       "0      40-60%                      0              True   \n",
       "1      60-80%                      0              True   \n",
       "2     80-100%                    -15             False   \n",
       "3     80-100%                    -32             False   \n",
       "4      40-60%                    -64             False   \n",
       "\n",
       "                                       Game Title  Year  Week  \\\n",
       "0  Pokemon: Let's Go, Pikachu! / Let's Go, Eevee!  2018    46   \n",
       "1                                      Fallout 76  2018    46   \n",
       "2                               Super Mario Party  2018    46   \n",
       "3                    Call of Duty: Black Ops IIII  2018    46   \n",
       "4                                 Luigi's Mansion  2018    46   \n",
       "\n",
       "              Days        Date  \n",
       "0  nov 12 / nov 18  12/11/2018  \n",
       "1  nov 12 / nov 18  12/11/2018  \n",
       "2  nov 12 / nov 18  12/11/2018  \n",
       "3  nov 12 / nov 18  12/11/2018  \n",
       "4  nov 12 / nov 18  12/11/2018  "
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df2=create_top30_list(clean_tab,2018,46,\"nov 12 / nov 18\",\"12/11/2018\")\n",
    "df2.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And it does!\n",
    "\n",
    "\n",
    "![it works](https://wb4son.com/wpblog/wp-content/uploads/2016/09/Alive.gif)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Getting all the data available to create the dataset\n",
    "\n",
    "The next step is to use this function *urbi et orbi*. I mean, to all post with this info in the ResetEra forum. \n",
    "\n",
    "There is a post with all links to each weekly post, so let's web scrap it... In the block of code below I am going to retrieve all links in the post and store them in `links`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "url=\"https://www.resetera.com/threads/media-create-sales-archive-thread.4115/\"\n",
    "ustitles = requests.get(url)\n",
    "soup = BeautifulSoup(ustitles.text)\n",
    "links=soup.findAll(\"a\", {\"class\": \"link link--internal\"}) "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Ok, so lets build the final loop to obtain the dataset."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "# List with the URL of each post\n",
    "links_clean=[]\n",
    "# List with the year, week number and range of days in the week\n",
    "links_data=[]\n",
    "# Empty dataframe where I will store the final dataset\n",
    "df_sw = pd.DataFrame()\n",
    "# A list with the links where something failed and the script didn't work\n",
    "error=[]\n",
    "# Dictionary with the numerical values of the month\n",
    "months={\"jan\":\"1\",\"feb\":\"2\",\"mar\":\"3\",\"apr\":\"4\",\"may\":\"5\",\"jun\":\"6\",\"jul\":\"7\",\"aug\":\"8\",\"sep\":\"9\",\"oct\":\"10\",\"nov\":\"11\",\"dec\":\"12\"}\n",
    "\n",
    "# Looping to mine the weekly data\n",
    "for el in links[::-1]:\n",
    "    # There are links where it is stored the yearly info instead of the weekly ones. \n",
    "    # We do not want these ones, so we use the following if statement to discard those.\n",
    "    # They have \"new-used\" in the title and in their URL, so it is easy.\n",
    "    if ( el.get('href').find(\"new-used\") < 0):\n",
    "        # Store the URL in a file\n",
    "        links_clean.append(el.get('href'))\n",
    "        time.sleep(1) # Just in case, to not to get an error due to do a lot of requests\n",
    "        try:\n",
    "            # Get the text table\n",
    "            text_tab=obtain_top30_text(obtain_post(links_clean[-1]))\n",
    "            # Obtain the year, week number and range of days in the week from the URL\n",
    "            # and store them in links_data\n",
    "            temp=links_clean[-1].split(\".\")[2].split(\"-\")[-6:]\n",
    "            temp_data=[int(temp[1]),int(temp[0]),temp[2]+\" \"+temp[3]+\" / \"+temp[4]+\" \"+temp[5],\n",
    "                              temp[3]+\"/\"+months[temp[2]]+\"/\"+temp[1]]\n",
    "            links_data.append(temp_data)\n",
    "            # Append the weekly info dataframe in the final dataset\n",
    "            df_sw=df_sw.append(create_top30_list(text_tab,temp_data[0],temp_data[1],temp_data[2],temp_data[3]))\n",
    "        except:  # If there was an erron, store the URL in the error list\n",
    "            error.append(links_clean[-1])\n",
    "\n",
    "# Reseting the final dataframe index\n",
    "df_sw=df_sw.reset_index()\n",
    "# Convert Date column to datetime\n",
    "df_sw[\"Date\"]=pd.to_datetime(df_sw[\"Date\"], infer_datetime_format=True)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>index</th>\n",
       "      <th>Position</th>\n",
       "      <th>Position Last Week</th>\n",
       "      <th>System</th>\n",
       "      <th>Genre</th>\n",
       "      <th>Launch Date</th>\n",
       "      <th>Company</th>\n",
       "      <th>Price</th>\n",
       "      <th>Sales (this week)</th>\n",
       "      <th>LTD Sales</th>\n",
       "      <th>Range Sales</th>\n",
       "      <th>Change from last week</th>\n",
       "      <th>Launch this week</th>\n",
       "      <th>Game Title</th>\n",
       "      <th>Year</th>\n",
       "      <th>Week</th>\n",
       "      <th>Days</th>\n",
       "      <th>Date</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>NSW</td>\n",
       "      <td>TBL</td>\n",
       "      <td>2020.11.19</td>\n",
       "      <td>Konami</td>\n",
       "      <td>6300</td>\n",
       "      <td>107064</td>\n",
       "      <td>1617601</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>23</td>\n",
       "      <td>False</td>\n",
       "      <td>Momotaro Dentetsu: Showa, Heisei, Reiwa mo Tei...</td>\n",
       "      <td>2021</td>\n",
       "      <td>2</td>\n",
       "      <td>jan 11 / jan 17</td>\n",
       "      <td>2021-11-01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>NSW</td>\n",
       "      <td>ETC</td>\n",
       "      <td>2020.03.20</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>5980</td>\n",
       "      <td>36009</td>\n",
       "      <td>6553618</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-20</td>\n",
       "      <td>False</td>\n",
       "      <td>Animal Crossing: New Horizons</td>\n",
       "      <td>2021</td>\n",
       "      <td>2</td>\n",
       "      <td>jan 11 / jan 17</td>\n",
       "      <td>2021-11-01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>NSW</td>\n",
       "      <td>HOB</td>\n",
       "      <td>2019.10.18</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>7980</td>\n",
       "      <td>35397</td>\n",
       "      <td>2237398</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-20</td>\n",
       "      <td>False</td>\n",
       "      <td>Ring Fit Adventure</td>\n",
       "      <td>2021</td>\n",
       "      <td>2</td>\n",
       "      <td>jan 11 / jan 17</td>\n",
       "      <td>2021-11-01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>NSW</td>\n",
       "      <td>RCE</td>\n",
       "      <td>2017.04.28</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>5980</td>\n",
       "      <td>26636</td>\n",
       "      <td>3601699</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-22</td>\n",
       "      <td>False</td>\n",
       "      <td>Mario Kart 8 Deluxe</td>\n",
       "      <td>2021</td>\n",
       "      <td>2</td>\n",
       "      <td>jan 11 / jan 17</td>\n",
       "      <td>2021-11-01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>4</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>NSW</td>\n",
       "      <td>FTG</td>\n",
       "      <td>2018.12.07</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>7200</td>\n",
       "      <td>17099</td>\n",
       "      <td>4109327</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-29</td>\n",
       "      <td>False</td>\n",
       "      <td>Super Smash Bros. Ultimate</td>\n",
       "      <td>2021</td>\n",
       "      <td>2</td>\n",
       "      <td>jan 11 / jan 17</td>\n",
       "      <td>2021-11-01</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   index  Position  Position Last Week System Genre Launch Date   Company  \\\n",
       "0      0         1                   1    NSW   TBL  2020.11.19    Konami   \n",
       "1      1         2                   2    NSW   ETC  2020.03.20  Nintendo   \n",
       "2      2         3                   3    NSW   HOB  2019.10.18  Nintendo   \n",
       "3      3         4                   4    NSW   RCE  2017.04.28  Nintendo   \n",
       "4      4         5                   5    NSW   FTG  2018.12.07  Nintendo   \n",
       "\n",
       "   Price  Sales (this week)  LTD Sales Range Sales  Change from last week  \\\n",
       "0   6300             107064    1617601     80-100%                     23   \n",
       "1   5980              36009    6553618     80-100%                    -20   \n",
       "2   7980              35397    2237398     80-100%                    -20   \n",
       "3   5980              26636    3601699     80-100%                    -22   \n",
       "4   7200              17099    4109327     80-100%                    -29   \n",
       "\n",
       "   Launch this week                                         Game Title  Year  \\\n",
       "0             False  Momotaro Dentetsu: Showa, Heisei, Reiwa mo Tei...  2021   \n",
       "1             False                      Animal Crossing: New Horizons  2021   \n",
       "2             False                                 Ring Fit Adventure  2021   \n",
       "3             False                                Mario Kart 8 Deluxe  2021   \n",
       "4             False                         Super Smash Bros. Ultimate  2021   \n",
       "\n",
       "   Week             Days       Date  \n",
       "0     2  jan 11 / jan 17 2021-11-01  \n",
       "1     2  jan 11 / jan 17 2021-11-01  \n",
       "2     2  jan 11 / jan 17 2021-11-01  \n",
       "3     2  jan 11 / jan 17 2021-11-01  \n",
       "4     2  jan 11 / jan 17 2021-11-01  "
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sw.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>index</th>\n",
       "      <th>Position</th>\n",
       "      <th>Position Last Week</th>\n",
       "      <th>System</th>\n",
       "      <th>Genre</th>\n",
       "      <th>Launch Date</th>\n",
       "      <th>Company</th>\n",
       "      <th>Price</th>\n",
       "      <th>Sales (this week)</th>\n",
       "      <th>LTD Sales</th>\n",
       "      <th>Range Sales</th>\n",
       "      <th>Change from last week</th>\n",
       "      <th>Launch this week</th>\n",
       "      <th>Game Title</th>\n",
       "      <th>Year</th>\n",
       "      <th>Week</th>\n",
       "      <th>Days</th>\n",
       "      <th>Date</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>5035</th>\n",
       "      <td>25</td>\n",
       "      <td>26</td>\n",
       "      <td>23</td>\n",
       "      <td>NSW</td>\n",
       "      <td>FTG</td>\n",
       "      <td>2017.09.07</td>\n",
       "      <td>Bandai Namco Games</td>\n",
       "      <td>6800</td>\n",
       "      <td>2011</td>\n",
       "      <td>45219</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-33</td>\n",
       "      <td>False</td>\n",
       "      <td>Dragon Ball: Xenoverse 2 for Nintendo Switch</td>\n",
       "      <td>2017</td>\n",
       "      <td>42</td>\n",
       "      <td>oct 16 / oct 22</td>\n",
       "      <td>2017-10-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5036</th>\n",
       "      <td>26</td>\n",
       "      <td>27</td>\n",
       "      <td>17</td>\n",
       "      <td>PS4</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2017.09.28</td>\n",
       "      <td>Nihon Falcom</td>\n",
       "      <td>7800</td>\n",
       "      <td>1966</td>\n",
       "      <td>120050</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-55</td>\n",
       "      <td>False</td>\n",
       "      <td>The Legend of Heroes: Trails of Cold Steel III</td>\n",
       "      <td>2017</td>\n",
       "      <td>42</td>\n",
       "      <td>oct 16 / oct 22</td>\n",
       "      <td>2017-10-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5037</th>\n",
       "      <td>27</td>\n",
       "      <td>28</td>\n",
       "      <td>25</td>\n",
       "      <td>PS4</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2017.07.29</td>\n",
       "      <td>Square Enix</td>\n",
       "      <td>8980</td>\n",
       "      <td>1927</td>\n",
       "      <td>1321426</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-22</td>\n",
       "      <td>False</td>\n",
       "      <td>Dragon Quest XI: Echoes of an Elusive Age</td>\n",
       "      <td>2017</td>\n",
       "      <td>42</td>\n",
       "      <td>oct 16 / oct 22</td>\n",
       "      <td>2017-10-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5038</th>\n",
       "      <td>28</td>\n",
       "      <td>29</td>\n",
       "      <td>28</td>\n",
       "      <td>PS4</td>\n",
       "      <td>ACT</td>\n",
       "      <td>2015.10.08</td>\n",
       "      <td>Take-Two Interactive Japan</td>\n",
       "      <td>4990</td>\n",
       "      <td>1907</td>\n",
       "      <td>304725</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-8</td>\n",
       "      <td>False</td>\n",
       "      <td>Grand Theft Auto V [New Price Edition]</td>\n",
       "      <td>2017</td>\n",
       "      <td>42</td>\n",
       "      <td>oct 16 / oct 22</td>\n",
       "      <td>2017-10-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5039</th>\n",
       "      <td>29</td>\n",
       "      <td>30</td>\n",
       "      <td>13</td>\n",
       "      <td>PS4</td>\n",
       "      <td>SLG</td>\n",
       "      <td>2017.10.14</td>\n",
       "      <td>Sony Interactive Entertainment</td>\n",
       "      <td>4900</td>\n",
       "      <td>1906</td>\n",
       "      <td>6604</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>-59</td>\n",
       "      <td>False</td>\n",
       "      <td>No Heroes Allowed! VR |PlayStation VR|</td>\n",
       "      <td>2017</td>\n",
       "      <td>42</td>\n",
       "      <td>oct 16 / oct 22</td>\n",
       "      <td>2017-10-16</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      index  Position  Position Last Week System Genre Launch Date  \\\n",
       "5035     25        26                  23    NSW   FTG  2017.09.07   \n",
       "5036     26        27                  17    PS4   RPG  2017.09.28   \n",
       "5037     27        28                  25    PS4   RPG  2017.07.29   \n",
       "5038     28        29                  28    PS4   ACT  2015.10.08   \n",
       "5039     29        30                  13    PS4   SLG  2017.10.14   \n",
       "\n",
       "                             Company  Price  Sales (this week)  LTD Sales  \\\n",
       "5035              Bandai Namco Games   6800               2011      45219   \n",
       "5036                    Nihon Falcom   7800               1966     120050   \n",
       "5037                     Square Enix   8980               1927    1321426   \n",
       "5038      Take-Two Interactive Japan   4990               1907     304725   \n",
       "5039  Sony Interactive Entertainment   4900               1906       6604   \n",
       "\n",
       "     Range Sales  Change from last week  Launch this week  \\\n",
       "5035     80-100%                    -33             False   \n",
       "5036     80-100%                    -55             False   \n",
       "5037     80-100%                    -22             False   \n",
       "5038     80-100%                     -8             False   \n",
       "5039     80-100%                    -59             False   \n",
       "\n",
       "                                          Game Title  Year  Week  \\\n",
       "5035    Dragon Ball: Xenoverse 2 for Nintendo Switch  2017    42   \n",
       "5036  The Legend of Heroes: Trails of Cold Steel III  2017    42   \n",
       "5037       Dragon Quest XI: Echoes of an Elusive Age  2017    42   \n",
       "5038          Grand Theft Auto V [New Price Edition]  2017    42   \n",
       "5039          No Heroes Allowed! VR |PlayStation VR|  2017    42   \n",
       "\n",
       "                 Days       Date  \n",
       "5035  oct 16 / oct 22 2017-10-16  \n",
       "5036  oct 16 / oct 22 2017-10-16  \n",
       "5037  oct 16 / oct 22 2017-10-16  \n",
       "5038  oct 16 / oct 22 2017-10-16  \n",
       "5039  oct 16 / oct 22 2017-10-16  "
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sw.tail()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Only 2 of them returns an error, so we've got a very complete dataset using web scraping."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['https://www.resetera.com/threads/media-create-sales-week-32-2019-aug-05-aug-11.134991/',\n",
       " 'https://www.resetera.com/threads/media-create-sales-week-19-2019-may-06-may-12.117093/']"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "error"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And now I leave it to you to have fun with the dataset!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### A bit of fun with the database\n",
    "\n",
    "Now I will play a little bit with the dataset. For example, let's see the popularity of genres by checking the sum of the titles in the top 30. It seems that the most popular ones are action, RPG and adventure games."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "ACT    1534\n",
       "RPG     881\n",
       "ADV     812\n",
       "SPT     403\n",
       "ETC     357\n",
       "FTG     303\n",
       "RCE     219\n",
       "SLG     205\n",
       "HOB     148\n",
       "TBL      72\n",
       "EDU      49\n",
       "PZL      40\n",
       "STG      17\n",
       "Name: Genre, dtype: int64"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sw[\"Genre\"].value_counts()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now let's check the number of times a company made a game to be in the top 30. Nintendo seems to be dominating the top 30 charts in Japan, followed by Bandai Namco and Square Enix."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Nintendo                          1896\n",
       "Bandai Namco Games                 504\n",
       "Square Enix                        316\n",
       "Pokemon Co.                        287\n",
       "Sony Interactive Entertainment     192\n",
       "Capcom                             179\n",
       "Konami                             155\n",
       "Sega                               148\n",
       "Microsoft Game Studios             144\n",
       "Koei Tecmo                         141\n",
       "Name: Company, dtype: int64"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sw[\"Company\"].value_counts()[:10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And now the times a company made a game to be the best selling video game in the week. As before the most succesful company is Nintendo. The second and the third places belongs to Sony and the Pokemon Company."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Nintendo                          66\n",
       "Pokemon Co.                       16\n",
       "Sony Interactive Entertainment    16\n",
       "Konami                            13\n",
       "Bandai Namco Games                 9\n",
       "Capcom                             8\n",
       "Square Enix                        7\n",
       "Sega                               5\n",
       "Koei Tecmo                         4\n",
       "Atlus                              4\n",
       "Name: Company, dtype: int64"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sw[df_sw[\"Position\"] == 1][\"Company\"].value_counts()[:10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Checking the number of times a title made in the top 30, we see that there are 3 titles that, within the time range of the dataset, they appear in all top 30 weekly charts."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Mario Kart 8 Deluxe                                                             168\n",
       "The Legend of Zelda: Breath of the Wild                                         168\n",
       "Splatoon 2                                                                      168\n",
       "Super Mario Odyssey                                                             138\n",
       "Minecraft                                                                       133\n",
       "Super Mario Party                                                               118\n",
       "Super Smash Bros. Ultimate                                                      109\n",
       "New Super Mario Bros. U Deluxe <New Super Mario Bros. U \\ New Super Luigi U>    103\n",
       "Taiko no Tatsujin: Drum 'n' Fun!                                                101\n",
       "Pokemon Ultra Sun / Ultra Moon                                                   82\n",
       "Name: Game Title, dtype: int64"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sw[\"Game Title\"].value_counts()[:10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now let's see the number of times a game made in the top of the list. Animal Crossing is the winner!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Animal Crossing: New Horizons                         20\n",
       "Pokemon Sword / Shield                                10\n",
       "Momotaro Dentetsu: Showa, Heisei, Reiwa mo Teiban!     9\n",
       "Super Smash Bros. Ultimate                             7\n",
       "Super Mario Maker 2                                    6\n",
       "Monster Hunter: World                                  5\n",
       "Splatoon 2                                             4\n",
       "Ring Fit Adventure                                     4\n",
       "Kirby Star Allies                                      3\n",
       "Marvel's Spider-Man                                    3\n",
       "Name: Game Title, dtype: int64"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sw[df_sw[\"Position\"] == 1][\"Game Title\"].value_counts()[:10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Finally, I will put a list with the 10 most sucessful launches within the range of time of the dataset:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>index</th>\n",
       "      <th>Position</th>\n",
       "      <th>Position Last Week</th>\n",
       "      <th>System</th>\n",
       "      <th>Genre</th>\n",
       "      <th>Launch Date</th>\n",
       "      <th>Company</th>\n",
       "      <th>Price</th>\n",
       "      <th>Sales (this week)</th>\n",
       "      <th>LTD Sales</th>\n",
       "      <th>Range Sales</th>\n",
       "      <th>Change from last week</th>\n",
       "      <th>Launch this week</th>\n",
       "      <th>Game Title</th>\n",
       "      <th>Year</th>\n",
       "      <th>Week</th>\n",
       "      <th>Days</th>\n",
       "      <th>Date</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1290</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>NSW</td>\n",
       "      <td>ETC</td>\n",
       "      <td>2020.03.20</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>5980</td>\n",
       "      <td>1880626</td>\n",
       "      <td>1880626</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Animal Crossing: New Horizons</td>\n",
       "      <td>2020</td>\n",
       "      <td>12</td>\n",
       "      <td>mar 16 / mar 22</td>\n",
       "      <td>2020-03-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1830</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>NSW</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2019.11.15</td>\n",
       "      <td>Pokemon Co.</td>\n",
       "      <td>5980</td>\n",
       "      <td>1364544</td>\n",
       "      <td>1364544</td>\n",
       "      <td>60-80%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Pokemon Sword / Shield</td>\n",
       "      <td>2019</td>\n",
       "      <td>46</td>\n",
       "      <td>nov 11 / nov 17</td>\n",
       "      <td>2019-11-11</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4590</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>PS4</td>\n",
       "      <td>ACT</td>\n",
       "      <td>2018.01.26</td>\n",
       "      <td>Capcom</td>\n",
       "      <td>8980</td>\n",
       "      <td>1350412</td>\n",
       "      <td>1350412</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Monster Hunter: World</td>\n",
       "      <td>2018</td>\n",
       "      <td>4</td>\n",
       "      <td>jan 22 / jan 28</td>\n",
       "      <td>2018-01-22</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3240</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>NSW</td>\n",
       "      <td>FTG</td>\n",
       "      <td>2018.12.07</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>7200</td>\n",
       "      <td>1238358</td>\n",
       "      <td>1238358</td>\n",
       "      <td>60-80%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Super Smash Bros. Ultimate</td>\n",
       "      <td>2018</td>\n",
       "      <td>49</td>\n",
       "      <td>dec 03 / dec 09</td>\n",
       "      <td>2018-03-12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4890</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>3DS</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2017.11.17</td>\n",
       "      <td>Pokemon Co.</td>\n",
       "      <td>4980</td>\n",
       "      <td>1199814</td>\n",
       "      <td>1199814</td>\n",
       "      <td>60-80%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Pokemon Ultra Sun / Ultra Moon</td>\n",
       "      <td>2017</td>\n",
       "      <td>46</td>\n",
       "      <td>nov 13 / nov 19</td>\n",
       "      <td>2017-11-13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1200</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>PS4</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2020.04.10</td>\n",
       "      <td>Square Enix</td>\n",
       "      <td>8980</td>\n",
       "      <td>702853</td>\n",
       "      <td>702853</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Final Fantasy VII Remake</td>\n",
       "      <td>2020</td>\n",
       "      <td>15</td>\n",
       "      <td>apr 06 / apr 12</td>\n",
       "      <td>2020-06-04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3330</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>NSW</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2018.11.16</td>\n",
       "      <td>Pokemon Co.</td>\n",
       "      <td>5980</td>\n",
       "      <td>664198</td>\n",
       "      <td>664198</td>\n",
       "      <td>40-60%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Pokemon: Let's Go, Pikachu! / Let's Go, Eevee!</td>\n",
       "      <td>2018</td>\n",
       "      <td>46</td>\n",
       "      <td>nov 12 / nov 18</td>\n",
       "      <td>2018-12-11</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3030</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>PS4</td>\n",
       "      <td>RPG</td>\n",
       "      <td>2019.01.25</td>\n",
       "      <td>Square Enix</td>\n",
       "      <td>8800</td>\n",
       "      <td>640406</td>\n",
       "      <td>640406</td>\n",
       "      <td>60-80%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Kingdom Hearts III</td>\n",
       "      <td>2019</td>\n",
       "      <td>4</td>\n",
       "      <td>jan 21 / jan 27</td>\n",
       "      <td>2019-01-21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4980</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>NSW</td>\n",
       "      <td>ACT</td>\n",
       "      <td>2017.10.27</td>\n",
       "      <td>Nintendo</td>\n",
       "      <td>5980</td>\n",
       "      <td>511625</td>\n",
       "      <td>511625</td>\n",
       "      <td>80-100%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Super Mario Odyssey</td>\n",
       "      <td>2017</td>\n",
       "      <td>43</td>\n",
       "      <td>oct 23 / oct 29</td>\n",
       "      <td>2017-10-23</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>240</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>NSW</td>\n",
       "      <td>TBL</td>\n",
       "      <td>2020.11.19</td>\n",
       "      <td>Konami</td>\n",
       "      <td>6300</td>\n",
       "      <td>345697</td>\n",
       "      <td>345697</td>\n",
       "      <td>60-80%</td>\n",
       "      <td>0</td>\n",
       "      <td>True</td>\n",
       "      <td>Momotaro Dentetsu: Showa, Heisei, Reiwa mo Tei...</td>\n",
       "      <td>2020</td>\n",
       "      <td>47</td>\n",
       "      <td>nov 16 / nov 22</td>\n",
       "      <td>2020-11-16</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      index  Position  Position Last Week System Genre Launch Date  \\\n",
       "1290      0         1                   0    NSW   ETC  2020.03.20   \n",
       "1830      0         1                   0    NSW   RPG  2019.11.15   \n",
       "4590      0         1                   0    PS4   ACT  2018.01.26   \n",
       "3240      0         1                   0    NSW   FTG  2018.12.07   \n",
       "4890      0         1                   0    3DS   RPG  2017.11.17   \n",
       "1200      0         1                   0    PS4   RPG  2020.04.10   \n",
       "3330      0         1                   0    NSW   RPG  2018.11.16   \n",
       "3030      0         1                   0    PS4   RPG  2019.01.25   \n",
       "4980      0         1                   0    NSW   ACT  2017.10.27   \n",
       "240       0         1                   0    NSW   TBL  2020.11.19   \n",
       "\n",
       "          Company  Price  Sales (this week)  LTD Sales Range Sales  \\\n",
       "1290     Nintendo   5980            1880626    1880626     80-100%   \n",
       "1830  Pokemon Co.   5980            1364544    1364544      60-80%   \n",
       "4590       Capcom   8980            1350412    1350412     80-100%   \n",
       "3240     Nintendo   7200            1238358    1238358      60-80%   \n",
       "4890  Pokemon Co.   4980            1199814    1199814      60-80%   \n",
       "1200  Square Enix   8980             702853     702853     80-100%   \n",
       "3330  Pokemon Co.   5980             664198     664198      40-60%   \n",
       "3030  Square Enix   8800             640406     640406      60-80%   \n",
       "4980     Nintendo   5980             511625     511625     80-100%   \n",
       "240        Konami   6300             345697     345697      60-80%   \n",
       "\n",
       "      Change from last week  Launch this week  \\\n",
       "1290                      0              True   \n",
       "1830                      0              True   \n",
       "4590                      0              True   \n",
       "3240                      0              True   \n",
       "4890                      0              True   \n",
       "1200                      0              True   \n",
       "3330                      0              True   \n",
       "3030                      0              True   \n",
       "4980                      0              True   \n",
       "240                       0              True   \n",
       "\n",
       "                                             Game Title  Year  Week  \\\n",
       "1290                      Animal Crossing: New Horizons  2020    12   \n",
       "1830                             Pokemon Sword / Shield  2019    46   \n",
       "4590                              Monster Hunter: World  2018     4   \n",
       "3240                         Super Smash Bros. Ultimate  2018    49   \n",
       "4890                     Pokemon Ultra Sun / Ultra Moon  2017    46   \n",
       "1200                           Final Fantasy VII Remake  2020    15   \n",
       "3330     Pokemon: Let's Go, Pikachu! / Let's Go, Eevee!  2018    46   \n",
       "3030                                 Kingdom Hearts III  2019     4   \n",
       "4980                                Super Mario Odyssey  2017    43   \n",
       "240   Momotaro Dentetsu: Showa, Heisei, Reiwa mo Tei...  2020    47   \n",
       "\n",
       "                 Days       Date  \n",
       "1290  mar 16 / mar 22 2020-03-16  \n",
       "1830  nov 11 / nov 17 2019-11-11  \n",
       "4590  jan 22 / jan 28 2018-01-22  \n",
       "3240  dec 03 / dec 09 2018-03-12  \n",
       "4890  nov 13 / nov 19 2017-11-13  \n",
       "1200  apr 06 / apr 12 2020-06-04  \n",
       "3330  nov 12 / nov 18 2018-12-11  \n",
       "3030  jan 21 / jan 27 2019-01-21  \n",
       "4980  oct 23 / oct 29 2017-10-23  \n",
       "240   nov 16 / nov 22 2020-11-16  "
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sw[df_sw[\"Launch this week\"]].sort_values(by=['Sales (this week)'],ascending=False).head(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And now... it's your turn to play with the dataset!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}