Skip to content

sjrahimian/araneae_crawlers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Araneae Crawlers 🕷️

Python

A collection of my Spiders for the world wide web: extracting, formatting, storing, etc.

House Spider 🏠

A generic term for different spiders commonly found around the web (homes)

* Chiracanthium inclusum (Yellow Sac spider) - for any good ol' page
* Araneus gemmoides (Cat-faced spider) -

Miturgidae (Prowling spider)

* Zora - Random IP address generator and ping

Chiracanthium inclusum (Yellow Sac spider) - a common house spider worldwide -

  • Currently does: access (url given by user), pull information, & search (arg) if data contains desired element
  • Future direction: clean/remove unwanted tags, and store user information in format choice

Takes in two arguments from cmd line: file.py wordToFind desiredURL
Nb. URL in the following format: "example.com/etc"

Araneus gemmoides (Cat-faced spider) - "Have you seen my eight-legged cat? He's a special kitty." -

Originally I was hoping this would get facebook posts, but facebook has changed the token system so gotta figure something else out


Zora (Prowling spider)

Generate and ping a list of random IP addresses; tally responses and give output

About

Spiders for the world wide web

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages