Skip to content

abirotti/SpiderBro

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Firing up the server

sh run_server.sh

TODO

  • Please suspend disbelief - SpiderBro IS your best friend and does all it can for your benefit.
  • Process the pages depth-first (a simple implementation is provided).
  • Start fixing SpiderBro's behaviour to save him from the dangerous corners of the website (also please do not just 'fix' the website ;)
  • Have fun!

Slides

https://docs.google.com/presentation/d/1b3ad1HZDmFFCynNir-idhHNbfJACIE44qEyfntb2m6E/edit?usp=sharing

Documentation

About

Code for the crawler dojo

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published