Skip to content

markellisdev/NewsScraper

 
 

Repository files navigation

NewsScraper - Scrape any newspaper automatically

This is a simple python script for automatically scraping the most recent articles from any news-site. Just add the websites you want to scrape to NewsPapers.json and the script will go through and scrape each site listed in the file.

For more info read comments in NewsScraper.py.

This is my own version, forked from NewsScraper and adapted to my own desires.


2020-0714 Update

Decide to attempt to scrape using Selenium, so incorporated code from this tutorial as well. Now scraping from Marketwatch financial news and printing a list of ticker symbols. Only symbols with positive movement are included.

Libraries

This script uses the following libraries:

https://github.com/codelucas/newspaper

https://github.com/kurtmckee/feedparser

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%