Skip to content

A dockerized micro service based web application to scrape tweets of a given topic and display them to the user

License

Notifications You must be signed in to change notification settings

LukeR97/Tweet-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

65 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Twitter Tweet Scraper

This application takes a given topic from the user and will scrape Twitter.com for tweets of that given topic. 3 Docker containers are used. A DB is replicated 3 times and will store the results of the scraped tweets and can be accessed through an SSH into the Docker container. A Vue.js web application will act as our client facing app. This is where the user will input their topic to scrape and this will form a HTTP request and POST this to our scraper tool. This is a Node.js application which will navigate to Twitter and scrape the HTML of the results page and return the tweets back to our Vue.js application. The number of results returned is equal to the number of tweets displayed on a single page.

Vue app initialised

results

docker containers running

About

A dockerized micro service based web application to scrape tweets of a given topic and display them to the user

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •