GitHub - wosiu/WebScraper: JAVA based web scraper - collects results from given sources using implemented selectors for each website template. You can define proxy servers or user agent for each selector to act as a specific user. Goal is to allow easy extending modules for traversing through many websites by implementing proper Selector. HTML navigating managed by JSoup. Package includes also ProxyFinder which download active proxies adresses from defined proxy selectors, so you needn't search by yourself.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 165 Commits
.idea/libraries		.idea/libraries
src		src
.gitignore		.gitignore
.travis.yml		.travis.yml
browse_empty.sh		browse_empty.sh
collectFiles.sh		collectFiles.sh
config.json		config.json
pom.xml		pom.xml
resultCheck.R		resultCheck.R
run.sh		run.sh

About

JAVA based web scraper - collects results from given sources using implemented selectors for each website template. You can define proxy servers or user agent for each selector to act as a specific user. Goal is to allow easy extending modules for traversing through many websites by implementing proper Selector. HTML navigating managed by JSoup.…