项目作者: zaindanish

项目描述 :
A python based web crawler.
高级语言: Python
项目地址: git://github.com/zaindanish/Flipkart-Crawler.git
创建时间: 2017-08-09T19:23:42Z
项目社区:https://github.com/zaindanish/Flipkart-Crawler

开源协议:GNU General Public License v3.0

下载


Flipkart-Crawler

A python based web crawler for extracting all the reviews made by all the customes for a particular item.

Currently it is hard coded to fetch only all the reviews made in laptop section only and store it as MongoDB database.

Flipkart is a e-commerce website the source code was rendered with javascript so i had to use selenium web-drive to extract all data.

Liabries used

  • Requests
  • BeautifulSoup
  • Selenium
  • Pymongo

Future Scope

It will pull all the reviews of all the items listed in flipkart based on customer input.

Kindly note that it is for educational purpose only.