Data Scraper (CentOSLinux)
Project detail
*One-off project*
Duration: within 10-14 days, instant start.
Shift: IST
*Web scraping and API Building*
BRIEF
1. 5 websites – Crawl specific URLs and extract data into the required format.
2. Develop frameworks to be deployed in CentOS Linux to automate and maintain a constant flow of data from required sources.
REQUIRED SKILLS:
– In-depth knowledge of Centos Linux and data structures
– Strong knowledge of scraping frameworks such as Python, Scrapy, Web Harvest, etc.
– Firewall & networking
Ability to guide in-house team
Skills: Python, Centos Linux, Web Scraping, Data Mining, Data Processing, MySQL