Data scraper & db
Project detail
I am looking for a data scraper and database expert who can accurately collect and store structured data from a predetermined source. I already have a list of data sources, so the professional will not require assistance in this regard. The person should have expertise in data scraping and database management and be able to complete the task in a timely manner. Budget is $250.
Scrapers
Build historical scrapers for 3 websites to gather and store historical data in db (i.e. details to be provided)
Build current scraper for new data
Scraper to built in Python or similar language
Documentation required so we can update, as necessary
Database:
Architect a database (i.e., tables and db) to hold large historical and daily data
DB will be either MySQL, Mongo db or similar db
We will assist with the relationships with the db/tables
Search
Create a feature on the password protected website so that we can search the data
The search should be optimized so the call time is minimal