Crawling tool with Scrapy and Mongo
$30-250 USD
Paguhet në dorëzim
- We need you to build us a crawling tool from scratch which follow these requirements:
--- Requirements ---
- The tool should be used Scapy Python and MongoDB.
- It should dockerized into docker-compose separated into two containers: web and db.
- It should be easier to extend if we gonna crawl the new site.
Such as we will have folderA will crawl site A, folderB will crawl site B...etc
- It should be easier for configure the database and the site we gonna crawling.
- When the structure of codebase is done, we will review it and you need to send us a documentation to show:
+ How can we setup crawler for new site ?
+ Which file/folder need to be created
+ Which command need to be executed to crawl all the sites which were configured in the codebase.
- We will send you an example site, so you will do an example for us when the structure of codebase is done.
- I will send you invitation to github repository then you will work on it.
---- Note ---
- Please read it carefully before you ask us or bid with the right price.
- Only release payment if the codebase is good enough and easy for us to crawling the site.
- Please mark prefix 'DDPythonMongo' when you bid. Otherwise, I'll skip the bid due to automatically bid or bot.
ID Projekti: #21405415
Rreth projektit
10 profesionistë freelancer dërguan një ofertë mesatare prej $182 për këtë punë
DDPythonMongo Good day of today! I am a senior web developer with rich experiences about scrapy python and mongo db management. After checking your post carefully , I am convinced that I can complete your project and w Më shumë
DDPythonMongo How are you? I'm interested in your project. I've read your requirement carefully. In my precious working years i have finished many succesful projets with 100% customer satisfaction. I am a full stack d Më shumë
DDPythonMongo Hi, I have gone through your project description. I can do this work easily. I am a full stack developer with extensive experience in both front and backend technologies. I build apps using modern archi Më shumë
HI, I HAVE EXPERIENCE IN WORKING WITH WEB CRAWLING AND SCRAPING THE DATA FROM WEB SITES AND ABLE TO SCRAP THE DATA USING JAVA, PYTHON, PHP AND USING THE MYSQL AS MY DATABASE. AND THE BID IS NEGOTIABLE WANT TO NEGOTIA Më shumë
Currently working at a large project where my responsibilities are crawling, maintaining and updating big websites like google news, yahoo news, bing news etc.