Installing , Setting up and Running BuBING Web Crawler on Digital Ocean Droplet

€30-250 EUR

Mbyllur

Postuar

over 5 years ago

€30-250 EUR

Paguhet në dorëzim

As a company we have some droplets hosted on Digital Ocean and we have already a very long list of websites and domains (and subdomains) that need to be crawled: from every url, the crawler need to fetch webpage title and metatags (if any). In order to do so, there is a crawler that is already there, [login to view URL] but it is quite hard for our team to deploy it, install it and run it. This job requires the installation of BuBing crawler into the droplet, the correct setup in order to not get blocked by webpages and run it. After that, for each page the title and metatags need to be saved into a file that will be then parsed by one of our scripts and given to the databases. Long story short: install, setup and run BuBing given a list of urls.

Shell Script

Web Crawling

Web Scraping

ID e Projektit: 18537468

Rreth projektit

6 propozime

Projekt në distancë

Aktive 5 yrs ago

Po kërkoni të fitoni para?

Adresa e email-it

Përfitimet e ofertës për Freelancer

Vendosni buxhetin dhe afatin tuaj

Paguhuni për punën tuaj

Përshkruani propozimin tuaj

Është falas të regjistrohesh dhe të bësh oferta për punë

6 freelancers are bidding on average €201 EUR for this job

@kkc264043kkc

can do your job. These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping.

€277 EUR në 2 ditë

4,9

(44 përshtypje)

6,0

@brianconey

I am very interested in your project, because I have much experience in web Scraping I have good skills with the program language including python, C# , JAVA ,PHP . So I am a expert with web scraping (1000 over projects for scraping), automation and bot(500 over projects for automation and bot), selenium, mobile (android, ios native and others ) as you see my potifolio Especially, I am an expert in betting project and developing bot. So, I can solve the captcha automatically with 2captcha api . Please contact me, then we can discuss about the details and the reasonable price. Best Regard . Thanks.

€333 EUR në 3 ditë

5,0

(18 përshtypje)

5,6

@lightingdavid

Hello? How are you? I have good experiences in "Installing , Setting up and Running BuBING Web Crawler on Digital Ocean Droplet" as you can see my profile for these (Shell Script, Web Crawling, Web Scraping). I have been working for 7 yrs in this scope. While we contract and work in our jobs, I will get paid once you have confirmed satisfied result. If I do not deliver satisfied result, I will never get paid from you. We can discuss more details to understand more easily if you have other infos. Hope to work with you. Thank you.

€155 EUR në 3 ditë

5,0

(15 përshtypje)

4,7

@debianguy

Hi. BuBing crawler is a little hard to install because it need do a lot of adjust on system variables and install extra dependencies. I can help you installing it and running it. Better is you're using ubuntu or debian linux system with ssh access and root account enable. Open to questions

€133 EUR në 2 ditë

5,0

(6 përshtypje)

3,1

@emicsoft211

Hello, I can install, configure and setup the BuBING Web Crawler in the digital ocean server. Please let me know if you are interested so we can discuss the project further. Waiting for your reply. Thank you

€154 EUR në 3 ditë

5,0

(2 përshtypje)

2,9

@ekoomitsolution

Hi, We would like to Design and Build your online store / personal website / simple website / Management CRM application, We would like to provide you Website Design and then you select it and then if changes need we can do it , We would like to provide complete website design and development at your budget Insha Allah

€155 EUR në 3 ditë