Add proxies to a web scraper -- 2

₹600-1500 INR

I përfunduar

Postuar

about 1 year ago

₹600-1500 INR

Paguhet në dorëzim

I have a already a web scraping script which scrapes jobs from a website but I want someone to add proxies and rotate headers while sending requests so that I dont get ban and can scrape around 150k pages of data. I am looking for someone new and expert. My budget is $10 since the main script is already done.

Python

Web Scraping

Data Mining

ID e Projektit: 35836001

Rreth projektit

7 propozime

Projekt në distancë

Aktive 1 yr ago

Po kërkoni të fitoni para?

Adresa e email-it

Përfitimet e ofertës për Freelancer

Vendosni buxhetin dhe afatin tuaj

Paguhuni për punën tuaj

Përshkruani propozimin tuaj

Është falas të regjistrohesh dhe të bësh oferta për punë

I dhënë për:

@priyanshu8090

Hi there, I can add proxies and rotation of headers support into your script. I have already done it for almost all my scrapers. Can we have a chat to discuss it further in detail?

₹899 INR në 1 ditë

4,7

(18 përshtypje)

3,9

7 freelancers are bidding on average ₹1 107 INR for this job

@malkesh3m

⭐⭐⭐ Hi, My availability: Immediate / 40+ hours per week. I read your project post of Python Developer to add proxies in web scrapping project. I am Python developer having skillsets in Python Django/Flask, Machine Learning, Data Science, SQlAlchemy, PostegresDB, MySQL, jupyter notebook, Authentication, Authorization, API Development, Web Scrapping, web hosting, docker etc. Please send a message So we can have a quick discussion about your project and proceed further. Looking forward to hearing from you. Thanks

₹2 500 INR në 1 ditë

3,3

(7 përshtypje)

3,1

@robartint

Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg

₹600 INR në 7 ditë

4,4

(1 review)

2,5

@soniayt7

HhI I am experienced in and I can start right now but i have few doubts and questions lets have a quick chat and get it started waiting for your replyyy

₹1 050 INR në 7 ditë

0,0

(0 përshtypje)

0,0

@DICEAnalytics17

Hi, Dice Analytics is a team of professional experts in scraping/Excel/Data mining. We are here to complete your task in minimum time with good results. Please do massage for further details. Looking forward to hear you soon. Thanks

₹1 050 INR në 7 ditë