Find Jobs
Hire Freelancers

Scraping/crawling expert needed to help with python scraping script

€10-25 EUR / hour

I përfunduar
Postuar over 1 year ago

€10-25 EUR / hour

We have a python script that scrapes data from some subscription website that requires you to be logged in in order to see some data. It uses Selenium + firefox driver. I was working fine until recently, it seems the website changed the site structure and the way to look for the data we're looking for. It looks like it's loading the data with javascript. Important: this site requieres login, we use cookies with the script so we can scrape the data as if we were logged in. This still works but we can't pull the data out of the website. Please, include in you offer your experience working with python+scraping+selenium and what what would be your approach to solve the issues.
ID e Projektit: 34889838

Rreth projektit

86 propozime
Projekt në distancë
Aktive 2 yrs ago

Po kërkoni të fitoni para?

Përfitimet e ofertës për Freelancer

Vendosni buxhetin dhe afatin tuaj
Paguhuni për punën tuaj
Përshkruani propozimin tuaj
Është falas të regjistrohesh dhe të bësh oferta për punë
I dhënë për:
Avatari i Përdoruesit
Hello, There I am a talented python web scraper and familiar with data extracting using requests, scrapy, selenium and bs4. I have rich experience in scraping of many platforms such as instagram, google, yelp, zillow, twitter, facebook, doordash, ubereats, postmates, target and some vehicle sites and so on. These are my some result files of past data extraction work. B2b : [login to view URL] Facebook: [login to view URL] Furniture: [login to view URL] Podiatrists: [login to view URL] Zillow: [login to view URL] Vehicle: [login to view URL] Twitter: [login to view URL] Ebay: [login to view URL] Email: [login to view URL] ..... If you'd like, I'll share my more scripts and results with you in chat. My knowledge and experience in these fields will ensure your project is carried out successfully. Please give me your chance, I look forward to hearing from you. Regards!
€20 EUR në 7 ditë
5,0 (13 përshtypje)
5,4
5,4
86 profesionistët e pavarur ofrojnë mesatarisht €18 EUR/orë oferta për këtë punë
Avatari i Përdoruesit
Hi Good evening , How are you? I just saw your job posting . I see you have been looking for someone experience with these technologies Web Scraping, JavaScript, Scrapy, Python and Selenium. I believe this is some thing I can help you with because I have 9 years of experience working with these tech stacks and 8 years of experience working on freelancer.com which you can confirm from my profile: https://www.freelancer.com/u/AwaisChaudhry I have few questions: 1. These are all the requirements of your job or do you have more? If yes, Please provide detailed requirements. 2. Do you currently have anything done like Wireframes, UI/UX? Or this job has to be done from scratch? 3. What is the timeline to get this job done? Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Portfolio: https://www.freelancer.com/u/AwaisChaudhry Timings: 9am - 9pm Eastern Time (I work as a full time freelancer) Lets start the chat and discuss your job in detail and we will continue from there. Regards, Awais
€30 EUR në 32 ditë
4,9 (78 përshtypje)
8,2
8,2
Avatari i Përdoruesit
Hello, Warm Greetings! I am pretty sure I can produce high-quality and perfect results for your project. By using Python, I used to make AI engines, BOT, Web Scraping Tools, and so on. PHP, Python are my major, so you will be satisfied. I am a very highly skilled web developer with more than 5 years of rich experience in such as Laravel, CodeIgniter, Python, Django, etc So more specifically my skills are ... Web Development + Backend: Python Django, Node.js, Laravel, MySQL, MongoDB + FrontEnd: React, Angular, Vue. I hope you share with me more details about your project. Waiting for your reply. Thank you and Good day.
€18 EUR në 40 ditë
4,9 (108 përshtypje)
7,8
7,8
Avatari i Përdoruesit
Hello, I have 12+ years of experience in Python and have worked on a lot of Django, Flask, AI/ML, ... projects. I can share some demos if you are interested. Also, I work as a fulltime freelancer and have enough time to assign to your project. Thanks, Helmot
€18 EUR në 40 ditë
4,8 (164 përshtypje)
7,9
7,9
Avatari i Përdoruesit
Hi, I am Senior Python script developer with 10 years of experience. I can scrape your required website by python script/bot with your instructions very short time. Can we discuss please? Thanks.
€10 EUR në 40 ditë
4,9 (149 përshtypje)
7,3
7,3
Avatari i Përdoruesit
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 850 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion.. Thank you Sandeep
€18 EUR në 40 ditë
4,9 (149 përshtypje)
7,4
7,4
Avatari i Përdoruesit
hi, i am expert in scraping with selenium, can u pls share ur python script in chat?
€25 EUR në 40 ditë
4,9 (211 përshtypje)
7,1
7,1
Avatari i Përdoruesit
Hello Thanks for posting your job, I would like to work with your Python/Scrapping requirements. I have Scraped merchant websites including Amazon, Walmart, Target etc. Tools used: Python scrapy, beautifulsoup, selenium, proxy servers Key Projects ➲ Influencer's Marketplace --------------------------------------------------------------------- The Scope of work include Scrapping 10 social medias ( Instagram, Facebook, Tik tok, Twitch, Twitter, Pinterest, Youtube, Tumblr, Linkedin, Snapchat ) The scrapped results are used to make ML models ➲ Linkedin Operations Scrapper --------------------------------------------------------------------- It essentially automates the activities, mimicking an user in almost all aspects. We have written scripts to automate sending connection requests, Checking connection request accepted, Send messages to user once connected (in multiple stages until reply), Check reply messages and finally responding to reply. ➲OnlineScraper - Scrapy Onlinescraper is to scrap the data as per the search results in indeed, monster, dice,careerbuild and save and list the data Scrapy Best Regards Sayooj
€20 EUR në 40 ditë
3,8 (23 përshtypje)
8,4
8,4
Avatari i Përdoruesit
Hi there, I have read the brief details on the job listing. You can check my experience, customer feed backs and my portfolio here: https://www.freelancer.com/u/AITSoft I believe its a doable job I have great experience doing projects with Scrapy, Python, Web Scraping, Selenium and JavaScript. Please initiate the chat so we could discuss it in detail. Thanks! Shamshad
€25 EUR në 36 ditë
5,0 (40 përshtypje)
6,5
6,5
Avatari i Përdoruesit
hello. i have read your job posting carefully. i have an experience in making web automation bot and scraping using python selenium. it seems your site changes html structure. please contact me. i will modify your python script for your new site structure. thanks for your attention. best regards.
€18 EUR në 40 ditë
5,0 (36 përshtypje)
5,8
5,8
Avatari i Përdoruesit
Can we disscus over chat ASAP ? SO I Start work Hi there, Hope you are fine. I can help you with any kind of Automation, Web Scraping and Data mining. I have 5 years of Experience in Python Scraping , selenium and Coding. Please share with me Code Details in the Chat Box. Looking forward to working with you. Regards
€18 EUR në 40 ditë
5,0 (5 përshtypje)
5,8
5,8
Avatari i Përdoruesit
❤️Hi, dear client❤️ I have experience in scraping using python and selenium. According to my opinion, If they changed page structure or classname, then it would be a quick fix. And If you don't like python and selenium due to the speed problem, I can rebuild the project using node.js. I also have experience in using node.js scraping using puppeteer. Anyway, checking your project and target website will much help to make quote. Thank you for your time and review my proposal. Regards.
€20 EUR në 40 ditë
5,0 (22 përshtypje)
5,9
5,9
Avatari i Përdoruesit
Hello sir, Please take a look at my reviews and portfolio. I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss the details via pm. I look forward to hearing from you soon. Best Regards.
€25 EUR në 40 ditë
5,0 (57 përshtypje)
6,1
6,1
Avatari i Përdoruesit
Hello employer, I have been doing web scraping using selenium, scrapy, and requests framework. Most of the site that I do requires me to handle some javascript calls and most recently, I completed scraping for the Expedia site and I can share the data with you to understand my skill set better. Regarding my approach, I have operated with the same scenario where login is mandatory to have access to the data. If the data is being rendered by a javascript call (ajax call) then it will be wise to do it with the selenium framework as the HTML source doesn't contain the data. I can give you a better explanation of the approach but from my experience, all the data rendering in the selenium can be accessed by clever XPath methods and it is accessible. You can message me to have an interview with me to be sure of my skills in web scraping and we can discuss your project requirements. I am open to working with you and delivering you the best services possible. By hiring me, you will have solutions to your project problem in no time. I am looking forward to hearing from you, Thank you.
€12 EUR në 20 ditë
5,0 (27 përshtypje)
5,7
5,7
Avatari i Përdoruesit
Dear Susana, I've been developing complex scraping web apps using Python and Postgres hosted in AWS for several years and would like to work on your project. Check out my app MetricGate on Google, which I have built and scaled from scratch. It is used by tens of thousands of Statisticians to analyse their uploaded data files. I assure you that you will be impressed by the quality of my work as did every single client of mine. I'm looking forward to hearing from you. Yours sincerely.
€18 EUR në 35 ditë
4,9 (16 përshtypje)
5,4
5,4
Avatari i Përdoruesit
Hi, i have rich experience for scraping via python. Windows system defender is detecting the exe made by python now. But i already know solution for that. However i think we can discuss the project via chat. Please review the my resume and then if you are interest me , please contact me. Looking forward to build a long-term relationship with you based on quality and trust. Best regards.
€25 EUR në 40 ditë
5,0 (13 përshtypje)
5,5
5,5
Avatari i Përdoruesit
're looking for. It looks like it' Hi, How are you? Upon reading brief details I believe it's a doable job I have great experience doing projects with Selenium, Python, Scrapy, JavaScript and Web Scraping. I am confident about getting this done. While I believe we need to have a detailed discussion about it. I work as per Eastern time daily so that would be good for us to catch up on this job, Let's discuss this further and get started for you as soon as possible. Thanks! Muhammad
€15 EUR në 15 ditë
5,0 (54 përshtypje)
5,7
5,7
Avatari i Përdoruesit
Hi, Dear I`ve rich 7+years of experience and knowledge in Python scraping with beatifulsoap, selenium, requests, etc... If you hire me, I can start right now and I`ll provide you with the best results to your satisfaction. I would like to discuss more regarding project via chat. Please invite me to chatbox. Thanks for reading my proposal.
€18 EUR në 40 ditë
5,0 (30 përshtypje)
5,6
5,6
Avatari i Përdoruesit
Hi, how are you?. I guarantee you will receive a quality service in the shortest possible time. I invite you to review my portfolio and my grades which are 5. I will be delighted if we work together on this project. If you have any questions or queries, you can write to me and I will gladly assist you!
€18 EUR në 40 ditë
5,0 (13 përshtypje)
5,6
5,6
Avatari i Përdoruesit
Hi, I am senior Web Scraper. As you can see via my profile and work history, Web Scraping is my top skill. I have already done +1000 web scraping projects . So I can handle any type of web scraping task. If you choose me as a developer, You will get awesome result. Please contact me for our project.
€18 EUR në 40 ditë
4,9 (26 përshtypje)
5,6
5,6
Avatari i Përdoruesit
Hello client, First, receive warm greetings, and hoping you are good, I welcome you to the home of Amazing services and quality. I am an expert in named skills,over 9 years of experience, After keenly reading your description and being in possession of all clearly stated required skills as this is my area of professional specialization having the above qualifications, I hereby humbly request you to consider my bid for quality and professional work. It is my duty to ensure 100% satisfaction to you as my client. No timeline and quality excuses. Unlimited revisions until all client requirements are met as required. affordable, professional & quality services are guaranteed always. Message me we discuss more the project. thank you.
€25 EUR në 40 ditë
4,8 (7 përshtypje)
5,5
5,5

Rreth klientit

Flamuri i SPAIN
Madrid, Spain
5,0
6
Mënyra e pagesës u verifikua
Anëtar që nga tet 7, 2020

Verifikimi i klientit

Faleminderit! Ne ju kemi dërguar me email një lidhje për të kërkuar kredinë tuaj falas.
Ndodhi një gabim gjatë dërgimit të email-it tuaj. Ju lutemi provoni përsëri.
Përdorues të regjistruar Punë të postuara
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Po ngarkohet shikimi paraprak
Leja u dha për Geolocation.
Seanca e hyrjes ka skaduar dhe ke dalë. Hyr sërish.