Hello,
I have a python script that gets the result URLs for the searches on google. Script uses various methods to avoid getting blocked.
For this project a little tweaking of the script will be required and it will be good to go. I can provide the docker image/script setup instructions to run in your local/cloud env.
As an extra task, the excel containing the details can be load to google drive by the script. I can schedule the script to at regular intervals and send you emails if new data is generated.
Have created crawlers and scrapper for Google, LinkedIn, Instagram and various other sites.
I have 10+ years of extensive experience in Python, Java and software design and development. Have worked on numerous frameworks like python selenium, python flask, python celery, java spring boot, java vaadin, maven, gradle, and other.
Specialized in creating crawlers and scrapers for various sites using Selenium Python for front-end based scraping and python requests modules for api based scrapping. which can route through proxy servers so that sites that have logic to detect scrapping and crawling can be avoided to a limit.
I can definitely help with this project. Please contact me to discuss the detailed requirements, timelines and budget.