For this project I would be using and RPA (Robotic Process Automation) tool that I built.
This piece of software can be configured through scripts to navigate complete websites, scrap data and download files automatically.
You can see a video explaining how my system works, in my portfolio within my profile here:
https://www.freelancer.com/u/rvaldezv
Once the tool is configured, a project like this can be completed within a few hours, normally over night depending on complexity of the site and how much information we want to scrap.
Results can be stored in any file format such as Excel files, CSV, TXT or others. If desired, we can also store results on a database for further analysis.
What I do is to use the robot to automate the tools and options available on the site to read and normalize data for further use.
If awarded, we would need to work together to define search criterias and strategies that makes sense, so we can get the information you are looking for,
Looking forward to work with you.
Please let me know if you have any questions for me.
Have a great day.
RV