Web scraping ruby punët

I am seeking a proficient programmer to develop a scraping application for the purpose of extracting text data from NETFLIX. This project is sensitive, considering that the targeted websites demand API keys for access. Accordingly, the ideal candidate should be familiar with both GET and POST methods as well as API integration and management. Experience with data extraction and web scraping from API authenticated websites is a must. Skill requirements: • Web scraping • HEADERS • CUSTOM HEADEARS • STRINGS • URLLIB • Working knowledge of GET & POST methods • Experience with API authentication • Exceptional skills in data extraction, especially text. • loliscript • SilverBullet i need to get a netflix m...

I'm looking for a proficient Python developer to create a script that can efficiently scrape active IPs from a text file I will provide. The following specifics are required in this project: - The Skill-set: Strong Python programming skills, experience in IP scraping and working with text files would be an advantage. - Task Details: You need to extract the 'Activity Data' from these IPs. Profound knowledge in network protocols is a must-have. - Output Handling: The activity data extracted should directly be written to a text file. A clear understanding of FileIO operations in Python would be crucial. A successful completion of this project might lead to more future collaborations. I'm looking forward to seeing your proposals.

...Development: Proficiency in mobile app development platforms such as iOS (Swift) and Android (Java/Kotlin). Experience with cross-platform development frameworks like React Native or Flutter can be beneficial for building apps that work on both iOS and Android. 2. Backend Development: Strong understanding of backend development technologies and frameworks like Node.js, Python (Django/Flask), or Ruby on Rails. Knowledge of databases such as MySQL, PostgreSQL, or MongoDB for storing user data, ride information, and other relevant data. 3. Geolocation and Mapping: Familiarity with geolocation services and APIs for tracking user location and providing real-time navigation. Experience integrating mapping and routing APIs such as Google Maps or Mapbox for displaying maps, calculating...

I'm currently looking for an expert who can design a data scraping script for me. However, I haven't decided on which particular website and kind of data (text content, images, links etc) should be scraped yet. Furthermore, the frequency for data collection hasn't been specified. Ideal Skills and Experience: - Commercial experience with Python or JavaScript - Proficiency in web scraping using tools such as BeautifulSoup, Scrapy, or Selenium - Ability to add flexibility for target URLs, data type, and collection frequency Please note: the project details will be finalized upon discussion. Your recommendations are welcome and appreciated. Only apply if you're comfortable proceeding considering these conditions.

My aim is to effectively scrape forum posts from community.st.com. Currently, I have a Python-based web scraping code that requires debugging and optimization as the current JSON output presents inconsistencies. I am in need of a developer with: - Strong Python experience - Proven web scraping skills to optimize and debug data scraping code - Proficiency in handling and troubleshooting JSON data - Familiarity with structure will be a plus As a result, the corrected script should deliver complete and well-structured JSON data of forum posts within community.st.com.

My aim is to effectively scrape forum posts from community.st.com. Currently, I have a Python-based web scraping code that requires debugging and optimization as the current JSON output presents inconsistencies. I am in need of a developer with: - Strong Python experience - Proven web scraping skills to optimize and debug data scraping code - Proficiency in handling and troubleshooting JSON data - Familiarity with structure will be a plus As a result, the corrected script should deliver complete and well-structured JSON data of forum posts within community.st.com.

I'm looking for an experienced data scraper who can extract text data from marketing websites for subsequent data analysis.

I need a professional to scrape specific details from a website directory for a one-time project. - Specifics: The data of interest includes the company names, their URLs, and their expertise. This...URLs, and their expertise. This information is laid out in rows on the website. - I wish for the freelancer to carefully extract this data, ensuring no errors or omissions are made. - The final output is essential to be in a CSV file format. I require this scraping to be done just once, and I do not foresee a need for ongoing scraping after this initial task. As the data is crucial for my business development, I am seeking someone who can deliver accurate and complete results in a timely fashion. Prior experience with web scraping and proficiency in data m...

I need a data scraping tool to pull business names and addresses from Google and Google Maps. - The tool should be able to extract this information in an organized and comprehensive manner, enabling me to create a database for further analysis. Ideal skills and experience for this job include: - Proficiency in web scraping tools and techniques. - Experience working with Google and Google Maps APIs. - Ability to organize and structure data effectively. - Data to be compiled in an excel spreadsheet - Prior knowledge of extracting business information from online sources is a plus. Looking forward to your proposals.

Title: Expert Web Scraper Needed for Advanced Sales Lead Generation Description: We're in search of an expert web scraper proficient in niche database search techniques and advanced web scraping beyond Google and mainstream platforms. The ideal candidate will specialize in extracting company information from platforms like LinkedIn, focusing on contact details for sales lead generation. Key Details: Target Data: Company Information on LinkedIn Purpose: Sales Lead Generation Responsibilities: Utilize advanced web scraping tools and niche database search techniques to extract company information, emphasizing contact details. Ensure accuracy and reliability in gathering and organizing contact information from various sources. Collaborate on ...

...be equipped with moving averages, MACD, and RSI indicators for effective analysis and decision-making. - Web scraping: The ability to gather data from various sources is crucial for the bot's functionality. - Automation: The trading bot should be capable of executing trades autonomously based on predefined trading strategies and indicators. Ideal candidates for this project would have: - Profound knowledge and experience in Python programming - Prior experience in developing trading bots or similar automation projects - Familiarity with moving averages, MACD, RSI and other trading indicators - Strong understanding of data analysis and interpretation - Demonstrated expertise in web scraping NOTE: I need trading bot on Indian stocks all types If you bel...

As a detailed-minded individual who needs precise data for my endeavors, I am currently in need of enthusiastic freelancers with a specialty in data mining. - Required Skills: You should be able to comfortably scrape both text and numeric information off a webpage, particularly from Website 1. Your expertise should shine in extracting specific types of data, ensuring highly accurate data acquisitions. - Project Requirements: I don't need all information from the entire site. I am targeting very specific sections for data mining. Therefore, your ability to scrutinize site details and pinpoint the highest quality information will be essential for this project. I am looking to data scrap the real estate agents of 20 suburbs but will do this in smaller projects depending on the cost so...

My project requires the assistance of an experienced data analyst or data miner. I'm working on a market research project, which requires the extraction of text data from a specified website. Here are the specific details: - Task: Extracting text data...requires the assistance of an experienced data analyst or data miner. I'm working on a market research project, which requires the extraction of text data from a specified website. Here are the specific details: - Task: Extracting text data from a website for data analysis - Output: All extracted text data should be provided in a CSV file Given the nature of this project, prior experience in web scraping, data extraction, or data mining is highly desirable. The ability to accurately extract data and transfer it in...

I need assistance in extracting or scraping the subscriber data from a large Telegram channel ONLY (NOT GROUP). The ultimate goal is to invite these subscribers to my own channel. Key Deliverables: - Extracting or scraping the subscriber data from the specified Telegram channel - Providing a comprehensive list of the extracted subscribers - Ensuring the subscriber data is ready for easy import into my channel for invitation Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Experience with Telegram API or similar platforms - A proven track record of handling and managing large volumes of data - Strong communication skills to provide detailed project proposals Please ensure that your application contains a detailed project prop...

Hello, I'm looking for someone who can fix an error in a custom plugin for me. ? Requirements: Need an experienced WordPress developer for making adjustments to an existing data scraping plugin. The task to perform is to skip/skip cloudflare so that the plugin can extract the data without problem I explain: I have a custom plugin in WordPress, which extracts information all right, it turns out that the website activates Cloudflare on its side and that is preventing the plugin from being able to extract the information correctly. What I need: I'm looking for someone who can modify the plugin or do what is necessary so that it skips or bypasses Cloudflare and can extract the information without problem. ? Budget: $10 - $50 - I need it no later than Monday. For an expe...

We're looking for a programmer skilled in scraping and converting APIs into PHP or Python code (reverse engineering)! If you have the following skills, join us: 1. Proficiency in JavaScript: Ability to work with this popular programming language and fully interpret and modify codes. 2. Knowledge of Cryptography: Ability to understand and use cryptographic algorithms and methods to comprehend how data is encoded and to transform unencrypted data. 3. Familiarity with Progressive Web Apps (PWA): Deep understanding of PWA structure and methods to bypass installation on iOS. 4. Experience with network monitoring and traffic analysis software such as Fiddler: Ability to use these tools for analyzing network traffic and related information, including identifying and address...

...financieros para posteriormente desarrollar un algoritmo que evalúe y compare acciones o fondos de inversión basándose en criterios financieros clave para determinar cual ofrece el mejor potencial de retorno ajustado por el usuario. 1.3.2. Objetivos específicos OE1. recolección de datos: Desarrollar un web scraping, generando scripts para recopilar información de diferentes APIs y acceder a los datos necesarios para utilizarlos en la aplicación. OE2. procesamiento de datos: Crear una aplicación web que solicite unos parámetros de entrada, limpiar y normalizar los datos para asegurar consistencia a la hora de utilizarlos. OE3. cálculo de indicadores: Definir funciones para calcular indicadores...

...street address, and zip code for these firms, but now I need someone to mine the contacts within them. I would like to start with 150 companies but I will need thousands very soon. This will be an ongoing relationship. Specifics include, but are not limited to: - Facility Managers - Construction Managers - Building Managers - Maintenance Managers You should have experience in data mining and web scraping, showcasing a solid understanding of how to extract specific information from given sources. A background in extracting information specifically for real estate industry firms would be a significant advantage. Furthermore, accuracy is of utmost importance to this project. The contacts mined should be accurate and relevant, avoiding any erroneous or mismatched contact ...

I need a Firefox Add-On urgently that can scrape specific text content from a website. The data doesn't need to be saved in any specific format; it's only important that it can be extracted and shown.

...building a Gmail email scraper/notifier. The ideal candidate should have a strong understanding of data scraping and email handling. The aim of the project is to: - Extract and display specific emails from Gmail in a user-friendly card format within an application grid. - The information to display on each card will include part of email body, phone numbers and web links. The phone numbers should be displayed in a clickable link format so that they seamlessly work with a soft phone application like RingCentral without need to use their API. Emails containing web link will have the option to automatically open the link in new tab in default browser. Skills required: - Proficiency in data scraping - Experience with Gmail API - Excellent knowledge in Python o...

I'm looking for a Python developer to assist with web scraping and script automation tasks. Key Responsibilities: - Web Scraping: You need to be proficient in web scraping techniques using Python, specifically with BeautifulSoup. The task will involve extracting data from websites. - Script Automation: Automating repetitive tasks will be another key aspect of this role. Experience in automation is a must. Ideal Candidate: - Proficient in Python with experience in Flask and BeautifulSoup. - Prior experience in web scraping and automation. - Detail-oriented, with the ability to follow instructions carefully. - Open to both experienced professionals and newbies with a strong grasp of Python. Looking forward to hearing from you.

I need to scrape specific information from a website for all search results with a particular key. The data should include Name, Address, Phone number, Email, Company name, and Job title. This data should be organized into an Excel file, with each category of information in separate columns. Ideal Skills: - Proficient in Excel VBA - Experience in web scraping - Understanding of VPN usage to access region restricted sites Please note that the website will only work with a USA VPN.

...opens and when it closes, the restaurant number, and people’s comments and opinions on Google Maps. -Other information: In addition to important details, I need opening hours, website URL, and reviews for each restaurant. - Filters: Any suggestions to improve the restaurant, people’s comments and what could be improved from it. Ideal candidate: - Experience: The person has experience using the web, with preference given to candidates who have worked with Google Maps data in the past. - Attention to detail: It is important that the data provided is accurate and complete. Attention to detail is a prerequisite for this project. - Communication: Good communication skills are essential. Regular updates on progress and any issues encountered would be greatly appreciated. ...

Ju lutemi Regjistrohuni ose Identifikohuni për të parë të dhënat.

As a client, I'm interested in scraping Google Maps for all the restaurants in New Zealand. I'm looking for someone who can handle this task efficiently and effectively. Key Details: - Scraping: The primary data points I need for each restaurant include the name, address, phone number, and the unique ID associated with the restaurant on Google Maps. - Other Information: In addition to the basic details, I also need opening hours, website URL, and reviews for each restaurant scraped. - Filters: While I haven't specified any specific filters or criteria, I'm open to any suggestions you might have for enhancing the data. Ideal Candidate: - Experience: Previous experience in web scraping is a must, with a preference for candidates who have work...

I require a professional with good attention to detail to extract specific information from the HealthPoint directory. The data will be for a key area in Auckland, New Zealand. The key details wanted are: - Doctor's name - Doctor's email - Clinic/GP practice - Clinic address - Contact ...information from the HealthPoint directory. The data will be for a key area in Auckland, New Zealand. The key details wanted are: - Doctor's name - Doctor's email - Clinic/GP practice - Clinic address - Contact number - Generic surgery or PA email address This data will be used for direct communication with doctors to communicate news about their local hospital. Having experience in data scraping is a must; we will provide the spreadsheet to input the data into in order f...

...target national retailers, although we will initially concentrate our efforts closer, in the Greater Melbourne area (Victoria Australia). Your task will be to generate quality leads to expand our retail distribution network within Australia. Skills and Experience: - Proven experience in lead list generation, particularly in the beverage manufacturing or similar industry. - Strong experiencing in scraping quality data. - Zoho CRM competency Key Responsibilities: - Identify potential retailer leads nationally from our list of industries - Create lead lists. - Scrape data to populate all the contact information. - Enter into our Zoho CRM We need someone fast, accurate and keen to work. We want you to identify the potential leads, enter them into our CRM, add their phone, email...

I'm in need of a data scraping expert to gather information about different research projects. The specific details I'm looking for include project name, organisation, project overview and project code. A full list of fields is available in the attachment in row A. Ideal freelancer for this project will have: - Proficiency in web scraping techniques and tools. - Experience in scraping research project information. - Ability to deliver accurate data in a timely manner. Please note the following for the target sites: Not all sites have consistent data format. Not all sites have all of the fields - this is not an issue. This project would have a turnaround of one week.

Hi Md I., I have another data scraping job, I need a list of all the address - seperated by street number with street name, suburb, state and postcode in excel. The suburb is Hope Island QLD 4212 in australia. Are you able to assist?

I am seeking a skilled freelancer who can scrape member data from a specific Telegram channel and automate their addition to my channel. Your job will involve: - Scraping Usernames from the target Telegram channel - Automatically adding these scrapped members to my Telegram channel There is no specific selection criterion for the members to be scrapped, all existing members from the target channel must be added to my channel. The ideal freelancer for this job should have prior experience scraping data from Telegram channels and implementing automated actions within the Telegram API. Knowledge of programming languages like Python would be highly beneficial. Familiarity with Telegram bots and scripting would also be an edge. The task needs to be completed with precision, e...

...needs to have a fresh look while maintaining its initial design consistency. Key tasks include: - Removing obsolete website links and replacing them with relevant ones - Incorporating API scraping for better data handling and integration - Developing a built-in scraper for efficient data extraction - Implementing an escort application form to expand our service offerings - Ensuring rigorous testing and deployment for a seamless user experience The ideal candidate should have comprehensive skills in HTML/CSS, JavaScript frameworks, and CMS like WordPress or Joomla. They should also be proficient in API scraping. A keen eye for design consistency and experience with conversion rate optimization would be beneficial. The prime objective is to create a user-friendly website ...

Bonjour, Je recherche quelqu'un pour m'aider à créer des workflows pour scraper des sites français réputés pour être difficiles en scraping. Je démarre une nouvelle entreprise et je recherche donc des tarifs compétitifs pour créer ces workflows. Je recherche également une personne sachant travailler sur Octoparse et Python. Si vous avez l'expérience et les compétences pour ce projet, n'hésitez pas à me contacter. Merci d'avance pour votre attention et votre réponse. Cordialement,

I am seeking a proficient programmer to develop a scraping application for the purpose of extracting text data from websites. This project is sensitive, considering that the targeted websites demand API keys for access. Accordingly, the ideal candidate should be familiar with both GET and POST methods as well as API integration and management. Experience with data extraction and web scraping from API authenticated websites is a must. Skill requirements: • Web scraping • HEADERS • CUSTOM HEADEARS • STRINGS • URLLIB • Working knowledge of GET & POST methods • Experience with API authentication • Exceptional skills in data extraction, especially text. • loliscript • SilverBullet i need to get a netflix ...

I need to scrape base salary information from Glassdoor for about 2000 companies. Key project requirements: - Scraping Glassdoor for base salary and range info only for every job function/title. - Compiling this data into an Excel spreadsheet Ideal skills include: - Proficient in web scraping techniques - Experience with data analysis Website: (it is free but need to register and complete the profile to see the information)

I would like to hire a professional to extract and organize Amazon Seller details using web scraping techniques. After you find the company name on Amazon, i need you to scrape the web for their contact information since Amazon wont disclose it on Specifically, this project involves: - Extracting Amazon seller information from the website -Use that Amazon seller information to scrape the web for email and contact details - Organizing the data in an Excel spreadsheet The main goal of this exercise is to generate leads from this data. Ideal Skills: - Proficient in web scraping techniques - Ability to handle and manipulate data in Excel - Experience in lead generation would be a plus as it will help in creating a strategic approach in leveraging ...

I am in need of an AI expert with exceptional skills in machine learning algorithms. Additionally, I require assistance with web scraping, primarily to help advise other team members. Ideal Skills: - Proficiency in Java or Python - Strong understanding of AI implementation - Extensive experience with machine learning algorithms - Knowledge of web scraping techniques - Ability to work collaboratively and independently Key Responsibilities: - Implementing machine learning algorithms for the project - Software development - Advising other team members on the web scraping component If you have a knack for AI, are well-versed in web scraping, experienced in software developement and can work effectively both as part of a team and indepe...

I'm seeking an experienced developer to create an advanced price monitoring/alert system that targets Amazon, via the Keepa API Key Requirements include: - Ability to monito...not being prioritized. - Automatic alert system for price changes. Frequency of alerts is to be confirmed, as this feature needs to be customizable. - Highly preferred for the system to be capable of tracking a variety of product categories such as Electronics, Fashion and Home Appliances. Ideal Candidate should possess: - Proficiency in Amazon's API (and Keepa API) and other relevant Web Scraping tools. - Previous Experience in developing price comparison or price monitoring tools. - Strong understanding of Data Processing and management. - Ability to deliver on time and maintain goo...

I need to scrape data from the website Transfermarkt.com. For specific football clubs and seasons, i need all arrivals and departures, including their name, age, position, transfer fee and sending/receiving club. I only need a generic code, where i can manually insert the club and year myself. I want the data to be transferred and appended in one excel file

I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code, documentatio...

I need a Python script that will create an endpoint for a Prometheus scraper to pull data from. I have the data already prepared, and it's ready to be pulled. Key Points: - The data to be pulled is in an unspecified format, so the script will need to be able to handle various data formats. - T...ready to be pulled. Key Points: - The data to be pulled is in an unspecified format, so the script will need to be able to handle various data formats. - The specific data fields the script should include in the endpoint for the Prometheus scraper are not defined. I'm looking for an experienced Python developer who has worked with Prometheus in the past and has a good understanding of data scraping. Knowledge of various data formats and the ability to handle dynamic data fields...

Hi Berty J. I hope you are fine. Remember the Skyscanner project you did? I need a cmd tool to get parcel tracking histories from where the last number is the parameter I need to call the tool and I expect a JSON on stdout with either the list of events (shipmentCourse entries) or anything they want to tell me like "expecting your shipment data soon." pls check and let's discuss availability and effort.

I'm looking for a skilled programmer who can quickly correct the issues in my web scraping project in python. The task involves scraping data from Website A. Specifically, I need to retrieve player, tournament, records and runs and bowlers information. Ideal Skills and Experience: - Proficient in web scraping techniques - Experience working with CSV format - Familiarity with data extraction from dynamic sources - Ability to troubleshoot and fix existing code - Strong attention to detail and accuracy Please note that I need this task completed urgently within few hours as base code is already written, need to fix details, so quick turnaround time is essential. Thank you!

I am seeking a proficient web scraper to extract specific data from The data I need includes venue details and contact information. I require the end product to be delivered as a well-organised Excel file. Key aspects to focus on: * Meticulous detail on venue data * Comprehensive contact information * High level data formatting skills The ideal candidate has demonstrated experience in web scraping, data management and Excel. A background in music or event-based data is a plus. Efficiency, precision and respect for the source website's terms of service are crucial for this project.

I'm in urgent need of someone who can scrape a website for me. So the intent is that we open the first page, and set a filter, and then go to each profile and open the websites/social profiles to see if they have any emails addresses. Output is a spreadsheet with rank, name, socials, website, email address. Skills required: - Web scraping - Ability to deliver results in a timely manner

I am urgently looking for an experienced Python expert with exceptional web scraping skills to extract text content from various sites. Your proficiency in data extraction and handling is paramount for this project. Specifics of the types of websites to be targeted will be discussed later. Ideally, you should have: 1. Proven experience in Python based web scraping. 2. Strong understanding of different types of websites and their structures. 3. Availability to start and complete the job ASAP. Please ensure your bid reflects your strong standing experience and your immediate availability to commence the task. Expect more details upon assignment. Let's get started!

Seeking Expert...business operations. How to Apply: If you're confident in your ability to deliver high-quality leads meeting the outlined criteria, we want to hear from you! Please provide the following information in your application: Experience: Share details of your experience with lead scraping, particularly within the specified industry and geographical location. Methodology: Outline your approach to sourcing and verifying leads to ensure accuracy and reliability. Samples: If available, provide samples of previous lead scraping work demonstrating your capabilities. Timeline: Estimate the time required to deliver the specified number of leads. Contact Information: We look forward to partnering with a talented freelancer to fulfill our lead generation needs effici...

I'm looking for an expert with significant experience in web scraping and script debugging to help address an issue with one of my scripts. The issue I'm encountering is with Website 1, specifically in relation to URL scraping. Despite providing the necessary command, the script is not collecting URLs as it should be. Ideal candidate: - Experienced in web scraping and script debugging - Proven track record with similar projects - Ability to resolve the issue in a quick, efficient manner Your task will not be deemed complete until the script is able to successfully and accurately scrape URLs from Website 1.

...platform management, Troubleshooting production issues and capacity planning. Create/manage sustainable systems and services through automation and uplifts. Balance feature development speed and reliability with well-defined service-level objectives Required skills and qualifications: Ability to program (structured and OOP) using one or more high-level languages, such as Python, Java, C/C++, Ruby, and JavaScript Experience in working with such as Amazon S3, Sagemaker, Amazon Bedrock Excellent knowledge working with cloud-native infrastructure, such as AWS Lambda, OpenShift Good understanding of API management and should be able to troubleshoot API related issues. Automation Mindset to manage cloud infrastructure using AWS CloudFormation/Terraform Impeccable creative and commun...

I'm in need of a skilled python developer to create a fully-automated program for me that operates o...engage with a specific post's link also provided. The engagement should include likes, comments, and shares, and there should be an option to track and verify these actions. Skill and Experience Requirements: - Excellent knowledge of Python programming - Familiarity with social media API, especially Facebook's API - Experience in developing automated tools on a Windows platform - Knowledge of web scraping and automation - Great problem-solving and debugging skills I expect the resultant tool to be user-friendly, efficient, and free from bugs or errors. As this task involves potentially sensitive information (Facebook login credentials), a commitment to priva...