Linux web scraping jobs

I'm seeking an experienced professional who can assist in developing a real-time FPGA Android AI solution for monitoring. Key Requirements: - Industry: Monitoring - Data to be monitored: Media, Scanning, OCR - Functionality: Real-time media processing Skills and Experience: - Expertise in FPGA development - Sound recognition, data classification algo - Proficient in Android AI - Prior experience in real-time media processing - Understanding of monitoring applications The ideal candidate would be able to effectively combine FPGA capabilities with Android AI to create a solution that can process media in real-time for monitoring purposes. Experience in similar projects or industries will be highly regarded.

scraping site: list scoreboards of a competition

I'm in need of a skilled Electron JS developer to join me on an ongoing project. Key Project Requirements: - **Operating System Compatibility:** Our primary target is Windows, with consideration for Mac and Linux. - **Functionalities:** - **File Management:** The application should allow users to efficiently manage their files. - **Offline Support:** Users should be able to access the app's core features even when not connected to the internet. - **Cross-platform Compatibility:** The app should work seamlessly across different operating systems. Ideal applicants should have: - Excellent understanding of cross-platform app development. This is an exciting opportunity for a developer keen to work on a sophisticated project and be part of a long-term collaboration...

I'm seeking a skilled professional to help in the scraping and generation of high-quality B2B leads specifically in the healthcare and other industry in Spain. Your primary task will be to extract verified email addresses useing tools as apollo. I need between 2000-5000 verified emails and phone number if its possibble. Key Responsibilities: - Utilize lead scraping tools and strategies to extract B2B leads in the healthcare sector. - Generate and verify email addresses for each lead Preferable skills and qualifications: - Proven experience with lead generation and email scraping in the B2B sector - Previous projects or expertise specifically within the healthcare industry is a significant advantage - Familiarity with data verification and the ability to provide...

Data Scraping from a website. I will explain in detail while hiring you.

We are in need of a highly skilled and experienced Python Developer who specializes in Large Language Mo...Augmented Generation (RAG) tasks. Key Tasks: -Your main responsibility will be to create a custom AI Chatbot by combining LLM (Large Language Model) with RAG (Retrieval-Augmented Generation) using custom data. General Requirements: - Demonstrable proficiency in Python and understanding of LLM and RAG is a generally necessary. - Familiarity with Chatbot modeling, data analysis, model building, web scraping, data extraction, and task automation will be regarded as additional advantages. This project provides an excellent opportunity for individuals deeply interested in language models and augmented generation. Interested and qualified bidders are advised to place their ...

Note: make millions after see results The AI Influencer Agency Bot would function as a middleman between businesses seeking to promote their products or services and influencers interested in collaboration. Here's how it would work: 1. **Business Search**: The bot would search for businesses looking to promote their products through influencer marketing. This could involve scanning social media platforms, websites, and other online channels for potential leads. 2. **Influencer Search**: Simultaneously, the bot would also search for suitable influencers who align with the business's target audience and marketing objectives. It could analyze factors such as follower demographics, engagement rates, and content relevance to identify the best matches. 3. **Initiating Contact**: O...

...Backend: C# coding. - Database: MySQL. - Currently hosted on a Windows server with IIS. - **New Hosting Environment:** - Hostinger VPS with Linux OS. - SQL Server installed via command line (no GUI). - No Windows server or IIS available. **Issues Encountered:** - Umbraco runs well locally on the VPS but not accessible externally. - Unable to attach the website domain. - Issues uploading the website from a local machine to the VPS. **Requirements:** - Expertise in Umbraco CMS. - Strong knowledge of C# and MySQL. - Experience with migrating websites from Windows/IIS to Linux environments. - Familiarity with configuring SQL Server on Linux. - Ability to troubleshoot and resolve issues with domain attachment and site deployment on a VPS without a GUI. **Re...

I'm in need of someone to help me scrape a website daily, note down a list of traders and run some checks on them. Qualifications: - Knowing how to use a computer. Tasks Involved: - Visit the website daily, note down a list of traders, and run some checks on them. - This needs to be done by hand, as it cannot be automated due to Cloudflare.

If you have ever run a bitTorrent application, then you can run this.... and get paid to do so. The free software can be found here: It's easy to install in Windows, Linux, or macOS. I also have it installed on one of my machines, but my internet connection is currently limited with my cell phone hotspot, so I am willing to pay you to allow your machine to stay online and run as a peer. I want to contribute to the decentralized search network and also connect as a peer to your machine. This can be done in the background. You could continue using your computer for other tasks. Key Requirements: - Able to download the free software and install it on your machine - Keep your machine online (or most of the time) - You may

...project: 1. Develop a web scraping script using Python (e.g., BeautifulSoup, Scrapy) to extract data from relevant grant databases and websites (if possible, considering anti-scraping measures). Sites to be scraped: 2. Design a database schema to store the extracted data. 3. Write scripts to clean, transform, and load the data into the database. 4. Design a WordPress directory listing interface with search filters to display the grant information. 5. Develop a user interface to query and display the grant information based on customer criteria 6. Create a Python plugin for WordPress to automate the scraping work, using tools like WP-Python or PyWP. This plugin would allow for scheduled scraping, data updates, and

...experience in developing software that can parse and interpret SERP data effectively. - While I'm not looking for a full suite of features, ensuring that the tool can provide a comprehensive SERP analysis is crucial. - The tool should be user-friendly, intuitive, and capable of generating clear and concise reports based on the analysis conducted. Given the nature of the project, expertise in web scraping and data analysis would be highly beneficial. Familiarity with Google's search algorithms and ranking factors would also be advantageous. Budget for this project is in parts and long term. The first stage it to get a platform to launch with. Then we will add more tools. We LOVE the project and look to offer something similar. IT is easy to use and easy ...

Please Sign Up or Login to see details.

I'm looking for a proficient web scraper who can extract text content from a specific website on a daily basis. The scraped data should be compiled and delivered in a spreadsheet. Key requirements include: - Daily scraping of text content from the designated website - Compilation and formatting of this data into a spreadsheet Your experience in web scraping, data compiling, and spreadsheet management will be greatly valued for this project. Accuracy, timeliness, and consistent daily delivery are crucial aspects of this job. Understanding of automation tools for data scraping would be a big plus. I am looking to collate some data from this website and need an ongoing scrape of this website to set up an ever-updating excel spreadsheet with the fie...

I'm seeking a dependable freelancer for a weekly web data extraction task. The primary purpose of this extraction is for market research analysis. Key Responsibilities: - Conduct weekly web data extraction for market research purposes - Deliver the extracted data in an Excel spreadsheet format Ideal Skills and Experience: - Proficiency in web scraping and data extraction - Previous experience with market research data - Strong attention to detail and reliable turnaround time

...site pages. Key Requirements: - Aggregating Business Ratings: The system should specifically focus on collecting the business ratings of security installation services available on Google. Data Points: The key data points that need to be collected include each business's overall rating and star reviews listed on Google SERPs. for Ideal Candidate: - Proficient in Web Scraping: Experience extracting and aggregating data from websites is essential. - Familiar with Google API: Knowledge of Google's API for harvesting ratings and review stars would be a plus. - Data Analytics Skills: Ability to process and analyze large amounts of data efficiently. - Rich Results and Schema Markup Please provide examples of similar projects you've worked on, and a brief ex...

I'm looking for a skilled professional to scrape and collect specific sports-related statistics from Website A. The template is made, its really jsut a copy and paste exercise. Code is already written. Key Responsibilities: - Extract sports statistics from Website A. Your Skills and Qualifications: - Proficiency in web scraping and data extraction. - Previous experience with similar projects. - Understanding of sports statistics is a plus. This is a one-time project with the potential for future work if successful. I look forward to discussing the project further with you.

We're looking to recruit a rockstar virtual assistant to execute admin tasks with SPEED. Plenty of room for advan...sheets - Basic knowledge of Wordpress - Flexibility with working time and hours Job roles include but are not limited to… - Scraping basic information from website lists - Navigate Wordpress and add needed information Note - put the number ‘88’ in your application so we know you’ve taken the time to read this description!! Required personal attributes: - Strong work ethic - Focus and efficiency - Great English skills Expect a long term role with plenty of room for growth. Approx 2-4 hours per day to start, but this can grow if you are good! Ideal candidates should be detail-oriented, able to work with speed, and have a good grasp ...

I'm looking for a skilled developer who can create an IP forwarder for Linux. Key Requirements: - The IP forwarder should support Linux as its primary operating system. - I need the forwarder to efficiently handle load balancing, traffic routing, and network security. Ideal Skills: - Experience in Linux system programming and networking is a must. - Understanding of load balancing and network security principles. - Ability to create a reliable and efficient software without the need for a graphical user interface.

I am looking for a data scraper to collect product information and pricing from various websites. Key Requirements: - The scraper should be able to collect data from multiple websites and be ea...future. - The data to be scraped includes product title, description, and price information. - The scraper will need to be able to navigate through the websites and accurately collect the required data. - The scraper should be able to work efficiently and provide timely data updates. Ideal Skills and Experience: - Proficient in web scraping techniques. - Experience working with product data and pricing. - Familiarity with tools and technologies used for web scraping. - Ability to develop a scalable and reliable data scraper. Please let me know if you have any que...

I require an expert in web scraping. The project involves extracting content, images, and product details from Amazon, eBay, and Craigslist. Key Project Requirements: - Extracting text content, images, and product details from Amazon, eBay, and Craigslist - Timely completion is crucial - the deadline is set as ASAP Skills Required: - Proficiency in web scraping tools and techniques - Experience in scraping from various types of e-commerce websites - Ability to deliver results quickly and efficiently This is a time-sensitive project and I'm looking for a professional who can deliver high-quality work promptly.

I need a seasoned expert to scrape data from a specific website for data analysis. The scope of the project, types of data to be scraped, and further details will be discussed once we move forward. Ideal Skills: - Strong understanding of web scraping techniques - Proficiency in data scrapers (ex: Octoparse, Content Grabber) - Understanding of data analysis Your application should highlight your experiences in these areas, provide examples of past projects, and present a brief proposal on how you'd tackle this project. Creativity, clarity, and specificity will be highly appreciated.

I'm in need of a skilled web scraper who can extract product details from Website 1 and deliver them to me in an Excel spreadsheet. Key requirements: - Extracting specific product details from Website 1. - Organizing and delivering this data in an Excel spreadsheet. Ideal skills and experience: - Proficiency in web scraping. - Strong understanding of data organization and delivery methods. - Experience in working with Excel for data delivery. Your role will be crucial in helping me access and utilize specific product data from Website 1. The neat and organized delivery in Excel will ensure I can efficiently work with this information.

I'm looking for a Python expert to help me with some specific tasks. The tasks are varied and I will provide more details upon chatting with interested freelancers. Ideal skills and experience: - Proficient in Python - Experience in data analysis, web scraping, and automation - Able to understand and tackle various Python tasks efficiently - Good communication skills for explaining concepts and discussing project details. - Flexible and able to adapt to changing requirements Please note that due to the nature of this project, I can only provide specific details once we have a direct discussion.

I need a skilled professional to assist me in installing Ubuntu 20.04 as a dual boot system on my Linux Mint laptop. This job will require: • Thorough understanding of Linux operating systems and dual boot set ups • Proficiency in partitioning hard drives and configuring boot loaders • Experience with Ubuntu 20.04 and Linux Mint Additionally, I require programming tools to be installed alongside Ubuntu. The right candidate should therefore be familiar with popular and necessary tools used for programming in a Linux environment.

...of data analysis. Key Requirements: - Data Collection: The primary task is to source and gather text data in a systematic manner. This may involve scraping data from websites, social media platforms, academic articles, or other relevant sources. - Data Analysis: The collected text data will be used for in-depth data analysis. Therefore, the freelancer should have a keen understanding of data analysis techniques, trends, and tools. Prior experience in text data analysis is a plus. Ideal Freelancer: - Proficient in data collection with a focus on text data - Skilled in data analysis particularly with text data - Familiarity with data scraping tools and techniques - Strong attention to detail and data accuracy This project offers an excellent opportunity for a talented...

...identifying possible bugs and vulnerabilities in web applications. Since I skipped my project specifics, your broad-based experience in Burp Suite is essential. Critical skills to have for this project include: - Proficiency in vulnerability scanning - Expertise in web application testing - Knowledge of report generation using Burp Suite - Identifying secret code of signature or ability to bypass Your task will entail scanning for vulnerabilities, testing web application functionalities, and generating detailed security reports. Despite not specifying the operating system in use, experience across various operating systems (Windows, MacOS, Linux) is an added advantage since Burp Suite is cross-platform. Your role here is crucial in helping optimize our ...

...sites may have more complex structures, requiring the freelancer to navigate and extract data accurately. - **Excel Formatting:** The extracted data needs to be entered neatly into an Excel spreadsheet. - **Advanced Level Detail:** The data extracted should be detailed and comprehensive, including historical data and analytics where relevant. The ideal freelancer should have experience in web scraping and data entry, as well as a good understanding of Excel. They should be meticulous, capable of handling potentially complex website structures, and able to work with a high level of detail. Excel: Analyze Data with Tables and Conditional Formatting Position: Virtual Assistant (VA) from Phillipines. Location: Remote Type: Long-Term Ongoing work (Not full time) but will tr...

I have a list of 2060 SKUs in an Excel sheet that I need corresponding images scraped from Website A. Each image should be saved with the SKU number as the filename (e.g., 324...Scrape images from Website A for 2060 SKUs - Save each image as a high-resolution jpg with the SKU number as the filename Delivery: - I will provide you with the Excel sheet containing the list of SKUs via email. - You should deliver the images in a compressed file with 2060 images, each named according to the corresponding SKU. Ideal Skills and Experience: - Experience in web scraping, particularly image scraping - Proficient in Excel for managing SKU lists - Ability to deliver high-resolution images - Attention to detail to ensure correct matching of SKUs and images Please, let me know if...

I need a proficient data scraper to help in generating Instagram leads. The focus will be on the extr...data scraper to help in generating Instagram leads. The focus will be on the extraction of Instagram usernames from the followers of a specific account, which I will provide. The successful freelancer should demonstrate advanced web scraping skills with a track record of similar projects. Attention to detail, ensuring accuracy, and maintaining a high level of confidentiality are desired traits essential for this project. Key responsibilities: - Scraping Instagram usernames - Ensuring high data accuracy - Ensure no duplication of leads Ideal Skills: - Web Scraping - Data Mining - Instagram API - Strong Attention to Detail - A strong understanding of p...

I require a Python script that can scrape specific data and ...property websites, and the script should be able to work across them all. Since these websites might have different structures, the script should be flexible enough to adapt to these differences. I would also accept 10 different scripts of varying logic if that helps the project to success. Skills and experience needed for this project: - Proficiency in Python programming - Prior experience with web scraping, particularly from dynamic websites - Ability to work with and manipulate large amounts of data - Understanding of property listing sites and their structures would be a plus Your solution should output all the data in an organized and easy-to-access format. Please highlight any similar projects you've ...

I'm in need of an expert software developer to create Trinamic motor control software. The software needs to be compatible with Trinamic motor control boards, specifically the TMCM-1260. The language required is Trinamic motor control command set. Key details include: - Operating System compatibility: Windows, Linux, and MacOS. - Required Programming Language: Trinamic Motor Control Command Set. - Timeline: Expected completion of the project is ASAP. Ideal Candidate: Would have experience and skill in dealing with motor control boards, TMCM-1260 in particular, as well as the Trinamic command set. A comprehensive understanding of multiple operating systems will be beneficial too. Those who can work within a tight timeframe would be best suited for this task.

I need a skilled PHP developer who can create a script that fetches information from a specific website when a user inputs a serial ID. Example serial : 2X0BHSB6AUXW5QAX (use this serial to test with) Site B : where the info need to retrive from to scrape information from to site A. Sorry for the bad image...$50 USD for this. If you cant meet this budget, dont bid on this work. Key Requirements: - Develop a PHP script to scrape information from Website B when a user inputs a serial ID on website A. - Ensure the script is efficient and able to handle multiple requests without performance degradation. Ideal Skills and Experience: - Proficient in PHP and web scraping techniques. - Familiarity with handling user input and displaying output in a web interface.

I am looking for a freelancer to replicate a website () for personal use. It is in arabic and is a text based site there is no copyright issues which i want translated into English through chatgpt. Ideal skills and experience for this job include: - Strong web development skills - Experience in website replication - Attention to detail to ensure accurate replication - Proficiency in web scraping techniques - Knowledge of HTML, CSS, and JavaScript - Ability to work independently and meet deadlines If you have the skills and experience necessary for this project, please submit your proposal. Thank you.

Hi, I need to extract data from some sites and compare them in a unique database. In few words i need a scraping code in python that extract data from some sites and the data have to saved in a mysql database.

I'm seeking an experienced system administrator to configure a Linux webserver that integrates Hestia Control Panel (CP). Key Deliverables: - Enable web hosting functionality for between 1 to 5 websites. - Configure email management services - specifically, the ability to setup email accounts and implement a solid spam filtering system. Ideally, the freelancers bidding on this project should have prior experience setting up and managing Linux servers and using HestiaCP. Knowledge of website and email database management, spam filtering techniques is a plus. Deliver reliable, secure, and high-performing results.

I'm in need of a skilled individual who can scrape data from various websites for the purpose of lead generation. The data should be delivered in Excel or CSV format. Key Requirements: - Proficient in web scraping - Experience with lead generation - Ability to deliver data in Excel/CSV Ideal Skills: - Proficiency in Python/R for web scraping - Previous experience in similar projects - Strong understanding of lead generation techniques If you have experience in web scraping and lead generation, I'd love to hear from you.

I'm in need of a skilled data scientist who can create a web scraping tool specifically for Shopify websites. I need to extract Product details, Pricing information, and Customer Reviews from a wide range of Shopify websites including those in the Clothing and fashion, Electronics, and Home and decor etc. Key requirements: - The tool should efficiently scrape the specified data points from the mentioned categories of Shopify websites. - The extracted data should be well-structured and easily exportable for further analysis. - The tool should be able to scrape a large number of websites in a relatively short period of time. Ideal Skills: - Proficiency in web scraping and data extraction - Experience with data structuring and analysis - Good knowledge of...

... Key Requirements: - Build a custom Odoo 14 module based on the Linux operating system. - The primary purpose of the module is user authentication leveraging fingerprint scanning technology. - The module should be developed using Python and JavaScript programming languages. Your responsibilities will include: - Analyzing the requirements and proposing a suitable solution. - Designing and developing the module from scratch. - Integrating the module seamlessly with the UareU Digital Persona Reader. - Ensuring the module complies with Odoo 14's community module development standards. The ideal candidate should have: - Strong experience in Odoo 14 and its community module development. - Proficiency in Linux operating system. - Proven track record in de...

I need a tool that can scrape text content and tables from LinkedIn quickly and efficiently into an Excel format. The tool needs to be able to: - Extract text content and tables from LinkedIn - Export the scraped information into Excel format - Operate quickly and efficiently to meet a tight deadline The ideal candidate should have: - Experience in web scraping, particularly with LinkedIn - Proficiency in Excel - Ability to develop a tool that can operate quickly and effectively Given the urgency of this project, I need someone who can start ASAP and deliver the tool in a timely manner. Experience with rapid tool development would be a huge plus.

I need a freelancer who can assist me in setting up a CentOS EC2 Webserver and a WordPress instance on AWS S3. The project is urgent so I need someone who can start immediately and work with me remotely over Google Meet. Key requirements include: - Installation of CentOS EC2 Webserver - Setup of a WordPress instance on AWS S3 Ideal skills for this project include: - Proficiency in Linux system administration, specifically CentOS - Experience with AWS services, particularly EC2 and S3 - Knowledge of WordPress configuration and setup Please only apply if you're available to start right now as this is an urgent project.

...Initiation Protocol (SIP) client for specific platforms. This client will cater to Windows and Linux operating systems. Key Requirements: * The core capability of the Python SIP client will be to facilitate audio calling. Therefore, the developer must focus primarily on this function. * For safety and security, a basic username and password system will suffice for user authentication. Ideal Skills & Experience: * Proficiency in Python language is mandatory. * Prior experience in developing communication applications, specifically in SIP, will be beneficial. * An in-depth understanding of user authentication using basic username and password systems is required. * Familiarity with Windows and Linux environments is a must. Consider this an opportunity to use your sk...

I need an experienced web scraping expert who can help me scrape relevant data from a specific website on a daily basis. Key Details: - I'm looking for data in text format including headlines, product descriptions, and any other relevant information available on the site. - There is no requirement for authentication to access the data, so the process should be straightforward. - The extraction needs to happen daily, so you should be able to set up a recurring scraping process. Skills and Experience: - Proficiency in web scraping tools and techniques. - Experience in extracting text data from websites and setting up automated daily scraping routines. - Good understanding of data formats and storage to deliver data in a usable format. I'...

I'm in need of a professional Linux server expert to assist with my CentOS-based web hosting server. Requirements: - Expertise in CentOS: In-depth knowledge and experience working with CentOS as the primary operating system of the server is crucial. - Web Hosting Knowledge: Understanding of web hosting principles such as server configuration, performance optimization, and troubleshooting is highly desired. - Security Audits: The task will also include conducting a comprehensive security audit on the server to ensure it is adequately protected against potential threats. - Performance Optimization: Assistance with identifying and improving performance bottlenecks will be required. Ideal skills and experience for this job include: - Strong Linux ...

I need a software expert to develop a program that scrapes text content off of multiple websites and then cross-refe...software should effectively pull out text content from all provided sites. - The text content should be in a plain text format, ready for easy analysis and interpretation, preferably in an excel spreadsheet or comma delimited list. - The cross-referencing component is crucial, as the software will need to compare the data scraped with that of another website. Qualifications: - Background in Data Scraping and Software Development. - Previous experience with cross-referencing data. - Proficiency in handling different data formats. In essence, I'm looking for someone who can create a tool that not only collates data but also carries out comparisons to yield rel...

I need a web scraping expert to gather data from the Maharera Maharashtra website. The data to be extracted includes agent names, their respective registration numbers, and contact details. The ideal candidate should: - Be proficient in web scraping techniques - Have prior experience in scraping data from government websites - Be able to deliver the project as soon as possible As I need this information urgently, I'm looking to have this done as a one-time scraping job.

I'm looking to transform my Linux laptop into a hosting server to sell hosting plans. I will provide root access for setup and maintenance, so you'll have full control to configure and manage the server. I prefer using cPanel as the hosting control panel for managing hosted sites. The main tasks and requirements for this project include: - Setting up the laptop as a hosting server - Installing and configuring cPanel - Advising on any additional software or configuration needed to make the hosting business-ready - Ensuring the server is secure and properly maintained Ideal applicants will have experience in: - Linux server administration - Setting up hosting environments - cPanel and web hosting control panels - Network and server security

I'm in need of an experienced Linux System Administrator to assist in setting up a new VPN server for my organization. The primary goal of this server is to ensure the secure transfer of data. Key Project Details: - The server is running on Linux, hence a proficient understanding of this operating system is crucial. - The creation of this VPN server is from scratch, so a deep understanding of VPN server setup is required. - The VPN server's primary objective is securing data transfer, so a focus on encryption and robust security measures is essential. Ideal Candidate: - Extensive experience with Linux system administration. - Proven track record in setting up VPN servers. - Familiarity with data security and encryption protocols. - Strong understanding of n...

I'm looking for a professional who can help me set up a free SSL certificate on my Linux VPS. Here are some key details about the project: GOT FREE SSL FOR ONE YEAR AND CAN INSTALL ON VPS USING COMMAND LINE. - Operating System: My VPS is running on Linux. - Root Access: I have full root access to the VPS. - Web Server: The VPS is currently running on Apache. Key Responsibilities: - Install and configure a free SSL certificate on my VPS. - Ensure that the SSL is correctly integrated with the Apache server. - Test the SSL setup to guarantee that it works efficiently. Ideal Candidate: - Extensive experience with Linux VPS systems and root access. - Proven track record of setting up SSL certificates on Apache. - Strong understanding of SSL configuration and...

Assistance with Linux - advise me how to do various operations, fix issues, etc.