Web Scraping Using Python
How to use the Scrapy framework for Web scraping
I need somebody who knows how to use RSS feeds or how to build a custom API (I think this is called data mining/scraping?). Or an alternative to achieve the following: I am a big fan of the Wall Street Journal, and I want to build a website that automatically aggregates and displays all of the Wall Street Journal’s exclusive news articles/exclusive content. And also for the New York Times and a couple of other publications. The site would only scrape and display the headline of exclusive news articles, the image for the article, and maybe the first two sentences of the article to respect the copyrights of publishers. Site visitors can click on an article, which will direct them to the full article on the publisher's site, where they will have to log in with...
10 detailed case study based articles about cryptocurrency: NFTs (Non-Fungible Tokens) DeFi (Decentralized Finance) Cryptocurrency exchanges Altcoins (Alternative cryptocurrencies) Stablecoins (Cryptocurrencies with stable value) Mining (Cryptocurrency mining) Blockchain technology CBDCs (Central Bank Digital Currencies) Cryptocurrency regulation Smart contracts
CPU AMD Ryzen 9 3900X Memory 128GB DDR4 Operating System Linux Ubuntu 18.04 - 64Bits I am looking for someone who can and has the experience to install a cryptocurrency mining server with multi coins See the attached file mining pool server, like this
Hello I need an expert in Data Scraping. Need to scrape some web content ASAP Please apply if you have the required expertise. No teams or companies please.
I am looking for someone to help with a project involving website scraping. Specifically, I need a website to be scraped from an e-commerce store and the results in a CSV or XLS format. I do not need this scraping to be done regularly, but I would like some kind of guarantee that the job can be done quickly and without errors. Any experience in this type of work is essential.
I need a person who can fetch data of various resale properties for specific location in Delhi NCR
Web scraping from the conference
I'm looking for a freelancer to help me with a project involving Horse Racing Soft ware scarping. I need the data scraped to focus on horse profiles, and I will provide pre-built solutions. The output of the data Scraping I need should be info that is compatible with a desktop progamme. The job requires expertise in developing software tailored specifically to the job at hand, so your experience in this matter is important. It is also important that the results be delivered in an efficient and timely manner, as well as being organized. I would like to view projects you have worked on in the past that are similar so that I can make sure you can do the project properly and trust in the final product. I look forward to seeing your responses, and please don'...
I am in need of top-notch data mining services to predict trends in the data I have on hand. The data is structured, so the most suitable approach for this would be to use mathematical algorithms to assess the data and draw conclusions from it. With your expertise, my goal is to accurately predict future trends and to gain a deeper understanding of the data. If you have experience in machine learning, statistical analysis, and other data mining techniques, please feel free to include them in your proposal as well. With your help, I am confident that we can make the best use of the data I have available and generate meaningful insights.
Hello there freelancers! We are a Business Growth and Development agency. I’m looking for a virtual a virtual assistant for appointment setting and data scraping with a knack for booking quality appointments. The ideal freelancer would be someone with at least 6 months of experience in cold calling/ appointment setting. They should be dedicated and hard-working and should be committed to the task assigned. They should be someone that rises above excuses to put in their best foot forward. If you don't fit these requirements, please do not apply. To apply please: 1. Provide a few examples of your work 2. Let me know what you charge Also, so I know that you’ve read and understood this job post, please start off your response with how many years you’ve ...
I am looking for an experienced freelancer who can create a safe and reliable mining pool for Kaspa. I have already set up a VPS and domain, and the operating system is Ubuntu 18.04 - 20.04 will be installed if necessary. I would like the mining pool to have a similar design and functionality as or , with a simple and clear system. The mining pool should have the following features: User-friendly interface for miners Secure payment system Mining statistics and monitoring DDOS protection Automatic payout system SSL certificate My budget for this project is $600 USD. If you have experience in creating mining pools and can deliver a high-quality product within my budget and timeline, please submit your proposal with relevant experience and portfolio. Tha...
Hello, I am looking for a concerned freelancer to help me with developing a web scrapper to scrape one specific web-site using multiple queries. The project requires scraping only some specific pages, which need to be done accurately and efficiently. Moreover, I also require additional processing of the scraped data. Most important things for me are: a) ability to query web-site by providing information in three different fields in order to be forwarded to next / output page b) the speed of scraping, supporting multiple threads using socks proxies (for example 100 scraping sessions at once) + updating proxies and rotating them every certain period of time c) convenient method of saving the output data (excel database, text files) -...
I am looking for an EXPERT web scraper that can build it in PHP. Looking at these guides I think it is possible to do what I want to do. It is mostly logging into a website, and collecting information from tables and forms to then store in a MySQL DB. The websites do NOT have MFA or captcha, and I do have permission to scrape the data. It should be written in vanilla / plain PHP as we will take the code and my team will modify it into a WordPress plugin. Please include in your bid "PHP not Python for Scraping" so that I know you are a real bid.
I am looking for someone to help me with a data scraping and machine learning project. This project is for personal use and will involve gathering numbers that need to be extracted. I am looking for someone with the expertise to utilize supervised learning to help achieve this goal. To complete this project, the freelancer must have a sound understanding of Data Science principles and skillsets. Timely completion of the project is a priority. It would also be helpful if the freelancer could provide additional insights, tips and recommendations to make the data gathering process more efficient. I look forward to finding someone to work with to help me accomplish my data scraping and machine learning goals.
I am looking for a proficient expert to help me with my data mining project. The project requires someone with expertise in handling a variety of data, including numbers, text/words and pictures. As the project is time-sensitive, I would like the expert to complete it ASAP.
This work will involve comparison of the LDA, Decision Tree, and SVM (linear kernel) classifiers as implemented in scikit-learn
I need a freelancer who can help me scrape data, clean and organize it, and create a supervised learning model. The data I need scraped includes URLs. I understand the importance of having clean and organized data before implementing a machine learning model, which is why I would also need support with cleaning and organizing said data as well. Because of the complexity of the project, I'm looking for a freelancer who has experience with data scraping, data management, and supervised machine learning models. The ideal candidate should be well-versed in today's technologies and be able to provide the best data scraping and machine learning solution for my project. If you think you are a great fit, then submit your pro...
I am looking for a freelancer to create a custom piece of Bitcoin mining software for me. The software must be created to work on Windows operating systems, and include additional custom features designed according to my specifications. It must also provide an advanced level of security to safely handle the transaction of Bitcoin. If you are an experienced software creater and are interested in taking this project on, please contact me!
Hi there, I need help scraping product listing data from one or more websites in CSV format. The website(s) can be any URL, and the data to be scraped should be Product Listings. This data will be delivered in a CSV file. I appreciate any help that you can offer. Thank you! PS: I want someone expert in this field, I have limited time to finish this due to some restrictions. If you are not experienced or can't answer or understand my questions/projects. Please don't bid. It will help me save your and my time. Regards,
we need to Create a UI to scraping data
hi sir need you to scrp last start faves from racenet must be just 1 last start fav in race
In need of an expert webscraper with the knowledge of scraping websites with automation. The respectful candidate will have to scrape data from 260 suppliers that have about 100k products each. The data that is scraped will need to be in the format of website link, price, upc code, name of product. This is my website. I’m only looking for experienced individuals. No negotiation on the rate of pay along with amount of work. It’s about 20 million products.
I am looking to have a python script written to help me with web scraping of PDF documents. I need the data that is scraped to be aggregated, so that I can easily review the content. The data will be coming from various websites, so the script must be able to successfully do this in an efficient manner. It needs to be able to identify if the source is taking too long to respond and move onto the next source. If you are the right fit for the job I look forward to working with you and building a successful relationship!
I am looking to hire a freelancer who can help me scrape data from an API in XML format, and keep the data refreshed periodically. This project requires someone who can not only provide an accurate and timely data collection service but who can also ensure the data maintains its quality and is regularly refreshed. The goal is for the data to be stored in a secure and organized manner, updating reliably as the data source is adjusted or changed. If you believe that you can carry out this project with excellence then I invite you to submit your proposal.
I am looking for someone to help me scrape some data from a website. I have the URL and the data that needs to be scraped is specific to one search (it will be multiple pages but they will all have the same structure). The data I need to scrape includes text information, images and links. I am looking for someone with experience in scraping data quickly, accurately, and securely. I will provide more details about the project once we have established a freelancer to work with. Thanks! I'd like it done in Python and, ideally, sent as a Jupyter Notebook
I’d like a CAT 6060 excavator and a CAT D11 bulldozer. Both facing outwards like in the pictures. With the silhouette of pine trees between the two machines in the background. Please remove the hi-vis ID number off the side of the excavator. I’d like the logo to be in the same sort of sketched/cartoon style as the reference logo. I’ve attached a... Both facing outwards like in the pictures. With the silhouette of pine trees between the two machines in the background. Please remove the hi-vis ID number off the side of the excavator. I’d like the logo to be in the same sort of sketched/cartoon style as the reference logo. I’ve attached also a logo layout that I’m fond of. As well as the text font. I’d like to have J-TECH, and then M...
Web scraping job for Talha8520
I want to export product details from ecommerce website.
Development of a Mining pool backend for KASPA coin. Functionalities: stratum server with variable difficult payment (payment frequency, pool fee and minimum payment configurable) All info must be persisted on a PostgreSQL DB REST API end points with the following information: kaspa network difficult / network hashrate pool hashrate connected wallets workers connected pool lucky mined blocks Miner Statistics by Wallet (total payment, pending payment, total hashrate, current round total shares) Suggested Endpoint Structure: /api/pools /api/blocks /api/payments /api/miners /api/stats /api/miners/<miner-wallet-address> /api/miners/<miner-wallet-address>/payments /api/miners/<miner-wallet-address>/stats Info: Reference for Stratum servers:
aperi media () is on a mission to digitize the world’s businesses, one Google Virtual Tour at a time. We're looking to hire a freelancer that has experience with lead generation, data mining, market research, prospecting tools, etc Expectations: 1. Strong written and verbal communication skills 2. Excellent prioritization and time-management abilities 3. Very detail-oriented and organized 4. Coachable and willingness to continuously learn and grow 5. Ability to handle and lead a team 6. Available to work during 9AM - 5PM EST hours This is a very unique opportunity to be a part of an initiative and help businesses all around the world.
I am looking for help to scrape data from websites and populate my Woocommerce store & Perfex CRM. Specifically, I need the data to include Images and all the relevant product details in order to provide comprehensive information about the items my customers would be interested in buying. This is an essential part of my business as it will lead to accurate and efficient transactions, as well as assurance that customer needs are met. I have identified the websites from which the data needs to be scraped, so all I need is an expert who can carry out this task quickly, with accuracy the top priority. I am happy to provide further information and support to ensure success with this project.
I am looking for a skilled Data Entry specialist to help me with a large project that requires high-quality data entry and web research. I need someone who is detail-oriented, organized and able to effectively input large amounts of data accurately and efficiently. The project should be completed within two weeks. You will be required to conduct internet research and data mining to locate specific information and data in order to create a comprehensive report. As the Data Entry expert, your job will be to input the collected data into the provided system. This calls for excellent attention to detail, strong accuracy, speed, and overall technique. You will be provided with a list of necessary data points as well as an ...
I have a basket of stocks defined in an Excel workbook on Google Drive on Sheet 1. This is a Yahoo Finance API job. It is not screen scraping. Excel or Google sheets. Python. I want a Python script to go to the Yahoo Finance APIs and pull the 50-day average for the stock and use the API to pull the data to calculate the 20-day average for the same stock and return it to the Excel file at the bottom of Sheet 2. Columns: Date symbol displayName fiftyDayAverage fiftyDayAverageChange, fiftyDayAverageChangePercent regularMarketPrice regularMarketDayHigh regularMarketDayRange regularMarketDayLow regularMarketVolume Then sort by: Date, symbol The delete all rows where date <> today's Date Save workbook I should be able to run this script from Visual Studio code: yo...
Download 2500 approx files when logged into a site. Add the data into excel / google sheets; Title, Author, Year, Language, Country, Pages, Tags
Look for european and russian freelancer to scrap simple data
I'm looking for someone to help me with website scraping. This project is for personal use, and I need to scrape adult website research from at least 245 webpages. Experience in this field and proven track record with successful website scraping is a must. Specific details of the project can be discussed upon acceptance. I'm open to negotiation regarding the budget, as long as I can find someone who can deliver quality results on time.
Note : My budget is very tight (Less than $5). Fresher are welcome. This is good for those who want good relationship on there profile. Work is very simple. And a...relationship on there profile. Work is very simple. And also Write on top that I am comfortable with adult website. Award will be Lowest bid, Not for quality work. I am looking for someone experienced in web scraping to scrape content from an adult website. Specifically, I am looking for text content to be scraped and I am open to anything that is available on the website. The content I need scraped only needs to be done once. The freelancer should have a lot of experience with web scraping, as well as understanding ethical issues related to scraping websites. It is also important that th...
Hi Guys We are looking at essentially moving all the information off our website onto another website. Can you please help us with scraping all the data and images off the website such that we can then reupload it all onto one of our other websites? Website link is We are looking to scrape everything off of it. Please advise how you can help us.
Project ARROW is the first stage in deploying a commercial niche (conservative political) search project by a US based funded start-up. We are looking to rapidly hire teams to complete this wo...funded start-up. We are looking to rapidly hire teams to complete this work. The successful completion of project ARROW will move our search product closer to full commercial deployment and helps us identify teams which we can work with on future projects, as we work to bring our search product to market. IF THERE IS NOTHING CONNECTING YOU WITH SEARCH, IF SERP, ELASTICSEARCH, SOLR, INDEXING, SCRAPING, ALGORITHMS, RELEVANCE, ETC. PROFESSIONALLY MEAN NOTHING TO YOU, PLEASE DO NOT APPLY. IF YOU CANNOT DO THE WORK, YOU WILL HAVE WASTED YOUR PROFESSIONAL TIME AND OURS. Project description i...
webscraping data using python
Hello my name is Daniel, I have a software brokerage firm that specializes in developing custom software, and we need a new web scraping developer who works in python to help us reach our goal with one of our clients. This websites that we are scraping are difficult to get so we need only professional and experienced scrapers. If you’re interested, please reply to this project.
I need to check if we can customize and run a scraping service with the parameters I have in mind
Hey Ravi. You worked with me in the past on a scraping project and I have another one (possibly two). I have a list of skus from that i need scraped. I need a specific format for a csv upload to shopify. I need all these products: I need category for each (which is on the parent page) and the product data:
...am seeking an experienced freelancer to create a secure and reliable mining pool for Kaspa, Dynex, Ergo, Monero, and Litecoin. I have already set up a VPS and domain, and the operating system is Ubuntu 18.04, which can be upgraded to 20.04 if necessary. The mining pool should have a user-friendly interface and a clear system, similar to , , or The mining pool should possess the following features: A user-friendly interface for miners A secure payment system Mining statistics and monitoring DDOS protection An automatic payout system An SSL certificate My budget for this project is $600 USD, but I am willing to negotiate. If you have experience in creating mining pools and can deliver a high-quality product within my budget and timeline
I'm looking to have a web scraping project completed, collecting Products & Prices from a website that isn't Amazon or eBay. Specifically, I need the data updated on a weekly basis. The data should be collected in a database or spreadsheet in an easily accessible format. I'm looking for someone who is experienced and knowledgeable in this type of project and can provide accurate, reliable results. Knowledge and experience with different programming languages (e.g. Python and Ruby) is a plus. Please get in touch if you think you fit the bill and can help me out. Thank you!
I need simple web scraping with NodeJS and Puppeteer.
Hi Prakash C., I wanted to show my appreciation for working on this scraping project without award. I have decided to hold the project from others until you have exhausted your efforts