Find Jobs
Hire Freelancers

scrape data with Golang

$250-750 USD

Closed
Posted about 1 year ago

$250-750 USD

Paid on delivery
Build a project in Golang, to scrap data from twitter, website and test the scraped data after the URL, I specify, the scraped data will be a path So, the test on the WebHost will be like this URL/+ path of the scraped data and check if the result of Get request sucsess http 200 e.g Last step option to generate a pdf report for the http request This project should be done with Kali linux OS
Project ID: 36136912

About the project

25 proposals
Remote project
Active 1 yr ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
25 freelancers are bidding on average $481 USD for this job
User Avatar
Hi, I'm George and I specialize in web crawling. I've recently been developing a custom web scrapping tool, which makes me a perfect fit for this job. I'm confident I can build the project to scrape data from Twitter, websites, and to test the scraped data in a URL you specify. In addition, building a PDF report for these HTTP requests would be no problem. To e
$750 USD in 3 days
5.0 (79 reviews)
7.5
7.5
User Avatar
Hello Good evening , I just finished reading the job description . I see you are looking for someone experienced in developing products using Web Scraping, Google App Engine, Data Integration, Golang and Linux. This is something I can do, Please review my profile to confirm that I have great experience working with these tech stacks. While I have few questions: 1. These are all the requirements? If not, Please share more detailed requirements. 2. Do you currently have anything done for the job or it has to be done from scratch? 3. What is the timeline to get this done? Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Timings: 9am - 9pm Eastern Time (I work as a full time freelancer) My Portfolio: https://www.freelancer.com/u/AwaisChaudhry Please start the chat to discuss it further. Regards, Awais
$750 USD in 21 days
5.0 (6 reviews)
6.8
6.8
User Avatar
Hi! I am an expert Python engineer with skills including Data Integration, Linux, Google App Engine, Web Scraping and Golang. - web scraping, data mining, data extraction, data transformation, - writing scripts and utilities, - image / file downloading. - scraping info from websites into SQL-like DB or any other format (txt, CSV, EXCEL, JSON etc). - file transformation. Web scraping technologies: - Selenium Webdriver - create autotest, scraping information from different websites - Scrapy - a gathering of information variety of websites like amazon, airbnb, etc (python) - Xpath - analysis and using XPath to navigate in an XML document - beautiful soup + requests - collecting information from the given websites. Skillset: - Java – advances (new tools implementation, web applications creation, bug fixing, code review) - JavaScript – basic (new script creation, support existing solution). - Groovy – basic (creation simple CRUD web application using Grails Framework). - Python (knowledge: PyGame, Django, scrapy, beautiful soup) - Spring (Core, MVC, Security, JPA) – new application creation, support existing web applications. - Oracle SQL – creating new scripts, support and tuning existing scripts. - HTML + CSS – simple page creation / support existing Please contact me to discuss more regarding this project. Thanks & regards
$250 USD in 4 days
4.8 (28 reviews)
5.4
5.4
User Avatar
Hello there, I can help u with this job plz contact and initiate the chat so that we can discuss in detail. I have great experience with Golang, Data Integration, Linux, Web Scraping and Google App Engine. Meanwhile here is my profile: https://www.freelancer.com/u/ayesha0124
$750 USD in 9 days
5.0 (3 reviews)
4.9
4.9
User Avatar
Hi there! I have more than 10 years of experience as a Data Base Administrator and Analytics Engineer. I'd love to work together on your project building a project and testing data. I'm so responsible and kind, I will always send you the files on time and with the best quality. Send me a message and I'll start working on your project. Politely, Giovanni.
$250 USD in 1 day
5.0 (3 reviews)
3.5
3.5
User Avatar
Hello, I hope this finds you well. I have just seen your project requiring; Linux Web Scraping Google App Engine Golang Data Integration I believe that my 10-year experience in this field is what you need right away. Avoid the headache of looking further. Let's save time and focus on the real task. My proposed timelines and budget are just placeholder and an open for negotiation to increase or decrease as per the full requirements at hand. Allow me to prove how better my review can be. Smile all the way! Click the message button, so initiate the conversation. Regards, Fridah
$250 USD in 4 days
3.5 (7 reviews)
5.1
5.1
User Avatar
Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg
$250 USD in 7 days
4.8 (5 reviews)
3.4
3.4
User Avatar
Hi, I can work on the project you propose without problem, as I have been working on Golang scrapping projects for the last 5 years. Please do not hesitate to contact me for any question you may have. Regards.
$700 USD in 14 days
5.0 (1 review)
2.2
2.2
User Avatar
Hi there. I am an expert python web developer with expertise in data scraping, data crawling, and browser automation. we use numerous techniques for data scraping and using selenium for data extraction. let's come in and chat and discuss further details. regards Akshay
$300 USD in 7 days
5.0 (1 review)
2.4
2.4
User Avatar
Hello Amjad A., I've just seen your interesting proposal. I am delighted to tell you that my qualifications are well matched with your needs and I consider myself worthy enough to get the job. If you want a job get done right, you have to select the right person. I'm well versed in Linux, Web Scraping, Google App Engine, Golang, Data Integration and have strength in architecting project from scratch. Also, I'm well versed in both expo and bare flow. Beyond the coding chops, I'm an excellent communicator and team player, I’m passionate about writing and sharing what I’ve learned both with my teammates and the broader web community. I really value the ability to not only perform web development work but also help others improve their craft, because I’ve gained so much from others sharing their skills and knowledge. Please come over chat and discuss your requirement in a detailed way. Thank You
$680 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I'm fast at typing on the computer & I'm free right now. I review everything I write more than once. I have years of experience using excel & web scraping. I have the updated version of Excel. Let's discuss all details through chat. I request all chats and work to be discussed only via FREELANCER. Looking forward to work with you.
$250 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, How are you? I just saw your job posting and I felt that I can help you with this job considering the experience I have with Data Integration, Golang, Web Scraping, Linux and Google App Engine. Please check my portfolio: https://www.freelancer.com/u/AITSoft Regards, Shamshad
$750 USD in 29 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, my name is Alejandro, the last 15 years of my life have been dedicated to what I am most passionate about, which is TECHNOLOGY. I gave service to the Federal Government of my country in the technological area, managing to lead a team of 50 programmers. I decided to embark on an independent path where I can share and disseminate everything I learned in the development of new technologies to companies or entrepreneurship that are unaware of this world. In my profile I have some of the projects that we have been carrying out. We elaborate the entire process, design , market research, testing, business analysis and development. What I offer is basic to start a conversation if you find my profile interesting, I would love to know more details about the proposal and if it is possible to have a meeting to get to know each other. I am very interested in each project that we tackle with the team, we get involved and commit so much that it is also super important for us to know who is on the other side before starting work
$500 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear client, I saw your job description now and I am so interested in your project. I have many experiences of 4+ years in Node js puppeteer, Python selenium and php selenium web scraping. If you need to discuss with me for any kind of suggestions or information, please knock me anytime. I am looking forward to hearing from you very soon. Thanks for your time.
$250 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I am a golang developer with 3 years of experience building web applications in golang. I have also worked on scraping data from websites with golang and python. I am a seasoned hard working professional. Why should you choose me? 1. I have a very deep knowledge of golang and its library 2. I can provide you with very high quality of work. 3. I will provide you full support beyond this project with things like setting up the project and future extensions. 4. I will provide you with excellent documentation of the whole process. 5. I will help you understand the project code and how it works in the background. My profile as a freelancer is not up to mark as I have started recently. If you choose me I will work very sincerely to fulfill the project. One thing I can say about me that I am not only about delivering a project , I also like to take time to understand my clients need and provide him with kind of support to my fullest to make this project a success. Please reach out to me, If you want to discuss further about the project. I can provide you with helpful insight about the project whether you decide to work with me or not. I would love to hear from you. Thanks Ahmed
$450 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Build the Golang Application with factory pattern so the return type of your scrape URL can be changed dynamically. Also set the application to be a graceful so when the scrape is on running and error happened it can restart automatically, also when the server wants to shutdown, it can shutdown gracefully
$500 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I am Rischi and I am excited to learn more about your project. As a part-time worker, my background is in backend engineer with 3 years of experience in staff administration. I have extensive experience working with Docker, Golang and API development. My expertise makes me the perfect fit for this project as I have the knowledge and skills necessary to deliver a successful outcome. I believe I can provide the best solution for your project because I have a deep understanding of coding and I can understand how to read others' code making me an ideal choice for this job. Please feel free to reach out if you would like me to discuss further or answer any questions you may have about me or my skillset. Thank you for considering me for this position!
$500 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of SAUDI ARABIA
Makkah, Saudi Arabia
0.0
0
Payment method verified
Member since Aug 26, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.