basically, a while back we wrote some scripts to scrap some websites and download their content, due to some changes in the websites, the scripts have stopped working, i need some smart freelancer to troubleshoot them for me, and based on his knowledge and work flow, more jobs are available
you must be have good knowledge to work with sell script, linux and similar apps
regards
Good day,
Question for you, since you are on linux and using shell, are you also using the command line curl to scrape these sites?
If you are using curl and want to scrape more than once site at the same time, I have done development making a multithreaded C scraper using the curl development libraries which is lightning fast.
It is 11PM here and I am just shutting down, but since you are at least 13 hours ahead (just finished a project a few min ago with a guy in Sydney) send me more info on what you are using and exactly what you think is no longer working. i.e. the sites you are scraping have changed.
I'll be able to look at it in 7 hours.
Mark
Dear Sir,
I'm working linux shell-script for more than 4 years and also doing many scaping data before so i'm confident can solve out your problem or change in the website. Just ping me.
Best regards
Thanh