Hi
PHP is so slow when compared with C++, but if you do not use many threads, you won't get a better speed that deserves writing new code.
I recommend using a thread pool. For example 20 threads are working together and each thread works on a set of URLs (let us say 100 url). By using threads, you will get a very good speed.
I can build this using threads and asynchronous programming in Qt, so you get the best speed ever.
When we use asynchronous programming, the threads won't consume CPU cycles while they are waiting for the reply to be received. Also in C++ we get faster parsing for response to detect redirects.
We will also give enough time to test the program, so I added more days to the project.
Thanks in advance