We are looking to develop an Apache Spark or equivalent Pipeline to replace our hosted ML platform, and host the server ourselves. The current hosted platform is doing quite well, with ROC / AUC, Precision, Accuracy, Recall and F1 all above .98 (mostly above .99), but with 300,000+ Production API Transactions, it is getting quite expensive, so we are looking for alternatives.
Our current 3 classification models (in an ensemble configuration) utilize 300 or so features and seem to perform best with decision tree models, but we would like to explore different models to see which perform optimally.
We have a training data set available in a MSSQL that we can give you access to, and we will need to develop a streaming API so we can submit samples for analysis in real-time, then upload the results (along with the extracted features) to a different table in the MSSQL database. Our desktop software first checks the database to see if an identical sample has already been submitted and analyzed, and if it is not in the database, our desktop software submits the features to the hosted ML platform for analysis, then uploads the results and extracted features to the database.
Hi,
I have experience building machine learning pipelines using the Cloudera Hadoop stack on various platforms including Azure, AWS and on local hardware. I can recreate your ensemble classification model as required on a server where payments are made for server uptime (in case hosted) or no payments are made (where you own the infrastructure) rather than per API call. Performance in terms of model evaluation and speed will be equivalent.
Regards,
Chris
$600 USD in 10 days
4.6 (14 reviews)
5.3
5.3
11 freelancers are bidding on average $626 USD for this job
Experienced data scientist having worked on structured as well as unstructured data using a variety of Tree based, Linear & NN based models. Would like to understand the requirements in a bit more detail. Looking forward to hear back from you.
HI
I am experienced ML developer with python,spark, scala skills and developed various ML models in diverse domains like recommendation engine, predicting the sale order probability for courier company and assigning shortest route, classifying the bird species from the satellite imagery,nudity detection etc.
We can help you in understanding and upgrading your project.
Looking forward to hear from you.
With Regards
Bonjour! It is my humble offer to present my services to you for this project. I have passed 15 certifications here (& with 5-star rating) and your project's domain resides in my area of expertise.
I have few questions to ask and to showcase my skill set. Please message me so we can have a detailed communication.
Please enlighten me on all technical aspects of this project. Thank you.