Optimize the parallel analysis spark

$30-250 USD

Closed

Posted

about 2 years ago

$30-250 USD

Paid on delivery

Make spark more parallel our goal is to propose a new parallel performance model for different workloads of Spark Big Data applications running on HPC clusters. We need to add parallel technique on the rdd, to be parallelized. Then the execution will be faster. After we add parallel technique on RDDs, then we need to call openAcc and MPI pragmas to execute these parallel RDDs on GPU, we will call MPI and openAcc pragmas by a wrapper. For now we need to create a new parallel algorithm (foreach,for loops …etc) and apply it on the RDDs, but we need to make sure these new techniques are equivalent or appropriate to parallelization of MPI and OpenACC programming model. using Scala Language

Scala

Parallel Processing

Algorithm

Project ID: 33487054

About the project

3 proposals

Remote project

Active 2 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

3 freelancers are bidding on average $313 USD for this job

@KolaPeters

I'm the right freelancer for this work, please kindly send me a message, can help and deliver within your time. Hi there, I'm a senior engineer with rich experience in Algorithm, Scala, Parallel Processing, Matlab and Mathematica, Algorithm, Software Architecture, Mechatronics, Deep Learning. I am a Python developer with 5+ years of experience Skills: PyQt, PySide/PyQt,Scrapy, BeautifulSoup Java, C++, C#, SQL, 4, Pillow, Matplotlib, Xml, PHP, Django json, and csv modules. Expert in statistical analysis of datasets/images and apply ML/DL algorithm with python (Tensorflow, Keras,Pytorch) and R. I am interested in taking this task up for you and I hope I could awake your interest in me. Please kindly send me a message in chat window for more about the project and to adjust price, note price quoted in bid is not the final price, it can be less or more after discussing the project. I am always online, work hard and very sensitive to details. I hope to read from you in chat box. Best regards

$140 USD in 7 days