Write some Python Code Snippets

In Progress Posted 7 years ago Paid on delivery
In Progress Paid on delivery

I need some help in writing some Python code – efficient solutions for relatively elementary functions. I have some Python experience, so I will be able to do the fine-tuning of the algorithms, i.e. changing the folder/file names, database queries and the details (if then, comparisons etc.) within the algorithms – i.e. everything related to the actual biz-logic. This will be faster than explaining too many details of the biz-logic. The algos will do some very extensive calculations – so knowledge about algorithmic efficiency is really appreciated.

I have a very detailed spec on what I want to accomplish and what have to done within the Algo – however, I will share the details only as providing context; I have also a list of elementary things for which I need help/assistance – this list is attached to this project as a PDF. (Also, I have already gathered some additional material/links to get the issues on that list solved. I will share my research.)

Most of the code must use NumPy (i.e. efficient processing of arrays) – because the algo deal with large amount of data from a DB. Some operation must be done within memory only (e.g. compression should not send data to file system; or export of data to file system should be done in threads, so that the export is not slowing down the algo)

Additionally, most algos are querying data from an AWS RDS instance and/or inserting/updating data in that DB. Additionally, the Algo requires a byte-range access to a file on S3.

Finally, I want to do a load/unload of a DB (RDS) table from/to S3 using AWS API i.e. its BOTO Class.

The system should be setup on an EC2 instance (in a micro-instance as a starter/staging system) – i.e. Python, NumPy and all other components should be installed on that AMI – Also I want to know how a EBS storage is being accessible by that AMI – please do some screenshots ...and put it in a PPT so that I can later see what and how it was done.

Some of the work could/should be done in collaboration with me via TeamViewer so that I can decide when to take over the details in getting the remaining details done by myself -- instead of explaining it to you – share code-snippets with me early on and I will tell you where I will need potentially additional help.

Amazon Web Services Python Software Architecture

Project ID: #11294679

About the project

5 proposals Remote project Active 7 years ago