Data Processing and Filtering

This is the first job of a serie.

I need support in filtering data. I have about 70 million values (tick data) from EURUSD cross. Each row has date, time and price value.

- i need a script, program, formula or anything else that allows me to do what is described below. I'm open for your comments and advices. Possibly, if a program, it should be free or easy to use. I have excel, but i fear 70 mio. values are too much.

- i want to filter data similar to how data are filtered for point and figure or renko charts. Only increases or decreases of x pips (price) should be considered, all other data can be deleted.

- starting from the first price value , the next value greater or equal than first value + n.x pips (resp. the next value lower or equal than first value - n.x pips) should be considered. Values in between should be eliminated. --> see sheet2 of excel attached

- i should be able to change the x value

- to each increase of price (of the filtered data), a +1 should be attributed, while to each decrease of data, a -1 should be attributed.

To better understand the concept, see sheet 2 in eattached excel. Also find some example data in sheet 1 for your tests.

Skills: Big Data Sales, Data Mining, Data Processing

See more: what is data processing job, data processing in data mining, excel sheet formula, what data processing, mio, Data Processing, excel data filtering, formula sheet, excel open formula, filtering excel, easy processing program, excel filtering, filtering data excel, decrease formula, script renko, renko formula, data mining date, excel price charts, formula excel mining, data filtering, filter script excel, script mining, excel filter script, data processing data mining excel, tick data script

About the Employer:
( 1 review ) Camorino, Switzerland

Project ID: #5900838

Awarded to:


Piece of cake. I did it in 23 lines of code and 26 minutes just for fun. Although I had hoped to did in 5 minutes.

$35 USD in 1 day
(0 Reviews)

18 freelancers are bidding on average $175 for this job


Hello, filtering 70M values is a lot, but doable. I will code a program(desktop PC based), that will filter the results. The X value will be changeable. I'll need several days for testing and optimizing the software. I More

$526 USD in 5 days
(41 Reviews)

Hi, I can write a little program in java to filter the data you need. You need only give the path to the file with the data and the pips value you want and the program will create a file with the data filtered. More

$35 USD in 3 days
(6 Reviews)

Hey There, Thanks for posting the project. Its looks feasible and am Interested to do it. Next steps: Lets discuss/validate the complete requirement and I can start to get this done with required quality ou More

$189 USD in 1 day
(7 Reviews)

Hi, I am very experienced in Algorithm Design as a former informatics Olympiad contestant and current contest programmer. Review my profile and let me know if you are interested. I can do this easily and quickly. Paym More

$170 USD in 3 days
(1 Review)

Bir öneri henüz sağlanmadı

$30 USD in 3 days
(3 Reviews)

Hello, I carefully read your requirements and decide to take the project. About my profile, I was studying business information system, created many Business Intelligent system with SAP Crystal Dashboard, Web applica More

$88 USD in 2 days
(0 Reviews)

Hi, We are a BAI (Business Analytics and Intelligent) company. We specialized in Data Integration Data Processing Data Warehouse Business Intelligence Visualization Big Data (Hadoop) -------------------- More

$155 USD in 7 days
(0 Reviews)

Hi, expert perl programmer here with over 17 years experience - please see my ratings. I am able to finish in one day. Kind regards, Razvan

$155 USD in 3 days
(0 Reviews)

Hi, Please visit my linked in profile to get an overview of my experience: [login to view URL] I have done similar hadoop project through freelancer. I would be interested i More

$155 USD in 3 days
(0 Reviews)

Δεν έχει γίνει καμιά πρόταση ακόμα

$150 USD in 3 days
(0 Reviews)

Hi, I can do this for you. I will write it in Python, which is freely available on all operating systems. It should take no more than two days and I will provide documented code along with instructions on how to use More

$90 USD in 2 days
(0 Reviews)

A proposal has not yet been provided

$166 USD in 3 days
(0 Reviews)

Hi I have read your job post and very interested in this. I am experienced data miner and preproccessor and usually i used Rapid miner or weka for the processing. I am available for this job. I am also computer s More

$155 USD in 3 days
(0 Reviews)

Hi This is the first contract I have bid for on this site so forgive me if I don’t provide all the details one would normally expect to see. It sounds to me like your requirement is conceptually very straightforw More

$247 USD in 3 days
(0 Reviews)

A proposal has not yet been provided

$283 USD in 5 days
(0 Reviews)

I am a very good and intellectual report writer as well as an efficient academic writer. I am well acquainted with the kind of work you need to be done . I assure you to complete the work with complete inf More

$277 USD in 5 days
(0 Reviews)

I have been writing financial data trading systems since 2003. Also, please note that I'm a proud professional for the past 27 years, currently state licensed in Florida, USA. You will be getting nothing shy of profess More

$250 USD in 3 days
(0 Reviews)