Handle duplicate removals in huge excel files

So we have huge excel files in various formats that we sometimes must double check against each other and remove duplicates from file A that exists in file B. In short we put all the info that will be matched in column A in both files. Then we use to run a MACRO but it takes hours for huge files so we need a better solution. Maybe access or similar?

The files can have different amount of columns from time to time but column A will ALWAYS have the info that will be matched.

So File A) is matched against file B) and the output file will be file A) with all the UNIQUE rows intacs. In other words all the rows that file B) has that matches with file A) are removed from file A) And the rest is output.

I need this done ASAP since we have a file of 1,5 million rows that we need to match agains a file with about 200k rows and I can't use a macro for that since it's too slow.

Skills: Excel, Microsoft Access

See more: software write mq4, software write chip epson, useful software write book, software write web specs, view huge excel files, free software write user guide, software write edid, free software write company profile, merge excel files remove duplicate, software write websites idea, software write book images, software write books, software write protection, free software write book, software write book, software write protect software, code compare excel files find similar items, software write technical manual, lock excel files, access read excel files, code compare excel files, locking excel files, j2ee reading excel files, fetch data excel files, combining excel files

About the Employer:
( 42 reviews ) Solna, Sweden

Project ID: #12186692

63 freelancers are bidding on average €35 for this job


We are amongst top 1% global outsourcing providers. We have successfully finished over 430 projects in last 13 years. ID : 12186692 Greetings, We are interested to work on this project, please find my comments i More

€333 EUR in 12 days
(221 Reviews)
€80 EUR in 1 day
(248 Reviews)

we can add match/index formula and it will highlight duplicate rows, so we can remove those please share files, i'll show demo before you hire me thx

€35 EUR in 1 day
(253 Reviews)

Hi, I have more than 14 years of Visual Foxpro exp and I am expert in this kind of work. I can build this using Visual foxpro which will be pretty quick. not sure how long macro is taking now ? I have comple More

€30 EUR in 3 days
(98 Reviews)

Hello, I am Excel and VBA expert. I can create very fast macro. You have a very slow macro. I have a way to make my macro work very fast. I have just done tests on my data. For two files (each about 1 mi More

€39 EUR in 0 days
(51 Reviews)

Do you need a one time matching or a code solution? If you want a one time duplicate removal, I can start right away and give you output in an hour.

€23 EUR in 1 day
(87 Reviews)
€30 EUR in 1 day
(59 Reviews)

Hi! I would like to offer my service to handle removal of duplicate rows in the huge excel files. I think the macro you have is not optimized enough to work with the huge number of data, hence the slow performanc More

€30 EUR in 1 day
(67 Reviews)

I have gone through the description. I am very much interested to work on your project. I’ll provide you the work as per your requirement with in a particular time frame. So let’s start

€100 EUR in 1 day
(69 Reviews)

Hello, I have experience in excel, data entry work. I can remove duplicate. Please check my portfolio. I can do this project with accuracy. I am ready to start Now. Please review my bid. Thanks. Rich

€19 EUR in 1 day
(55 Reviews)

Hi, i can help you with this project, please let me know more about it :) i may fix your macro so you will get same results in less time, or i will create a tool in VB.NET that can handle this amount of rows in supe More

€29 EUR in 10 days
(15 Reviews)

I have 10 years experience with Data Processing in Excel and Web Researching. I work with: Web Search Web Scrapping Excel Access PowerPoint Finance Management Statistics Data Processing Data Collect More

€30 EUR in 1 day
(10 Reviews)

I have bachelor and master degrees in IT. My Primary skills include Java, Python, VB/.NET, ArcGIS, and PHP. Also database skills include MS Access, MySQL, and Oracle. My Other skills include server and network administ More

€30 EUR in 2 days
(16 Reviews)

Lest's start work with great accuracy and with in time deadlines .My aim is to satisfy my client by my WORK.Thanks.

€12 EUR in 1 day
(14 Reviews)

Hi, I am an expert in MS Excel, MS Access, SQL database production and management. I have over 7 years of experience in working with all of the databases and analytics. I am a financial engineering graduate and have e More

€10 EUR in 1 day
(11 Reviews)
€34 EUR in 1 day
(7 Reviews)

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 6 years of experience. I have successfully completed few projects for US clients which involved web sc More

€34 EUR in 3 days
(16 Reviews)

Hello There, Here are some of my work examples. Project Report Automation - [url removed, login to view] Log Report Automation - [url removed, login to view] More

€40 EUR in 2 days
(6 Reviews)

Hi, I can help with that. Possible solution would be to convert that files into ms access and run small tool that will perform duplicate checking and remove duplicates and after would reconvert into excel. Regard More

€50 EUR in 0 days
(9 Reviews)

Hi, Hope you are doing well. I have reviewed the project description and able to start this task which require to check huge excel files of various formats and remove duplicates from file A that exists in file B More

€25 EUR in 1 day
(19 Reviews)