Talend Expert
we collect more than 20.000 file / day from more than 150 differents sourcse (Oracle DB, MySQL DB, CSV, MSSQL ...)
we transform the data and map it will the destination tables in our DATA WareHouse.
We also perform some control :
- Number of rows reed
- Number of rows inserted into the destination table
- Number of rows rejected are stored into a csv file for future analysis
- all the logs : Start Time, End Time, Number of rows read, Number of rows rejected, .... are stored somewhere and analyse.
Tools : Talend Open Studio (Free Version)