Data Engineer Jobs
A Data Engineer is highly skilled in analytics, data management, and developing data architecture, making them the perfect addition to any organization in need of real-time insights. Data Engineers create the pipelines and data architecture necessary for Business Intelligence teams to access archives of data from which to analyze trends, providing them visibility into the current state of their business. In short, Data Engineers make it possible for companies to make informed decisions based on data quickly and accurately.
Here's some projects that our expert Data Engineers made real:
- Developed ETL pipelines from sources such as APIs, web services and databases, ensuring efficient data extraction while converting source data into desired formats.
- Designed custom databases and data models e.g. NoSQL and Big Data technologies such as Hadoop and Hive to store large datasets.
- Optimized data analysis processes using Python libraries such as pandas, numpy and scikit-learn to generate pattern recognition algorithms.
- Implemented advanced analytics techniques such as clustering analysis and forecasting models at scale.
- Automated data pipeline processes using source control platforms such as GIT, allowing teams to access and modify pipelines without breaking production code.
Data Engineering is an essential practice for any organization looking to analyze their historical business performance and make informed decisions on real-time data. The projects here are a testament to the power of Data Engineering; our experts have proved that with the right skillset businesses can cut through their complex datasets with ease – letting them focus on how best to use their crisp new insights. If you’re looking for an experienced and reliable comparison of your data then we invite you post your project now and hire a Data Engineer on Freelancer.com today!
From 2,939 reviews, clients rate our Data Engineers 4.95 out of 5 stars.Hire Data Engineers
Looking for a lead developer with snowflake expertise. Requirements 1. Design, develop and deliver end to end solution for snowflake integration 2. Design considerations while processing large amount of data in snowlfake 3. Need expertise in Snowflake listings, native apps and clean room 4. Knowledge about CDP, DSP, audiance segmentation, 1st party data is a big plus. 5. Readiness to work in team and good communication is a must.
Confirmis () is a Singapore-based business information provider specializing in connecting businesses with global capabilities; comprised of industry veterans, Confirmis business model is designed to overcome perennial lack of data (let alone quality data) to support effective decision making, particularly in developing economies. As a Site Verifier, you will be responsible for verifying a company’s existence through visual data by conducting a site visit to ensure that we provide reliable and accurate information to our client. JOB DESCRIPTION: • Conduct basic verification with the subject company’s authorized representative, such as line of business, key executives' name, etc. • Take pictures of the subject company and its vicinity, as per Confirmis&rsq...
Data Engineer Job Description + Bachelors in Computer Science or Equivalent with 8 years of experience in Data Engineering and data warehousing or Master with 5 years worth of experience in Data Engineering and DataWarehousing. + Informatica cloud (IICS) – Expert level working knowledge in Integration Service and DI . + 7+ Years of experience in IICS / Informatica + Expert level working Knowledge of RDBMS (Oracle & Postgresql ) and Snowflake Data Cloud. + At least 7+ years of working experience in RDBMS and snowflake will be a plus. + Experience in API based integration, Real time integration. + Familiarity with AWS is needed. + Interfacing with other systems such as Salesforce using IICS is a must. + Knowledge of other informatica products is always a plus + Good communication ...
I am looking for a GCP data engineer to provide online training and support for a small set of batch within a 1-month timeframe. The training and support will be provided using Google Cloud Platform. GCP BIG QUERY, GCP CLOUD PUB SUB, GCP SPANNER, GCP DATA PROC, GCP CLOUD COMPOSER This project requires the data engineer to have an in-depth understanding of GCP and the ability to develop, deploy, sustain, and manage cloud-based data services according to best practices. The data engineer must also be highly knowledgeable of the existing infrastructure and understand the relationship and dependency between cloud service data engineer should also be experienced in delivering clear and concise training to those who require it, as well as providing maintenance and support when needed. To ens...
We need a freelance Azure data engineer to develop a data pipeline for a large hotel chain. The project would start with a proof-of-concept where the freelancer will develop the first few steps of the pipeline. If we evaluate that the collaboration worked well, we would then continue the partnership to develop the rest of the pipeline. The full project scope is visualised in the picture attached The first steps to be developed in this first iteration are: - With a user and environment provided by us, deploy Azure Data Factory and Azure Blob Storage resources, requesting any necessary permissions for your user so we can provide them - Using Azure Data Factory, deploy a process that runs on a daily basis to extract CSV files from an SFTP and load them into Azure Blob Storage as parquet fi...
Extract the map of Dhaka Cantonment and highlight the government facilities like schools, hospitals and alike. I also want the empty/vacant lot and river to be highlighted or any vacant area where we could possibly install solar panel. I have attached a sample image for your reference
We seek an experienced engineer to enhance the design and build a device that can obtain fingertip photoplethysmography data at a wide range of wavelengths. We have designed and constructed preliminary prototypes based on published information using commercially available parts. An independent contractor who performs this work should have experience in circuit design, microprocessor control of light emitting diodes, laser diodes, and photodiodes, and troubleshooting acumen regarding signal transmission and reception and optimizing signal-to-noise ratio in the device.
Job Title: Cohesity Storage Administrator (Person from United Kingdom will be preffered) Duration 3-6 months – Possibly longer(Onsite job) Contract type full time freelance Job Summary: We are seeking a highly skilled and experienced Cohesity Storage Administrator with expertise in managing storage systems and domains, as well as experience with Office 365 and a broad range of IT technologies. The successful candidate will be responsible for managing and maintaining our Cohesity storage environment, ensuring it is highly available, reliable, and performing optimally. This role requires someone with strong communication skills and the ability to work effectively with both technical and non-technical stakeholders. Key Responsibilities: • Manage and maintain o...