1. JOB PURPOSE

• Data engineers are mainly tasked with transforming data into a format that can be easily analyzed. They do this by developing, maintaining, and testing infrastructures for data generation. Data engineers work closely with data analysts and are largely in charge of technical solutions to enable more efficient and timeline data analysis.
• Data engineers are often responsible for building approaches, pipelines and algorithms to help give easier access to raw data, but to do this, they need to understand the company’s or client’s objectives.
• Data engineers also need to understand how to optimize data retrieval and how to develop dashboards, reports and other visualizations for stakeholders.
• Mentor and coach junior/fresher into fully competent Data engineers.

2. JOB DESCRIPTION

• Develop, construct, test and maintain architectures.
• Align architecture with business requirements.
• Data collection: Collecting, measuring and analyzing.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Conduct research for industry and business questions.
• Deploy sophisticated analytics programs, machine learning and statistical methods
• Prepare data for predictive and prescriptive modeling.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.