Job Description
IT Jobs. Eon Collective Jobs
We are looking for an enthusiastic Data Engineer to join our Data Management team. The successful candidate will be responsible for developing, constructing, testing and maintaining architectures, such as databases and large-scale processing systems. The Data Engineer will be recommending and implementing ways to improve data reliability, efficiency, and quality. They will support software developers, database architects, data analysts and data scientists on data initiatives and ensuring optimal data delivery architecture.
Key Responsibilities
- Responsible for the design of stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including data acquisition of new sources of data into central repositories such as Data lakes, Data warehouses & ERPs.
- Create and maintain optimal data pipeline architecture.
- Select & integrate Big Data tools and frameworks required to provide requested capabilities.
- Influence and drive data management guidelines and implement standards across the enterprise.
- Identify opportunities & prototype solutions creating reusable templates and frameworks to simplify and accelerate time to value on repetitive data management & engineering tasks.
- Explore and examine data to find insights and hidden patterns.
- Develops data set processes for complex data modeling, mining and production.
- Identify and introduce ways to improve data reliability, efficiency and quality.
- Assembles large, complex data sets that meet functional / non-functional business requirements.
- Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Collaborate with Infra team & Cloud architects to build the infrastructure required for optimal ETL or ELT from a wide variety of data sources.
- Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Performs root cause analysis on internal and external data and processes to answer specific business questions and identifies opportunities for improvement.
- Works with outside partners to ensure Eon Collective requirements are met.
Functional Skills:
- Strong project management and organizational skills.
- Ability to collect, organize, analyze, and disseminate significant amounts of information.
- Attention to detail and accuracy.
- Business acumen.
- Business process modeling Statistical modeling.
- Understanding future technologies.
Technical Skills:
- Experience with Enterprise grade ETL/ELT tools.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Advanced working SQL knowledge.
- Technical expertise with Data Models, data mining and segmentation techniques and query performance tuning.
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience in object-oriented or functional scripting languages such as Python (preferred), C++, or Scala etc
- Adept at queries, report writing and presenting findings.
- Experience with dbt or Snowflake will be considered an added advantage.
How to Apply
The post Data Engineer Job Eon Collective appeared first on Corporate Staffing Services.