Senior Data Engineer

Overview

The Data Engineer will be responsible for development of data software applications, data platforms and data products.

This Engineer will closely work with application engineers, data engineers, data scientists and CRM to design, document, develop, test and implement solutions.

This engineer will work with other engineers, and individually contribute to the development including defining engineering standards, data analysis, data modeling, coding, testing / QA, code review, deployment, operational readiness, and agile management.

Responsibilities

Be a key contributor to deliver on-time, on budget, high value complex projects

Take technical responsibility for all stages and / or iterations in a software component

Specify and ensure the design and development of technology solutions properly fulfills all business requirements

Ensure project stakeholders receive regular communications about status of the work

Anticipate change management requirements and ensure effective solution adoption by ensuring appropriate knowledge transfer, training and deployment readiness

Document design approaches, code artifacts, communicate to and participate in knowledge sharing

Highly organized and adaptable to dynamic work schedule with effective time management and prioritization skills

Provide technical guidance to associates, colleagues and / or customers

Communicate difficult concepts and negotiate with others to adopt a different point of view

Interpret internal / external business challenges and recommend best-practices to improve products, processes, or services

Ability to work in multi-project environment and support multiple internal departments

Knowledge of industry best practice approach and standards

Ability to multi-task and effectively delegate tasks to teams

Qualifications

Computer Science Degree or equivalent

6 to 8 years of working experience in a commercial software development environment

5+ years of experience as an engineer in data platform centric environments

Hands-on experience in Data Engineering

Extensive knowledge of data platform paradigms and software architecture

Experience with cloud development on the Amazon Web Services (AWS) platform with services including API Gateway, Lambda, EC2, ECS, SQS, SNS, Dynamo DB, Redshift and Aurora

Expert-level Pyspark, Python & SQL skills

Ability to comprehend and implement detailed project specifications as well as the ability to adapt to various technologies and simultaneously work on multiple projects

Strong problem-solving skills of different complexities required

Excellent proactive communications and planning skills

About Experian

Experian is a global data and technology company, powering opportunities for people and businesses around the world.

We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software.

We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data.

As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries.

Our corporate headquarters are in Dublin, Ireland.

Learn more at experianplc.com.

Experience and Skills

Computer Science Degree or equivalent

6 to 8 years of working experience in a commercial software development environment

5+ years of experience as an engineer in data platform centric environments

Hands-on experience in Data Engineering

Expert-level Pyspark, Python & SQL skills

Strong problem-solving skills of different complexities required and Excellent proactive communications and planning skills

#J-18808-Ljbffr