A vaga não está disponível no seu país.

Data Engineer

Luxoftcajamar, estado de são paulo, br

Há 18 dias

Descrição da vaga

Project Description :

The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.
Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.
Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.

Responsibilities :

We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.

Mandatory Skills Description :

Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).

Experience in leading a distributed team.

Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.

Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.

Extensive experience with building robust and scalable ETL / ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.

Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.

Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data / Delta Lakehouse, Data Vault)

Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.

Experience integrating metadata and governance processes into cloud-based data platforms

Certification in Azure, Databricks, or other relevant technologies is an added advantage

Experience with cloud-based analytical databases.

Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.

Experience with Python and Python-based ETL tools.

Experience with shell scripting in Bash, Unix or windows shell is preferable.

Nice-to-Have Skills Description :

Experience with Elasticsearch

Familiarity with containerization and orchestration technologies (Docker, Kubernetes).

Troubleshooting and Performance Tuning : Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.

Collaboration and Communication : Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.

Languages :

English : B2 Upper Intermediate

Criar um alerta de emprego para esta pesquisa

Data Engineer • cajamar, estado de são paulo, br

Vagas relacionadas

Data Engineer (Senior) ID40199

AgileEngineSão Bernardo do Campo, SP, br

Quick Apply

Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Mostre maisÚltima atualização: 25 dias atrás

C# Engineer (Senior / Lead) ID41548

AgileEngineSorocaba, SP, br

Quick Apply

Data Engineer

Blue Orange DigitalSão Paulo, State of São Paulo, .BR

Quick Apply

Blue Orange Digital is a data and AI consulting firm that helps companies turn complex data into real business outcomes.We partner with organizations across industries to design and deploy scalable...Mostre maisÚltima atualização: há mais de 30 dias

Promovida

Senior Engineer - Product - Indaiatuba -SP

John Deere India Pvt. Ltd.Indaiatuba, São Paulo, Brazil

Trabalhamos para que a vida possa avançar e estamos sempre à procura de pessoas inovadoras que possam contribuir com a nossa missão. Que tal fazer parte do nosso time?.Brasil (BR)- São Paulo- Indaia...Mostre maisÚltima atualização: 10 dias atrás

Python / SDET Engineer (Senior) ID41556

AgileEngineSorocaba, SP, br

Quick Apply

Promovida

Mid-Level Machine Learning Engineer - Indaiatuba / SP

John DeereIndaiatuba, São Paulo, Brazil

Mid-Level Machine Learning Engineer - Indaiatuba / SP.Be among the first 25 applicants.Mid-Level Machine Learning Engineer - Indaiatuba / SP. Get AI-powered advice on this job and more exclusive feature...Mostre maisÚltima atualização: há mais de 30 dias

Promovida
Nova!

Data Engineer, Brazil - X Delivery

WHATJOBS?São Paulo, Federative Republic Of Brazil, Brasil

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy whe...Mostre maisÚltima atualização: 1 hora atrás

BI / Data Engineer (Senior / Lead) ID41786

AgileEngineSorocaba, SP, br

Quick Apply

Promovida

Mid-Level Machine Learning Engineer - Indaiatuba / SP

John Deere India Pvt. Ltd.Indaiatuba, São Paulo, Brazil

Python Engineer (Middle) ID39656

AgileEngineSorocaba, SP, br

Quick Apply

Full Stack Engineer ID40916 ($2,500 signing bonus)

AgileEngineSorocaba, SP, br

Quick Apply

AI Engineer - US SaaS startup | Remote

Atomic HRGuarulhos, State of São Paulo, .BR

Quick Apply

We connect talented tech professionals in Latin America and Canada with remote career opportunities at innovative startups worldwide. We specialize in finding roles that align with your skills, expe...Mostre maisÚltima atualização: há mais de 30 dias

Promovida
Nova!

Data Engineer, Brazil - X Delivery

Boston Consulting GroupSão Paulo, SP, São Paulo (microrregião); São Paulo (estado), BR

Locations : São Paulo | Rio de Janeiro.Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities.B...Mostre maisÚltima atualização: 11 horas atrás

Full Stack Engineer (Senior / Lead) ID41207

AgileEngineSorocaba, SP, br

Quick Apply

Full Stack Engineer ID38918 ($2,500 signing bonus)

AgileEngineSorocaba, SP, br

Quick Apply

Data Engineer (Senior / Lead) ID41785

AgileEngineSão Paulo, SP, br

Quick Apply

AI Engineer ID34949 ($3,000 signing bonus)

AgileEngineCampinas, SP, br

Quick Apply

Join us and receive a $3,000 signing bonus!.Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our peo...Mostre maisÚltima atualização: há mais de 30 dias

AI Engineer (Senior / Lead) ID40978

AgileEngineCampinas, SP, br

Quick Apply

Backend Engineer ID37418 ($3,000 signing bonus)

AgileEngineCampinas, SP, br

Quick Apply

Promovida

Senior Engineer - Product - Indaiatuba -SP

John DeereIndaiatuba, São Paulo, Brazil

Senior Engineer - Product - Indaiatuba -SP.Trabalhamos para que a vida possa avançar e estamos sempre à procura de pessoas inovadoras que possam contribuir com a nossa missão.Que tal fazer parte do...Mostre maisÚltima atualização: 9 dias atrás