A vaga não está disponível no seu país.
Data Engineer
Luxoftpiracicaba, estado de são paulo, brHá 18 dias
Descrição da vagaWe are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture. Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years). Experience in leading a distributed team. Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval. Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions. Extensive experience with building robust and scalable ETL / ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses. Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing. Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data / Delta Lakehouse, Data Vault) Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages. Experience integrating metadata and governance processes into cloud-based data platforms Certification in Azure, Databricks, or other relevant technologies is an added advantage Experience with cloud-based analytical databases. Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix. Experience with Python and Python-based ETL tools. Experience with shell scripting in Bash, Unix or windows shell is preferable. Experience with Elasticsearch Familiarity with containerization and orchestration technologies (Docker, Kubernetes). Troubleshooting and Performance Tuning : Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis. Collaboration and Communication : Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.
Project Description :
- The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.
- Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.
- Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.
Responsibilities :
Mandatory Skills Description :
Nice-to-Have Skills Description :
Languages :
English : B2 Upper Intermediate
Criar um alerta de emprego para esta pesquisa
Data Engineer • piracicaba, estado de são paulo, br
Vagas relacionadas
Buscamos respondentes em todo o Brasil.Por favor, registre seu interesse em .Sinta-se à vontade para passar o link de registro para seus amigos e familiares, pois ele está aberto a qualquer pe...Mostre maisÚltima atualização: há mais de 30 dias
Are you the type of person who loves to scroll Instagram.Do you LOVE Instagram, and already spend hours scrolling on a daily basis? .
Do you quickly dissect what made a post go viral and what p...Mostre maisÚltima atualização: há mais de 30 dias
Paid Online Market Research - Brazil
PowerData Group ConsultingÁguas de São Pedro, AC, brQuick Apply
- Promovida
Senior Engineer - Product - Indaiatuba -SP
John Deere India Pvt. Ltd.Indaiatuba, São Paulo, Brazil Trabalhamos para que a vida possa avançar e estamos sempre à procura de pessoas inovadoras que possam contribuir com a nossa missão.
Que tal fazer parte do nosso time?.Brasil (BR)- São Paulo- Indaia...Mostre maisÚltima atualização: 10 dias atrás
- Promovida
Engenheiro Sênior (Especialista Energia, Potencia & Serviços Industriais) - Araras
NestléAraras, São Paulo, Brazil Área / BU : Engenharia Corporativa – CCT Araras.Reporte : Gerencia de Energia e Serviços Industriais.Alguma pessoa interna mapeada? Não.
Entrar na Nestlé significa que você está se juntando à maior em...Mostre maisÚltima atualização: 1 dia atrás
- Promovida
Machine Learning Engineer
Bastian SolutionsPaulínia, São Paulo, Brazil The Machine Learning Engineer will work with Bastian Solutions’ R&D team to produce industry leading Autonomous Vehicle and Robotic solutions for the Material Handling Industry.With a current team ...Mostre maisÚltima atualização: 24 dias atrás
- Promovida
Mid-Level Machine Learning Engineer - Indaiatuba / SP
John DeereIndaiatuba, São Paulo, Brazil Mid-Level Machine Learning Engineer - Indaiatuba / SP.Be among the first 25 applicants.Mid-Level Machine Learning Engineer - Indaiatuba / SP.
Get AI-powered advice on this job and more exclusive feature...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Mid-Level Machine Learning Engineer - Indaiatuba / SP
John Deere India Pvt. Ltd.Indaiatuba, São Paulo, Brazil Trabalhamos para que a vida possa avançar e estamos sempre à procura de pessoas inovadoras que possam contribuir com a nossa missão.
Que tal fazer parte do nosso time?.Brasil (BR)- São Paulo- Indaia...Mostre maisÚltima atualização: há mais de 30 dias
Instagram Viral Content Copywriter
Impact ClientsÁguas de São Pedro, SP, BRRemota
Quick Apply
- Promovida
Senior Engineer - Product - Indaiatuba -SP
John DeereIndaiatuba, São Paulo, Brazil Senior Engineer - Product - Indaiatuba -SP.Trabalhamos para que a vida possa avançar e estamos sempre à procura de pessoas inovadoras que possam contribuir com a nossa missão.Que tal fazer parte do...Mostre maisÚltima atualização: 9 dias atrás