Talent.com
A vaga não está disponível no seu país.
Data Engineer

Data Engineer

Luxoftsão leopoldo, Brasil
Há 10 dias
Descrição da vaga

Project Description :

  • The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.
  • Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.
  • Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.

Responsibilities :

  • We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.
  • Mandatory Skills Description :

  • Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).
  • Experience in leading a distributed team.
  • Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.
  • Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.
  • Extensive experience with building robust and scalable ETL / ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.
  • Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.
  • Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data / Delta Lakehouse, Data Vault)
  • Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.
  • Experience integrating metadata and governance processes into cloud-based data platforms
  • Certification in Azure, Databricks, or other relevant technologies is an added advantage
  • Experience with cloud-based analytical databases.
  • Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.
  • Experience with Python and Python-based ETL tools.
  • Experience with shell scripting in Bash, Unix or windows shell is preferable.
  • Nice-to-Have Skills Description :

  • Experience with Elasticsearch
  • Familiarity with containerization and orchestration technologies (Docker, Kubernetes).
  • Troubleshooting and Performance Tuning : Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.
  • Collaboration and Communication : Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.
  • Languages :

    English : B2 Upper Intermediate

    Criar um alerta de emprego para esta pesquisa

    Data Engineer • são leopoldo, Brasil

    Vagas relacionadas
    • Promovida
    Senior Data Engineer

    Senior Data Engineer

    Jusfycaxias do sul, estado do rio grande do sul, br
    Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas do Brasil.Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxili...Mostre maisÚltima atualização: 12 dias atrás
    • Promovida
    Senior Enterprise AI Engineer

    Senior Enterprise AI Engineer

    beBeeDataPorto Alegre, Brasil
    As a seasoned Data Scientist, you will be responsible for developing and deploying advanced AI / ML models that drive business growth and innovation. Your expertise in building scalable data workflows...Mostre maisÚltima atualização: 5 dias atrás
    • Promovida
    Software Engineer

    Software Engineer

    Elios Talentestância velha, Brasil
    Work on scalable and innovative applications.Remote flexibility with global teams.Career growth in fast-paced technology environments. We are looking for a Software Engineer to join our development ...Mostre maisÚltima atualização: 8 dias atrás
    • Promovida
    Data Analyst

    Data Analyst

    GeorgiaTEK Systems Inc.Porto Alegre, BR
    We are looking for a Data Analyst with solid experience in statistics and data quality.This professional will be responsible for validating, certifying, and critically analyzing data—from raw sourc...Mostre maisÚltima atualização: 8 dias atrás
    • Promovida
    Machine Learning Engineer Specialist

    Machine Learning Engineer Specialist

    Sankhya Gestão de Negóciosmontenegro, Brasil
    Machine Learning Engineer Specialist.Desenvolver software AI-driven integrando com parceiros como por exemplo Open AI, AWS, GCP, Azure etc ou produtos internos. Alimentar modelos com dados definidos...Mostre maisÚltima atualização: 5 dias atrás
    • Promovida
    Senior Backend Engineer (Conversational AI)

    Senior Backend Engineer (Conversational AI)

    Yuna.ioivoti, Brasil
    Yuna's mission is to radically transform the way mental health support is accessed and delivered.By providing 24 / 7 instant and private support at the push of a button, we aim to address the signifi...Mostre maisÚltima atualização: 8 dias atrás
    • Promovida
    Data Scientist

    Data Scientist

    Insight Globalestância velha, Brasil
    Bachelor’s or Master’s degree in Data Science, Computer Science, Statistics, or a related field.ML models in enterprise environments. Strong coding skills and experience with scalable data workflows...Mostre maisÚltima atualização: 8 dias atrás
    BI / Data Engineer (Lead) ID41786

    BI / Data Engineer (Lead) ID41786

    AgileEnginePorto Alegre, RS, br
    Quick Apply
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Mostre maisÚltima atualização: 9 dias atrás
    • Promovida
    Market Data Infrastructure Engineer (Latam)

    Market Data Infrastructure Engineer (Latam)

    Amaris ConsultingSapucaia do Sul, Rio Grande do Sul, Brasil
    IMPORTANT : Eligible locations in LATAM : Brazil, Chile, Colombia, Mexico.Company DescriptionAmaris Consulting is an independent technology consulting firm with a global footprint, bringing together ...Mostre maisÚltima atualização: 2 dias atrás
    • Promovida
    Staff ML Engineer (Conversational AI)

    Staff ML Engineer (Conversational AI)

    Yuna.ioPorto Alegre, BR
    Yuna's mission is to radically transform the way mental health support is accessed and delivered.By providing 24 / 7 instant and private support at the push of a button, we aim to address the signifi...Mostre maisÚltima atualização: 8 dias atrás
    • Promovida
    Data Engineer

    Data Engineer

    LuxoftDois Irmãos, Rio Grande do Sul, Brasil
    Project Description : The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel cus...Mostre maisÚltima atualização: 29 dias atrás
    • Promovida
    Principal AI Engineer - AI in Healthcare

    Principal AI Engineer - AI in Healthcare

    Stealth Healthcare AI StartupPorto Alegre, BR
    We are a stealth-stage healthcare AI startup that is the missing link in healthcare revenue management, bridging the gap between clinical care and financial operations. We're transforming how primar...Mostre maisÚltima atualização: 8 dias atrás
    • Promovida
    Engenheiro de Dados Sênior "980883"

    Engenheiro de Dados Sênior "980883"

    Dexian Brasilgramado, Brasil
    A Dexian, lançada em 2023, tem presença global e traz consigo quase 30 anos de experiência através de suas companhias legadas, principalmente da combinação da DISYS e Signature Consultants.Iniciamo...Mostre maisÚltima atualização: 7 dias atrás
    • Promovida
    Senior Data Engineer

    Senior Data Engineer

    Eightpointcanoas, Brasil
    Eightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for pa...Mostre maisÚltima atualização: 7 dias atrás
    • Promovida
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesSapucaia do Sul, Rio Grande do Sul, Brasil
    Come to one of the biggest IT Services companies in the world!!.Here you can transform your career!.Here at TCS we believe that people make the difference, that's why we live a culture of unlimited...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    Platform Engineer

    Platform Engineer

    Everest SystemsPorto Alegre, Rio Grande do Sul, Brazil
    Role : Platform Software Engineer.At Everest, our Platform team builds the core framework that enables fast and consistent business application development. As part of this team, you’ll help shape th...Mostre maisÚltima atualização: 8 dias atrás
    • Promovida
    Engenheiro de dados

    Engenheiro de dados

    Softtekestância velha, Brasil
    Vaga : Engenheiro(a) de Dados Sênior.Buscamos um(a) Engenheiro(a) de Dados Sênior com sólida experiência em ETLs (Extract, Transform, Load), modelagem de dados relacional e Databricks.O(a) candidato...Mostre maisÚltima atualização: 7 dias atrás
    Data Engineer (Lead) ID41785

    Data Engineer (Lead) ID41785

    AgileEnginePorto Alegre, RS, br
    Quick Apply
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Mostre maisÚltima atualização: 9 dias atrás
    • Promovida
    Full Stack Engineer

    Full Stack Engineer

    Insight Globalgramado, Brasil
    This is a fully remote position, CLT model and salary range is 17-23k real / mo.Back End and 4 years Front End Front end is React. They have to have experience working in Back End and WANT to work in ...Mostre maisÚltima atualização: 8 dias atrás
    • Promovida
    Engenheiro de Dados Senior

    Engenheiro de Dados Senior

    FOURSYSmontenegro, Brasil
    A Foursys é um time apaixonado por inovação, design e transformação digital.Na Foursys, celebramos a diversidade e acreditamos que são as diferentes ideias e perspectivas que nos enriquecem.Portant...Mostre maisÚltima atualização: 7 dias atrás