Talent.com
A vaga não está disponível no seu país.
Data Engineer

Data Engineer

Luxoftvinhedo, estado de são paulo, br
Há 16 dias
Descrição da vaga

Project Description :

  • The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.
  • Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.
  • Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.

Responsibilities :

  • We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.
  • Mandatory Skills Description :

  • Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).
  • Experience in leading a distributed team.
  • Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.
  • Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.
  • Extensive experience with building robust and scalable ETL / ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.
  • Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.
  • Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data / Delta Lakehouse, Data Vault)
  • Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.
  • Experience integrating metadata and governance processes into cloud-based data platforms
  • Certification in Azure, Databricks, or other relevant technologies is an added advantage
  • Experience with cloud-based analytical databases.
  • Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.
  • Experience with Python and Python-based ETL tools.
  • Experience with shell scripting in Bash, Unix or windows shell is preferable.
  • Nice-to-Have Skills Description :

  • Experience with Elasticsearch
  • Familiarity with containerization and orchestration technologies (Docker, Kubernetes).
  • Troubleshooting and Performance Tuning : Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.
  • Collaboration and Communication : Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.
  • Languages :

    English : B2 Upper Intermediate

    Criar um alerta de emprego para esta pesquisa

    Data Engineer • vinhedo, estado de são paulo, br

    Vagas relacionadas
    • Promovida
    Azure Data Engineer

    Azure Data Engineer

    Aubay Portugalpaulínia, estado de são paulo, br
    Your connection with Aubay starts in the following lines : .Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized cons...Mostre maisÚltima atualização: 15 dias atrás
    • Promovida
    Senior Data Engineer

    Senior Data Engineer

    Invilliacajamar, estado de são paulo, br
    A Invillia não apenas transformou a forma como as empresas mais revolucionárias do mundo criam e desenvolvem estratégias, negócios e produtos digitais. Inovou também a maneira como pessoas apaixonad...Mostre maisÚltima atualização: 16 dias atrás
    • Promovida
    Senior Data Engineer

    Senior Data Engineer

    Pride Globalamericana, estado de são paulo, br
    We're Hiring : Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required.Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to ...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    Data Engineer

    Data Engineer

    Insight Globalsorocaba, estado de são paulo, br
    AWS Senior Cloud Data Engineering, management, maintenance, or architecting, implementing best practices and industry standards. Experience with data warehousing platforms such as Snowflake, Redshif...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    Unix & Cloud Data Support Engineer (ETL / AWS / Java Debugging / LATAM)

    Unix & Cloud Data Support Engineer (ETL / AWS / Java Debugging / LATAM)

    Amaris Consultingbragança paulista, estado de são paulo, br
    Amaris Consulting is an independent technology consulting firm with a global footprint, bringing together diverse talents from various backgrounds to deliver innovative solutions to clients worldwi...Mostre maisÚltima atualização: 5 dias atrás
    • Promovida
    AI Gateway Engineer

    AI Gateway Engineer

    AVM Consulting Incfranco da rocha, estado de são paulo, br
    The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI / ML models in a production environ...Mostre maisÚltima atualização: 6 dias atrás
    • Promovida
    Datadog Engineer - SRE

    Datadog Engineer - SRE

    International Digital Partnershortolândia, estado de são paulo, br
    Our client is seeking an experienced.This is an excellent opportunity to work on international projects, leading monitoring initiatives and driving best practices in observability.Lead end-to-end m...Mostre maisÚltima atualização: 4 dias atrás
    • Promovida
    Data Engineer

    Data Engineer

    Tata Consultancy Servicescampinas, estado de são paulo, br
    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    Remote Data Engineer

    Remote Data Engineer

    INDI Staffing Servicessalto, estado de são paulo, br
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    Data Engineer

    Data Engineer

    Fidelis Securityvárzea paulista, estado de são paulo, br
    We are seeking a skilled and experienced Data Engineer to join our Threat Research team.The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat in...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    Senior Data Engineer

    Senior Data Engineer

    Avenue Codelouveira, estado de são paulo, br
    AWS, ensuring performance, quality, and security.You will collaborate with data scientists and analysts to integrate data from multiple sources and support AI / ML initiatives.Ensure data governance,...Mostre maisÚltima atualização: 21 dias atrás
    • Promovida
    Data Engineer Senior | IA e MachineLearning

    Data Engineer Senior | IA e MachineLearning

    Grupo FCamaraamericana, estado de são paulo, br
    Esta oportunidade é em parceria com uma das maiores referências nacionais em ensino superior na área da saúde, com forte presença nos cursos de Medicina e Odontologia. A instituição está em constant...Mostre maisÚltima atualização: 14 dias atrás
    • Promovida
    Data Engineer

    Data Engineer

    Coda Search│Staffingsorocaba, estado de são paulo, br
    Their mission is to ensure food safety, quality, and sustainability across international supply chains.This role is critical to building, maintaining, and modernizing data pipelines that process la...Mostre maisÚltima atualização: 24 dias atrás
    • Promovida
    Data Engineer

    Data Engineer

    Elios Talentvárzea paulista, estado de são paulo, br
    Data Engineer – Microsoft Azure (Contractor).Remote (Brazil, supporting EST / CST hours) | ⏳ 4–5 Month Contract | 🌐 Collaboration via Teams. We are seeking a Data Engineer (short-term contractor) to ...Mostre maisÚltima atualização: 17 dias atrás
    • Promovida
    Generative AI Engineer

    Generative AI Engineer

    AnswerThisfranco da rocha, estado de são paulo, br
    Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Mostre maisÚltima atualização: 13 dias atrás
    • Promovida
    Data Engineer

    Data Engineer

    Luxoftitupeva, estado de são paulo, br
    The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Sol...Mostre maisÚltima atualização: 16 dias atrás
    • Promovida
    Lead Data Engineer - Oracle performance

    Lead Data Engineer - Oracle performance

    Metasantana de parnaíba, estado de são paulo, br
    We are seeking an experienced Lead Data Engineer to design, develop, and lead the delivery of enterprise-grade data integration and analytics solutions. The ideal candidate will have deep expertise ...Mostre maisÚltima atualização: 1 dia atrás
    • Promovida
    Market Data Infrastructure Engineer (LATAM)

    Market Data Infrastructure Engineer (LATAM)

    Amaris Consultingsantana de parnaíba, estado de são paulo, br
    Eligible locations in LATAM : Brazil, Chile, Colombia, Mexico.Amaris Consulting is an independent technology consulting firm with a global footprint, bringing together diverse talents from various b...Mostre maisÚltima atualização: 5 dias atrás
    • Promovida
    Data Engineer (Relocation to Portugal)

    Data Engineer (Relocation to Portugal)

    Affinitysalto, estado de são paulo, br
    A Job? Or a Lifetime Experience? Start Yours Here!.Our mission is to be a meaningful part of our people's careers.As we grow, so does our determination to offer the best experience to our employees...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    Data / AI Consultant (Sales Engineer)

    Data / AI Consultant (Sales Engineer)

    able.digitaljaguariúna, estado de são paulo, br
    In this role, you’ll act as the.This position is primarily remote, but will require.Work closely with product and sales teams to ensure smooth technical handoffs. Data / AI, personalization, or Custom...Mostre maisÚltima atualização: 4 dias atrás