Talent.com
Data Lead Engineer - Snowflake
Data Lead Engineer - SnowflakeAmpstek • Curitiba, Paraná, Brazil
Data Lead Engineer - Snowflake

Data Lead Engineer - Snowflake

Ampstek • Curitiba, Paraná, Brazil
Há 2 dias
Descrição da vaga

Data Lead Engineer – Snowflake Remote

Contract

Brazil / Mexico

Responsibilities

  • Technical Leadership : Provide technical direction and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and data operations.
  • End-to-End Ownership : Architect, implement, and optimize end-to-end data pipelines that process and transform large-scale datasets efficiently and reliably.
  • Orchestration and Automation : Design scalable workflows using orchestration tools such as Apache Airflow, ensuring high availability and fault tolerance.
  • Data Warehouse and Lake Optimization : Lead the implementation and optimization of Snowflake and data lake technologies like Apache Iceberg for storage, query performance, and scalability.
  • Real-Time and Batch Processing : Build robust systems leveraging Kafka, SQS, or similar messaging technologies for real-time and batch data processing.
  • Cross-Functional Collaboration : Work closely with Data Science, Product, and Engineering teams to define data requirements and deliver actionable insights.
  • Data Governance and Security : Establish and enforce data governance frameworks, ensuring compliance with regulatory standards and maintaining data integrity.
  • Scalability and Performance : Develop strategies to optimize performance for systems processing terabytes of data daily while ensuring scalability.
  • Team Building : Foster a collaborative team environment, driving skill development, career growth, and continuous learning within the team.
  • Innovation and Continuous Improvement : Stay ahead of industry trends to evaluate and incorporate new tools, technologies, and methodologies into the organization.

Qualifications

Required Skills :

  • 8+ years of experience in data engineering with a proven track record of leading data projects or teams.
  • Strong programming skills in Python, with expertise in building and optimizing ETL pipelines.
  • Extensive experience with Snowflake or equivalent data warehouses for designing schemas, optimizing queries, and managing large datasets.
  • Expertise in orchestration tools like Apache Airflow, with experience in building and managing complex workflows.
  • Deep understanding of messaging queues such as Kafka, AWS SQS, or similar technologies for real-time data ingestion and processing.
  • Demonstrated ability to architect and implement scalable data solutions handling terabytes of data.
  • Hands-on experience with Apache Iceberg for managing and optimizing data lakes.
  • Proficiency in containerization and orchestration tools like Docker and Kubernetes for deploying and managing distributed systems.
  • Strong understanding of CI / CD pipelines, including version control, deployment strategies, and automated testing.
  • Proven experience working in an Agile development environment and managing cross-functional team interactions.
  • Strong background in data modeling, data governance, and ensuring compliance with data security standards.
  • Experience working with cloud platforms like AWS, Azure, or GCP.
  • Preferred Skills :

  • Proficiency in stream processing frameworks such as Apache Flink for real-time analytics.
  • Familiarity with programming languages like Scala or Java for additional engineering tasks.
  • Exposure to integrating data pipelines with machine learning workflows.
  • Strong analytical skills to evaluate new technologies and tools for scalability and performance.
  • Leadership Skills :

  • Proven ability to lead and mentor data engineering teams, promoting collaboration and a culture of excellence.
  • Exceptional communication and interpersonal skills to articulate complex technical concepts to stakeholders.
  • Strategic thinking to align data engineering efforts with business goals and objectives.
  • About Ampstek

    Ampstek is a global IT solutions partner serving clients across North America, Europe, APAC, LATAM, and MEA. We specialize in delivering talent and technology solutions for enterprise-level digital transformation, trading systems, data services, and regulatory compliance.

    Contact : Snehil Mishra

    snehil@ampstek.com

    Desk : 609-360-2673 Ext. 125

    LinkedIn

    Criar um alerta de emprego para esta pesquisa

    Data Engineer • Curitiba, Paraná, Brazil

    Vagas relacionadas
    Lead Data Engineer

    Lead Data Engineer

    Elios Talent • Curitiba, Paraná, Brasil
    Lead Data EngineerKey Highlights Lead the end-to-end design and build of a brand-new, greenfield analytics ecosystem Architect data pipelines, orchestration, warehousing, and BI layers from the gro...Mostre mais
    Última atualização: 18 horas atrás • Promovida • Nova!
    Data Engineer - Fluent English

    Data Engineer - Fluent English

    Artefact • Curitiba, BR
    The current vacancy is for the Brazilian office and we work in a Free Office model.At Artefact LatAm, we believe in and live a culture based on empathy!. A healthy work environment is a place where ...Mostre mais
    Última atualização: 16 dias atrás • Promovida
    Data Engineer

    Data Engineer

    Dexian • Curitiba, BR
    A Dexian, lançada em 2023, tem presença global e traz consigo quase 30 anos de experiência através de suas companhias legadas, principalmente da combinação da DISYS e Signature Consultants.Iniciamo...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Data Engineer (Lead) ID41785

    Data Engineer (Lead) ID41785

    AgileEngine • Curitiba, SP, br
    Quick Apply
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Mostre mais
    Última atualização: há mais de 30 dias
    Data Engineer ID43407

    Data Engineer ID43407

    AgileEngine • Curitiba, PR, br
    Quick Apply
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Mostre mais
    Última atualização: há mais de 30 dias
    Senior Data Engineer

    Senior Data Engineer

    Encora Inc. • Curitiba, BR
    We are looking for a Senior Data Engineer with deep expertise in building, optimizing, and managing data pipelines and modern cloud-based data platforms. This role involves designing scalable, secur...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Data Lead Engineer – Snowflake

    Data Lead Engineer – Snowflake

    Ampstek • Curitiba, BR
    Data Lead Engineer – Snowflake.Technical Leadership : Provide technical direction and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and data operations.End...Mostre mais
    Última atualização: 3 dias atrás • Promovida
    Databricks Data Engineer

    Databricks Data Engineer

    GlobalSource IT • Curitiba, BR
    We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from mult...Mostre mais
    Última atualização: 2 dias atrás • Promovida
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Curitiba, BR
    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Senior Data Engineer

    Senior Data Engineer

    Eightpoint • Curitiba, BR
    Eightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for pa...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Sr Python Data Engineer

    Sr Python Data Engineer

    Softensity Inc • Araucária, Paraná, Brazil
    Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose...Mostre mais
    Última atualização: 6 dias atrás • Promovida
    Senior Data Engineer

    Senior Data Engineer

    Pride Global • Curitiba, BR
    We're Hiring : Senior Data Engineer | Remote from Brazil | Fluent English required.Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work wit...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Python / Data Engineer

    Python / Data Engineer

    Luxoft • Curitiba, BR
    Join a team focused on backend and data engineering for headend applications at a leading video content provider.This role emphasizes Python-based services, AWS data workflows, and integration with...Mostre mais
    Última atualização: 5 dias atrás • Promovida
    Databricks Data Engineer

    Databricks Data Engineer

    Globalsource It • Campina Grande do Sul, Paraná, Brasil
    Databricks Data EngineerFully Remote Contract We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake...Mostre mais
    Última atualização: 18 horas atrás • Promovida • Nova!
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy Services • Curitiba, BR
    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • Curitiba, BR
    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Data Enginner w / Databricks (Relocation to Portugal)

    Data Enginner w / Databricks (Relocation to Portugal)

    Aubay Portugal • Curitiba, BR
    Aubay Portugal is a multinational French company, in Portugal since 2007.We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Main...Mostre mais
    Última atualização: 5 dias atrás • Promovida
    Data Lead Engineer - Snowflake

    Data Lead Engineer - Snowflake

    Ampstek • São José dos Pinhais, Paraná, Brazil
    Data Lead Engineer – Snowflake Remote Contract Brazil / Mexico Responsibilities • Technical Leadership : Provide technical direction and mentorship to a team of data engineers, ensuring best pract...Mostre mais
    Última atualização: 2 dias atrás • Promovida