Data Engineer / Senior Data Engineer
Location : Costa Rica, Brazil or Mexico
Focus : Digital & Customer Experience Applications
Role Summary
We are seeking a Data Engineer / Senior Data Engineer to design, build, and operate scalable data pipelines and curated datasets. This role is pivotal in enabling Digital and Customer Experience applications across our global enterprise. You will work hands-on with Python, PySpark, and Databricks, championing modern engineering practices through Git-based workflows, CI / CD, and Azure DevOps to ensure high-quality data delivery.
Key Responsibilities
Pipeline Development : Design and optimize ETL / ELT pipelines using Databricks and PySpark to transform and serve data for digital customer journeys.
Data Modeling : Build performant SQL transformations and curated dimensional data layers for downstream analytics and application consumption.
Engineering Excellence : Implement best practices for Databricks (notebooks vs. repos), modular code, cluster configuration, and cost-aware performance tuning.
Automation & Scripting : Utilize Python for data validation, orchestration helpers, and the creation of reusable libraries.
DevOps & CI / CD : * Manage source control via Git (GitHub / Bitbucket), enforcing strict PR reviews and branching strategies.
Build and maintain Azure DevOps pipelines to automate testing, packaging, and deployment across environments.
Quality & Reliability : Ensure data integrity through automated reconciliation checks, monitoring, and detailed operational runbooks.
Collaboration : Partner with product teams, analysts, and platform engineers to translate complex requirements into scalable data products.
Leadership (Senior Level) : Lead module-level design, mentor junior engineers, and take ownership of critical pipeline delivery and enterprise code standards.
Technical Skills
Primary (Must-Have)
Advanced Data Engineering : Expert-level Python , PySpark , and SQL (advanced querying and optimization).
Databricks Ecosystem : Proficiency in Databricks jobs, workflows, clusters, and repos.
Version Control : Strong experience with Git (GitHub and / or Bitbucket) and enterprise branching workflows.
Azure DevOps : Hands-on experience with Boards, Repos, and Pipelines for build / release automation in data workloads.
Secondary (Good-to-Have)
Orchestration : Experience with Azure Data Factory (ADF) for ingestion and scheduling patterns.
Data Visualization : Understanding of Power BI datasets, measures, and refresh patterns to support analytics enablement.
Senior Data Engineer • Campina Grande do Sul, Paraná, Brazil
Job Title: Senior GCP Data Engineer (BigQuery, Python, Airflow).Location: Mexico/ Brazil / Costa Rica (Remote).At Smart IT Frame, we connect top talent with leading organizations across the USA.Wit...Mostre mais
Senior Software Engineer, Platform Reliability.We are looking for a Senior Software Engineer with 5+ years of experience in platform reliability, backend systems, and cloud infrastructure.This role...Mostre mais
We are looking for a Senior Developer Data Engineer to build and operate scalable data pipelines and curated datasets that enable Digital and Customer Experience Applications across a global FMCG e...Mostre mais
SQL development and basic performance tuning.Ability to develop and monitor.DAGs to ensure reliable task scheduling.S3, and the broader AWS ecosystem for serverless data processing.ETL logic or sim...Mostre mais
No Grupo SBF, reunimos duas grandes forças do esporte no Brasil: a Centauro, maior varejista esportiva multimarcas da América Latina, e a Fisia, distribuidora oficial da Nike no país.Queremos ser r...Mostre mais
Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical.We’re privately held, profitable, and have be...Mostre mais
FirstIgnite builds best-in-class software that accelerates commercialization and innovation by connecting scientific research with industry partners.We support universities, national labs, and rese...Mostre mais
We are seeking a full-time, remote Senior Data Engineer with 5+ years of experience to join our U.This key individual should have experience making decisions, working on a small development team, a...Mostre mais
As a SQL & Snowflake Engineer, you will play a key role in the full development lifecycle, translating complex data structures into actionable technical insights with a specific focus on Snowflake ...Mostre mais
We are a fast growing business and technology consultant company co-founded in 2019.We offer a custom-tailored, white-glove engineering service fit for our clients, because a digital transformation...Mostre mais
Somos uma fintech em crescimento acelerado que está protagonizando a.Transformamos processos tradicionalmente burocráticos, caros e ineficientes em experiências.Se você acredita que tecnologia pode...Mostre mais
Azure and Blazor, AI-First Environment).Our client is a leading pediatric healthcare organization with a long-standing history of providing comprehensive care for infants, children, and adolescents...Mostre mais
We're Hiring: Senior Data Engineer | Remote from Brazil | Fluent English required.Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work wit...Mostre mais
Python, PySpark, Azure Databricks, LLMs, MLflow |.KPIT is seeking a high-caliber.Senior Data Scientist / AI Engineer.AI and Machine Learning solutions.This is not just a research role; it is a hand...Mostre mais
Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas do Brasil.Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxili...Mostre mais
Senior Data Engineer (Oracle / ODI) – Data Warehouse & ETL Specialist.Senior Data Engineer with strong expertise in Oracle and ODI (Oracle Data Integrator).This role is ideal for professionals who ...Mostre mais
Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre mais
Profissional para construir e escalar pipelines em Databricks/Spark na AWS, suportando iniciativas de AI/ML e projetos de analytics/BI, em colaboração com times globais.Projetar, desenvolver e otim...Mostre mais
