Data Engineer / Senior Data Engineer
Location : Costa Rica, Brazil or Mexico
Focus : Digital & Customer Experience Applications
Role Summary
We are seeking a Data Engineer / Senior Data Engineer to design, build, and operate scalable data pipelines and curated datasets. This role is pivotal in enabling Digital and Customer Experience applications across our global enterprise. You will work hands-on with Python, PySpark, and Databricks, championing modern engineering practices through Git-based workflows, CI / CD, and Azure DevOps to ensure high-quality data delivery.
Key Responsibilities
Pipeline Development : Design and optimize ETL / ELT pipelines using Databricks and PySpark to transform and serve data for digital customer journeys.
Data Modeling : Build performant SQL transformations and curated dimensional data layers for downstream analytics and application consumption.
Engineering Excellence : Implement best practices for Databricks (notebooks vs. repos), modular code, cluster configuration, and cost-aware performance tuning.
Automation & Scripting : Utilize Python for data validation, orchestration helpers, and the creation of reusable libraries.
DevOps & CI / CD : * Manage source control via Git (GitHub / Bitbucket), enforcing strict PR reviews and branching strategies.
Build and maintain Azure DevOps pipelines to automate testing, packaging, and deployment across environments.
Quality & Reliability : Ensure data integrity through automated reconciliation checks, monitoring, and detailed operational runbooks.
Collaboration : Partner with product teams, analysts, and platform engineers to translate complex requirements into scalable data products.
Leadership (Senior Level) : Lead module-level design, mentor junior engineers, and take ownership of critical pipeline delivery and enterprise code standards.
Technical Skills
Primary (Must-Have)
Advanced Data Engineering : Expert-level Python , PySpark , and SQL (advanced querying and optimization).
Databricks Ecosystem : Proficiency in Databricks jobs, workflows, clusters, and repos.
Version Control : Strong experience with Git (GitHub and / or Bitbucket) and enterprise branching workflows.
Azure DevOps : Hands-on experience with Boards, Repos, and Pipelines for build / release automation in data workloads.
Secondary (Good-to-Have)
Orchestration : Experience with Azure Data Factory (ADF) for ingestion and scheduling patterns.
Data Visualization : Understanding of Power BI datasets, measures, and refresh patterns to support analytics enablement.
Senior Data Engineer • João Pessoa, Paraíba, Brazil
We have an open position for a Senior Data Engineer for our client’s Technology team.Great opportunity to join an impactful Sustainability & ESG startup.Maintain and evolve data pipelines, ensuring...Mostre mais
Revel Street LLC helps corporate event planners discover and reach private dining venues through an extensive, dependable database.We use LLMs extensively to gather and enrich venue data, streamlin...Mostre mais
SQL development and basic performance tuning.Ability to develop and monitor.DAGs to ensure reliable task scheduling.S3, and the broader AWS ecosystem for serverless data processing.ETL logic or sim...Mostre mais
Design, build, and optimize ETL/ELT data pipelines using Python and SQL.Lead migration of Adobe-based pipelines to GCP/BigQuery.Develop event-driven ingestion pipelines for large-scale data process...Mostre mais
FirstIgnite builds best-in-class software that accelerates commercialization and innovation by connecting scientific research with industry partners.We support universities, national labs, and rese...Mostre mais
As a SQL & Snowflake Engineer, you will play a key role in the full development lifecycle, translating complex data structures into actionable technical insights with a specific focus on Snowflake ...Mostre mais
Come to one of the biggest IT Services companies in the world! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cult...Mostre mais
We are seeking a full-time, remote Senior Data Engineer with 5+ years of experience to join our U.This key individual should have experience making decisions, working on a small development team, a...Mostre mais
Senior Data Engineer (Oracle / ODI) – Data Warehouse & ETL Specialist.Senior Data Engineer with strong expertise in Oracle and ODI (Oracle Data Integrator).This role is ideal for professionals who ...Mostre mais
We have an open position for a Senior Data Engineer for our client’s Technology team.Great opportunity to join an impactful Sustainability & ESG startup.Maintain and evolve data pipelines, ensuring...Mostre mais
Job Title: Senior GCP Data Engineer (BigQuery, Python, Airflow) Location: Mexico/ Brazil / Costa Rica (Remote) Type: Contract / FTEAbout Smart IT Frame: At Smart IT Frame, we connect top talent wit...Mostre mais
We are a fast growing business and technology consultant company co-founded in 2019.We offer a custom-tailored, white-glove engineering service fit for our clients, because a digital transformation...Mostre mais
Somos uma startup jurídica que busca constantemente soluções para facilitar a vida dos advogados e advogadas do Brasil.Atuamos na área de tecnologia, desenvolvendo produtos e ferramentas que auxili...Mostre mais
We're Hiring: Senior Data Engineer | Remote from Brazil | Fluent English required.Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work wit...Mostre mais
A Job? Or a Lifetime Experience? Start Yours Here!.Please note that we're aiming at an expatriation to Portugal.Portuguese technology consulting company.We have 12 years of experience in the market...Mostre mais
We are looking for a Senior Developer Data Engineer to build and operate scalable data pipelines and curated datasets that enable Digital and Customer Experience Applications across a global FMCG e...Mostre mais
Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical.We’re privately held, profitable, and have be...Mostre mais
Required Skills & Qualifications.Solid understanding of data flow,.ETL/ELT pipelines, and data lifecycle.Strong analytical and problem-solving skills (bug triage, RCA).Knowledge of data governance ...Mostre mais
