Databricks Data Engineer
GlobalSource ITLavras, Minas Gerais, BrazilHá 1 dia
Descrição da vagaStrong hands-on Databricks experience (Spark, PySpark, Delta Lake). Advanced SQL for large-scale data processing. Experience integrating data from multiple structured and unstructured sources. Solid understanding of distributed computing, performance tuning, and debugging Spark jobs. Power BI (reports, models, DAX preferred). Experience with CI / CD pipelines in an Azure environment Experience with data quality frameworks, Lakehouse monitoring, or DQX Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus Experience with SAP data is a plus.
Databricks Data Engineer
Fully Remote Contract
We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and visualizations.
Responsibilities :
- Build and optimize ETL / ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.
- Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP / legacy systems, streaming).
- Develop reusable pipeline frameworks, data validation logic, and performance-tuned transformations.
- Design curated datasets and deliver insights through Power BI dashboards.
- Implement best practices for lakehouse development, orchestration, and version control.
- Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.
Required Skills :
Nice to Have :
Criar um alerta de emprego para esta pesquisa
Data Engineer • Lavras, Minas Gerais, Brazil
Vagas relacionadas
- Promovida
Senior Data Engineer
Pride GlobalVarginha, Minas Gerais, Brazil We're Hiring : Senior Data Engineer | Remote from Brazil | Fluent English required | Location : Remote – Brazil only Contact : Temporary Are you passionate about building scalable data platforms...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Data Engineer (Relocation to Portugal)
AffinityVarginha, Minas Gerais, Brazil A Job? Or a Lifetime Experience? Start Yours Here! Our mission is to be a meaningful part of our people's careers.As we grow, so does our determination to offer the best experience to our employee...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Software Engineer, Data Integrations
BlawkAILavras, Minas Gerais, Brazil Blawk is building next-generation infrastructure to automate and analyze financial data at scale across the entertainment and creator economy.
We’re looking for a Software Engineer (Data Integrati...Mostre maisÚltima atualização: 13 dias atrás
- Promovida
Data Scientist
IFIT SolutionsVarginha, Minas Gerais, Brazil Looking for 2 data scientist : Advanced pyspark skills with experience building modular code.Do not need to have ingestion pipeline skills like a Data Engineer, but they must have the ability to b...Mostre maisÚltima atualização: 1 dia atrás
- Promovida
Databricks Data Engineer
GlobalSource ITVarginha, Minas Gerais, Brazil Databricks Data Engineer Fully Remote Contract We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta La...Mostre maisÚltima atualização: 1 dia atrás
- Promovida
Azure Data Engineer
Tata Consultancy ServicesLavras, Minas Gerais, Brazil Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cu...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Data Lead Engineer - Snowflake
AmpstekLavras, Minas Gerais, Brazil Data Lead Engineer – Snowflake Remote Contract Brazil / Mexico Responsibilities • Technical Leadership : Provide technical direction and mentorship to a team of data engineers, ensuring best pract...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Sr Python Data Engineer
Softensity IncVarginha, Minas Gerais, Brazil Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose...Mostre maisÚltima atualização: 5 dias atrás
- Promovida
Data Lead Engineer – Snowflake
AmpstekLavras, Brasil Data Lead Engineer – Snowflake Remote Contract Brazil / Mexico.Responsibilities • Technical Leadership : Provide technical direction and mentorship to a team of data engineers, ensuring best practice...Mostre maisÚltima atualização: 1 dia atrás
- Promovida
AWS Data Engineer
Tata Consultancy ServicesVarginha, Minas Gerais, Brazil Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: 8 dias atrás
- Promovida
GCP Data Engineer
Tata Consultancy ServicesLavras, Minas Gerais, Brazil Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Data Enginner w / Databricks (Relocation to Portugal)
Aubay PortugalVarginha, Brasil Aubay Portugal is a multinational French company, in Portugal since 2007.We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Main...Mostre maisÚltima atualização: 3 dias atrás
- Promovida
Python / Data Engineer
LuxoftVarginha, Brasil Join a team focused on backend and data engineering for headend applications at a leading video content provider.This role emphasizes Python-based services, AWS data workflows, and integration with...Mostre maisÚltima atualização: 3 dias atrás
- Promovida
AWS Developer (Data Lake)
MetaLavras, Minas Gerais, Brazil About the Role We are seeking a Senior AWS Developer to support the design and implementation of a large-scale data lake and analytics platform within a leading financial institution.The ideal cand...Mostre maisÚltima atualização: 18 dias atrás
- Promovida
Senior Data Engineer
EightpointLavras, Minas Gerais, Brazil About Eightpoint Eightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving signifi...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Senior Data Engineer
Encora Inc.Varginha, Minas Gerais, Brazil Important Information Location : Brazil Job Mode : Full-time Work Mode : Work from home Job Summary We are looking for a Senior Data Engineer with deep expertise in building, optimizing, an...Mostre maisÚltima atualização: 18 dias atrás
- Promovida
Data Engineer - Fluent English
ArtefactLavras, Minas Gerais, Brazil The current vacancy is for the Brazilian office and we work in a Free Office model.Who we are At Artefact LatAm, we believe in and live a culture based on empathy! A healthy work environment is a p...Mostre maisÚltima atualização: 15 dias atrás
- Promovida
Data Engineer
DexianVarginha, Minas Gerais, Brazil Quem Somos A Dexian, lançada em 2023, tem presença global e traz consigo quase 30 anos de experiência através de suas companhias legadas, principalmente da combinação da DISYS e Signature Consultan...Mostre maisÚltima atualização: 8 dias atrás