Data Engineer

Required Skills & Experience

Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.

3–5 years of experience in data engineering roles.

At least 2 years of hands-on experience with Azure Databricks and Apache Spark.

Strong programming skills in Python.

Proficiency in SQL and experience working with both relational and non‑relational databases.

Nice to Have Skills & Experience

Azure certifications such as Azure Data Engineer Associate, or Databricks certifications.

Experience with streaming data processing (e.g., Structured Streaming, Event Hubs).

Knowledge of infrastructure as code (Terraform / Terragrunt or ARM templates).

Familiarity with data governance tools and practices.

Experience with Unity Catalog, data governance, and data security / compliance concepts.

Job Description

Insight Global is seeking a Data Engineer to support a large beverage company’s data and analytics initiatives. This delivery-focused role is responsible for designing, building, and maintaining scalable data pipelines and analytics solutions on Azure Databricks, including Unity Catalog. The Data Engineer will develop and optimize ETL / ELT pipelines and Apache Spark jobs, ensure data quality and reliability, and collaborate with product owners and analytics teams to translate business needs into robust technical solutions.

This is a remote role in Brazil.