Sr Python Data Engineer
Softensity Incserra, BrasilHá 4 dias
Descrição da vagaStrong proficiency in Python for data processing (must have expertise in Pandas, nice to have : Polars, openpyxl). Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
Senior Python Data Engineer
About the Project
Responsibilities
- Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).
- Develop and expose RESTful APIs using FastAPI or similar frameworks.
- Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
- Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code.
- Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
- Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts).
- Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools).
- Participate in design discussions for future migration to Snowflake and / or a data lake architecture.
- Contribute to CI / CD pipelines using GitHub Actions.
Required Skills and Experience
Criar um alerta de emprego para esta pesquisa
Data Engineer Sr • serra, Brasil
Vagas relacionadas
- Promovida
Sr Python Data Engineer
Softensity IncVila Velha, Espírito Santo, Brazil Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose...Mostre maisÚltima atualização: 4 dias atrás
- Promovida
Lead Data Engineer
Elios TalentRegião V Praia do Canto-Um, Brasil Key Highlights ️ Lead the end-to-end design and build of a brand-new, greenfield analytics ecosystem ⚡ Architect data pipelines, orchestration, warehousing, and BI layers from the ground up Build s...Mostre maisÚltima atualização: 23 horas atrás
- Promovida
- Nova!
Databricks Data Engineer
GlobalSource ITvitória, Brasil We’re looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake.
This role focuses on ingesting data from mult...Mostre maisÚltima atualização: 11 horas atrás
- Promovida
GCP Data Engineer
Tata Consultancy Servicesserra, Brasil Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Data Engineer
Tata Consultancy ServicesSerra, Espírito Santo, Brazil Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Data Enginner w / Databricks (Relocation to Portugal)
Aubay Portugalcariacica, Brasil Aubay Portugal is a multinational French company, in Portugal since 2007.We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Main...Mostre maisÚltima atualização: 3 dias atrás
- Promovida
Senior Data Engineer
Pride GlobalViana, Espírito Santo, Brazil We're Hiring : Senior Data Engineer | Remote from Brazil | Fluent English required | Location : Remote – Brazil only Contact : Temporary Are you passionate about building scalable data platf...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Senior Data Platform Engineer
Elios TalentRegião V Praia do Canto-Um, Brasil Data Platform Engineer – Senior.Key Highlights ️ Lead the design and expansion of large-scale data platform components supporting analytics, experimentation, and machine learning workloads ⚡ Archit...Mostre maisÚltima atualização: 23 horas atrás
- Promovida
AWS Data Engineer
Tata Consultancy ServicesViana, Espírito Santo, Brazil Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: 7 dias atrás
- Promovida
Senior Python Software Engineer (AI)
PyyneCariacica, Espírito Santo, Brazil About Pyyne Pyyne is a modern technology consultancy engineering the next generation of digital products and services.At Pyyne, we believe in using technology to unlock business potential, creat...Mostre maisÚltima atualização: 4 dias atrás
- Promovida
Desenvolvedor Python Especialista
Jaya Techserra, Brasil Engenharia de Software Consciente.Aqui, você encontrará oportunidades para crescimento profissional e pessoal, contribuindo para projetos que têm um impacto significativo na indústria e na sociedad...Mostre maisÚltima atualização: 3 dias atrás
- Promovida
Data Lead Engineer - Snowflake
AmpstekCariacica, Espírito Santo, Brazil Data Lead Engineer – Snowflake Remote Contract Brazil / Mexico Responsibilities • Technical Leadership : Provide technical direction and mentorship to a team of data engineers, ensuring best pract...Mostre maisÚltima atualização: 1 dia atrás
- Promovida
Sr. Data Engineer
Xml InternationalVila Velha, Espírito Santo, Brasil Sr Data Engineer (São Paulo, Brazil)Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization.From enhancing...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Senior Software Developer - Python / Data
Luxoftcariacica, Brasil Join a team focused on backend and data engineering for headend applications at a leading video content provider.This role emphasizes Python-based services, AWS data workflows, and integration with...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Python / Data Engineer
LuxoftRegião V Praia do Canto-Um, Brasil Join a team focused on backend and data engineering for headend applications at a leading video content provider.This role emphasizes Python-based services, AWS data workflows, and integration with...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Azure Data Engineer
Tata Consultancy ServicesSerra, Espírito Santo, Brazil Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Data Lead Engineer – Snowflake
Ampstekviana, Brasil Data Lead Engineer – Snowflake.Technical Leadership : Provide technical direction and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and data operations.End...Mostre maisÚltima atualização: 1 dia atrás
- Promovida
Senior Data Engineer
Encora Inc.Vila Velha, Espírito Santo, Brazil Important Information Location : Brazil Job Mode : Full-time Work Mode : Work from home Job Summary We are looking for a Senior Data Engineer with deep expertise in building, optimizing, an...Mostre maisÚltima atualização: 17 dias atrás