Sr Python Data Engineer
Softensity Incvitória, BrasilHá 1 dia
Descrição da vagaStrong proficiency in Python for data processing (must have expertise in Pandas, nice to have : Polars, openpyxl). Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
Senior Python Data Engineer
About the Project
Responsibilities
- Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).
- Develop and expose RESTful APIs using FastAPI or similar frameworks.
- Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
- Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code.
- Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
- Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts).
- Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools).
- Participate in design discussions for future migration to Snowflake and / or a data lake architecture.
- Contribute to CI / CD pipelines using GitHub Actions.
Required Skills and Experience
Criar um alerta de emprego para esta pesquisa
Data Engineer Sr • vitória, Brasil
Vagas relacionadas
- Promovida
- Nova!
Python / Data Engineer
Luxoftvitória, Brasil Join a team focused on backend and data engineering for headend applications at a leading video content provider.This role emphasizes Python-based services, AWS data workflows, and integration with...Mostre maisÚltima atualização: 14 horas atrás
- Promovida
Data Engineer - Databricks
GlobalSource ITRegião V Praia do Canto-Um, Espírito Santo, Brazil We are hiring a hands-on Databricks Data Engineer to rebuild five Data Quality Scorecards using SAP ECC data already available in the Lakehouse.
You will design and validate profiling logic, build...Mostre maisÚltima atualização: 4 dias atrás
- Promovida
AWS Data Engineer
Tata Consultancy Servicesviana, estado do espírito santo, Brasil Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Data Engineer
Tata Consultancy Servicesserra, estado do espírito santo, Brasil Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
- Nova!
Sr. Data Engineer...
XML Internationalviana, estado do espírito santo, BR Sr Data Engineer (São Paulo, Brazil) Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization.From enhanci...Mostre maisÚltima atualização: 12 horas atrás
- Promovida
- Nova!
Sr. Data Engineer
XML Internationalguarapari, Brasil Sr Data Engineer (São Paulo, Brazil).Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization.From enhancin...Mostre maisÚltima atualização: 14 horas atrás
- Promovida
Data Engineer - Fluent English
Artefactguarapari, estado do espírito santo, Brasil The current vacancy is for the Brazilian office and we work in a Free Office model.At Artefact LatAm, we believe in and live a culture based on empathy!.
A healthy work environment is a place where ...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Senior Data Engineer
Eightpointserra, estado do espírito santo, Brasil Eightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for pa...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Sr Python Data Engineer
Softensity IncRegião V Praia do Canto-Um, Espírito Santo, Brazil Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RES...Mostre maisÚltima atualização: 1 dia atrás
- Promovida
Azure Data Engineer
Tata Consultancy Servicesvitória, estado do espírito santo, Brasil Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Senior Python Software Engineer (AI)
Pyynevila velha, Brasil Pyyne is a modern technology consultancy engineering the next generation of digital products and services.At Pyyne, we believe in using technology to unlock business potential, create sustainable g...Mostre maisÚltima atualização: 1 dia atrás
- Promovida
Senior Data Engineer
Encora Inc.guarapari, estado do espírito santo, Brasil We are looking for a Senior Data Engineer with deep expertise in building, optimizing, and managing data pipelines and modern cloud-based data platforms.
This role involves designing scalable, secur...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Aws Data Engineer
Tata Consultancy ServicesVitoria, Espírito Santo, Brasil Come to one of the biggest IT Services companies in the world!!.Here you can transform your career!.Here at TCS we believe that people make the difference, that's why we live a culture of unlimited...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Data Engineer - Databricks
Globalsource ItGuarapari, Espírito Santo, Brasil We are hiring a hands-on Databricks Data Engineer to rebuild five Data Quality Scorecards using SAP ECC data already available in the Lakehouse.
You will design and validate profiling logic, build r...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Senior Python Developer
Luxoftserra, estado do espírito santo, Brasil Building a risk applications and tools for innovative international top-tier hedge fund from the ground up, comprising the systems for traders, pre-trade checks and analysis, risks and limits manag...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Data Engineer
Dexianguarapari, estado do espírito santo, Brasil A Dexian, lançada em 2023, tem presença global e traz consigo quase 30 anos de experiência através de suas companhias legadas, principalmente da combinação da DISYS e Signature Consultants.Iniciamo...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Data Platform Engineer
Avenue Codeguarapari, estado do espírito santo, Brasil About the Role and Reponsabilities : .In this role you will have the chance to build large additions to our platform ecosystem, contributing to an infrastructure that centralizes our ETL and streamin...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
- Nova!
Python / Data Engineer...
Luxoftviana, estado do espírito santo, BR Join a team focused on backend and data engineering for headend applications at a leading video content provider.This role emphasizes Python-based services, AWS data workflows, and integration with...Mostre maisÚltima atualização: 5 horas atrás