Talent.com
As candidaturas não são mais aceitas
ML Data Pipeline Engineer

ML Data Pipeline Engineer

ProsigliereCaruaru, Pernambuco, Brazil
Há 4 dias
Descrição da vaga

We're seeking a Data Pipeline Engineer to own and evolve our exercise recognition training data infrastructure. You'll manage the end-to-end pipeline that collects, synchronizes, validates, and prepares IMU sensor and video data for ML model training.

This role combines systems engineering, data quality automation, and hands-on problem-solving in a production environment.

What You’ll Do

Pipeline Operations & Improvement

Maintain and enhance our multi-source data collection system : IMU sensors (via mobile app) and synchronized video streams from gym-based cameras.

Improve video capture software robustness, particularly handling network interruptions and operational monitoring.

Deploy and monitor services in remote Linux environments with appropriate DevOps practices.

Data Quality & Validation

Evolve our Python-based QC engine that validates data pre- and post-annotation

Implement checks for IMU-video time synchronization, sensor health, and measurement consistency

Apply digital signal processing techniques to identify sensor failures, connectivity issues, and measurement irregularities.

Develop validation logic comparing annotations against sensor data to ensure temporal alignment.

Analysis & Troubleshooting

Perform ad-hoc analysis on ~1,200+ workout tasks to classify failure modes

Identify whether issues stem from pipeline bugs, sensor problems, or annotation errors

Prioritize engineering work based on data quality impact and coordinate with annotation team on fixes

Tooling and Visualization

Maintain and extend our NextJS UI serving annotators, data scientists, and stakeholders

Create visualizations (Chart.js) for QC metrics and signal analysis

Integrate with LabelStudio annotation interface

What You Bring

Required

Strong Python programming skills, particularly for data processing pipelines

Experience with time-series data and digital signal processing

Comfortable working in Linux environments and deploying / monitoring remote services

Ability to debug complex multi-component systems (sensors, video, networks, sync)

Data quality mindset : designing validation rules, tracking metrics, investigating anomalies

SQL / database experience for managing pipeline metadata

Highly Valued

Video processing experience (RTSP streams, encoding, OCR)

Working with sensor / IoT data and handling connectivity challenges

NextJS or modern web frameworks for data tooling

DevOps practices : containerization, monitoring, logging, alerting

Experience with annotation pipelines and ML training data workflows

Background in biomechanics, sports science, or wearable sensors

Tech Stack

Languages : Python (primary), JavaScript / TypeScript (NextJS UI)

Data : IMU sensor streams, video (RTSP), time-series analysis, DSP

Tools : LabelStudio, Chart.js, Linux / bash, OCR libraries

Infrastructure : Remote deployment, monitoring systems

You'll Thrive Here If You

Enjoy detective work : diagnosing why data doesn't match expectations

Balance pragmatism with quality : shipping improvements while maintaining reliability

Communicate well across technical and non-technical stakeholders

Can work autonomously in a small, mission-driven team

Criar um alerta de emprego para esta pesquisa

Data Engineer • Caruaru, Pernambuco, Brazil

Vagas relacionadas
  • Promovida
Data Engineer - Fluent English

Data Engineer - Fluent English

ArtefactCaruaru, Pernambuco, Brazil
The current vacancy is for the Brazilian office and we work in a Free Office model.Who we are At Artefact LatAm, we believe in and live a culture based on empathy! A healthy work environment is a p...Mostre maisÚltima atualização: 2 dias atrás
  • Promovida
Aws Developer (Data Lake)

Aws Developer (Data Lake)

MetaCaruaru, Pernambuco, Brasil
We are seeking a Senior AWS Developer to support the design and implementation of a large-scale data lake and analytics platform within a leading financial institution. The ideal candidate will demo...Mostre maisÚltima atualização: 3 dias atrás
  • Promovida
Senior Infrastructure Linux Engineer (L2 | Production | Market Data | Remote | Brazil)

Senior Infrastructure Linux Engineer (L2 | Production | Market Data | Remote | Brazil)

Amaris Consultingcaruaru, Brazil
Amaris Consulting is an independent technology consulting firm with a global footprint, bringing together diverse talents from various backgrounds to deliver innovative solutions to clients worldwi...Mostre maisÚltima atualização: 2 dias atrás
  • Promovida
Senior Data Engineer

Senior Data Engineer

EightpointCaruaru, Pernambuco, Brazil
About Eightpoint Eightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving signifi...Mostre maisÚltima atualização: há mais de 30 dias
  • Promovida
Cloud Engineer with Data Platforms Experience

Cloud Engineer with Data Platforms Experience

TurnKey Tech Staffingcaruaru, Brazil
For more than 30 years, Carnegie has been a leader and innovator in higher education marketing and enrollment strategy, offering groundbreaking services in the areas of Research, Strategy, Digital ...Mostre maisÚltima atualização: 1 dia atrás
  • Promovida
Data Platform Engineer

Data Platform Engineer

Avenue Codecaruaru, Brazil
About the Role and Reponsabilities : .In this role you will have the chance to build large additions to our platform ecosystem, contributing to an infrastructure that centralizes our ETL and streamin...Mostre maisÚltima atualização: 2 dias atrás
  • Promovida
Senior Data Engineer

Senior Data Engineer

Encora Inc.Caruaru, Pernambuco, Brazil
Important Information Location : Brazil Job Mode : Full-time Work Mode : Work from home Job Summary We are looking for a Senior Data Engineer with deep expertise in building, optimizing, an...Mostre maisÚltima atualização: 6 dias atrás
  • Promovida
Software Developer (Mobile / AI-Enabled Workflow)

Software Developer (Mobile / AI-Enabled Workflow)

Earned Media ProductionsCaruaru, Pernambuco, Brazil
Software Developer (Mobile / AI-Enabled Workflow) We are looking for a talented software developer with strong mobile app development experience to join our team. The ideal candidate will be comfo...Mostre maisÚltima atualização: há mais de 30 dias
  • Promovida
"#982228 Senior Data Engineer"

"#982228 Senior Data Engineer"

DexianCaruaru, Pernambuco, Brazil
Quem Somos A Dexian, lançada em 2023, tem presença global e traz consigo quase 30 anos de experiência através de suas companhias legadas, principalmente da combinação da DISYS e Signature Consultan...Mostre maisÚltima atualização: 25 dias atrás
  • Promovida
  • Nova!
Software Engineer, Data Integrations

Software Engineer, Data Integrations

BlawkAIcaruaru, Brazil
Blawk is building next-generation infrastructure to automate and analyze financial data at scale across the entertainment and creator economy. Software Engineer (Data Integrations).You’ll play a key...Mostre maisÚltima atualização: 12 horas atrás
  • Promovida
Staff ML Engineer

Staff ML Engineer

TurnKey Tech StaffingCaruaru, Pernambuco, Brazil
About the Product Niche is the leader in school search.Our mission is to make researching and enrolling in schools easy, transparent, and free. With in-depth profiles on every school and college in ...Mostre maisÚltima atualização: 2 dias atrás
  • Promovida
Machine Learning Engineer

Machine Learning Engineer

Flatiron Softwarecaruaru, Brazil
Flatiron is a global remote software development company with engineers located around the world.We unite experts from diverse backgrounds and experiences in a collaborative culture to deliver exce...Mostre maisÚltima atualização: 2 dias atrás
  • Promovida
Azure Data Engineer

Azure Data Engineer

Tata Consultancy Servicescaruaru, Brazil
Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: 2 dias atrás
  • Promovida
Ml Data Pipeline Engineer

Ml Data Pipeline Engineer

ProsigliereCaruaru, Pernambuco, Brasil
We're seeking a Data Pipeline Engineer to own and evolve our exercise recognition training data infrastructure.You'll manage the end-to-end pipeline that collects, synchronizes, validates, and prep...Mostre maisÚltima atualização: 2 dias atrás
  • Promovida
Data Engineer

Data Engineer

Tata Consultancy ServicesCaruaru, Pernambuco, Brazil
Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cu...Mostre maisÚltima atualização: há mais de 30 dias
  • Promovida
Data Modeler

Data Modeler

TurnKey Tech Staffingcaruaru, Brazil
For more than 30 years, Carnegie has been a leader and innovator in higher education marketing and enrollment strategy, offering groundbreaking services in the areas of Research, Strategy, Digital ...Mostre maisÚltima atualização: 1 dia atrás
  • Promovida
AI Gateway Engineer

AI Gateway Engineer

AVM Consulting IncCaruaru, Pernambuco, Brazil
AI Gateway Engineer We are seeking a skilled AI Gateway Engineer to join our team.The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend develo...Mostre maisÚltima atualização: há mais de 30 dias
  • Promovida
Data Engineer (Relocation to Portugal)

Data Engineer (Relocation to Portugal)

Affinitycaruaru, Brazil
A Job? Or a Lifetime Experience? Start Yours Here!.Our mission is to be a meaningful part of our people's careers.As we grow, so does our determination to offer the best experience to our employees...Mostre maisÚltima atualização: 2 dias atrás