A vaga não está disponível no seu país.
Data Engineer
Fidelis Securitysete lagoas, estado de minas gerais, brHá +30 dias
Descrição da vagaProven experience as a Data Engineer or similar role, with a focus on data ingest, validation, and export automation. Strong proficiency in Python. Experience with data pipeline orchestration tools such as Apache Airflow, Apache NiFi, or similar. Familiarity with cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform. Experience with data validation techniques and tools for ensuring data quality. Experience building and deploying images using containerization technologies such as Docker and Kubernetes. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills, with the ability to work effectively in a team environment.
We are seeking a skilled and experienced Data Engineer to join our Threat Research team. The primary responsibility of this role will be to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows.
Responsibilities :
- Design, develop, and maintain data pipelines for ingesting threat intelligence data from various sources into our data ecosystem.
- Implement data validation processes to ensure data accuracy, completeness, and consistency.
- Collaborate with threat analysts to understand data requirements and design appropriate solutions.
- Develop automation scripts and workflows for data export processes to external systems or partners.
- Optimize and enhance existing data pipelines for improved performance and scalability.
- Monitor data pipelines and troubleshoot issues as they arise, ensuring continuous data availability and integrity.
- Document technical specifications, data flows, and procedures for data pipeline maintenance and support.
- Stay updated on emerging technologies and best practices in data engineering and incorporate them into our data ecosystem.
- Provide technical guidance and support to other team members on data engineering best practices and methodologies.
Requirements :
Criar um alerta de emprego para esta pesquisa
Data Engineer • sete lagoas, estado de minas gerais, br
Vagas relacionadas
- Promovida
Software Engineer PL
Turbisete lagoas, estado de minas gerais, br A Turbi é a locadora do futuro : 100% digital, movida a tecnologia, gente boa e paixão por transformar a forma como as pessoas se locomovem.
A gente abre carro pelo app (sim, sem chave!) e acredita q...Mostre maisÚltima atualização: 2 dias atrás
- Promovida
Murex BAU Consultant
Luxoftsete lagoas, estado de minas gerais, br BAU Support - 1st and 2nd level production system support on Murex 3.Work on a variety of Murex system implementation, configuration and developments in various aspects of Murex including datamart,...Mostre maisÚltima atualização: há mais de 30 dias