Talent.com
HDP Administrator / Architect

HDP Administrator / Architect

TurnKey Tech StaffingSão Paulo, BR
Há 1 dia
Descrição da vaga

Role Summary

The HDP Administrator / Architect will provide deep technical expertise in administering and modernizing Hortonworks (HDP) and Cloudera environments as part of enterprise-scale data modernization initiatives powered by NexusOne . This role is responsible for ensuring operational stability, performance, and compliance of existing Hadoop environments, while architecting and supporting the transition toward open-source, cloud-native components (e.g., Spark, Iceberg, Trino, Ranger, DataHub).

This individual must possess hands-on depth in the full Hortonworks stack — from cluster management and security to performance tuning and metadata governance — serving as the technical bridge between legacy and modern data ecosystems.

Core Responsibilities

  • Administer, monitor, and optimize Hortonworks Data Platform (HDP) clusters, including HDFS, YARN, Hive, HBase, Oozie, Ranger, Atlas, and Ambari.
  • Perform environment maintenance and upgrades — patching, version management, capacity planning, and backup / recovery.
  • Ensure platform reliability, high availability, and adherence to enterprise security and compliance requirements.
  • Collaborate with Data Engineering and Platform Architecture teams to design migration strategies from HDP / Cloudera to modern open-source frameworks.
  • Lead the migration of data, metadata, and security policies from legacy components (e.g., Atlas / Ranger) to DataHub, Iceberg , and modern equivalents.
  • Conduct root-cause analysis and resolve complex performance or stability issues across distributed systems.
  • Implement and maintain Kerberos, LDAP / SSO integration, and role-based access control (RBAC) policies.
  • Document architecture, configurations, and operational runbooks for cluster management and decommissioning.
  • Train and mentor engineers in HDP administration, troubleshooting, and modernization best practices.

Must-Have Core Skills

  • Deep Hortonworks Expertise : Proven hands-on administration experience with HDP 2.x / 3.x , including HDFS, YARN, Hive, HBase, Oozie, Ranger, Atlas, Ambari, and Kerberos.
  • Cloudera Stack Knowledge : Understanding of Cloudera Manager and CDP transition paths.
  • Security & Governance : Expertise in configuring and managing Ranger, Atlas, Kerberos, LDAP / SSO , and encryption frameworks.
  • Performance Optimization : Skilled in resource tuning, query optimization, and capacity planning for large-scale clusters.
  • Automation & Infrastructure : Experience with Ansible, Terraform , or equivalent for provisioning and configuration management.
  • Monitoring & Observability : Hands-on with Grafana, Prometheus, Ambari Metrics , or equivalent platforms.
  • Scripting & OS : Strong Linux administration and scripting (Bash, Python).
  • Ideal Background

  • 5–10 years of experience as an HDP or Cloudera Administrator supporting production-grade clusters at scale.
  • Deep operational experience with Hortonworks Data Platform (HDP) , including upgrades, troubleshooting, and tuning.
  • Prior involvement in data platform modernization or cloud migration programs .
  • Knowledge of emerging open-source frameworks (Spark, Trino, Iceberg, Ranger, DataHub).
  • Proven ability to collaborate across platform, security, and data teams to deliver mission-critical outcomes.
  • Success Criteria

  • Sustained platform stability and high availability throughout modernization.
  • Successful migration of data, metadata, and policies to NexusOne-aligned open-source components.
  • Zero major incidents or regressions during transition or decommissioning.
  • Clear documentation and knowledge transfer to engineering and operations teams.
  • Recognition as a subject-matter expert in Hortonworks administration and modernization best practices .
  • We offer :

  • We welcome new ideas and allow you to make an immediate impact on the team.
  • Flexible Paid time off (PTO for any reason, including sick days (no specified limits) and flexible work schedule.
  • Personal laptop.
  • Health / Sport Budget.
  • Fully remote.
  • Criar um alerta de emprego para esta pesquisa

    Architect • São Paulo, BR

    Vagas relacionadas
    • Promovida
    • Nova!
    Cloud Architect

    Cloud Architect

    GeorgiaTEK Systems Inc.praia grande, Brazil
    Position : Associate Principal – Cloud Architecture (Azure PaaS Modernization).Type : Full-Time / Contractor (depending on region). Language : Fluent English required.Associate Principal – Architecture...Mostre maisÚltima atualização: 10 horas atrás
    • Promovida
    • Nova!
    Tableau Administrator

    Tableau Administrator

    Tata Consultancy Servicesarujá, Brazil
    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: 18 horas atrás
    • Promovida
    • Nova!
    .NET Architect (AWS & Cloud Modernization)

    .NET Architect (AWS & Cloud Modernization)

    Solas IT Recruitmentguarujá, Brazil
    NET Architect (AWS & Cloud Modernization).Candidates must be resident in Brazil and eligible to work remotely from within the country. The ideal candidate will lead the modernization of existing app...Mostre maisÚltima atualização: 18 horas atrás
    • Promovida
    Senior Linux + Windows Administrator (Fluent English)

    Senior Linux + Windows Administrator (Fluent English)

    Tech Mahindra - BrasilSantana de Parnaíba, São Paulo, Brazil
    Our client develops and delivers cloud enterprise software for companies around the world who manufacture and distribute goods, build and maintain assets, and manage service-focused operations.With...Mostre maisÚltima atualização: 5 dias atrás
    • Promovida
    • Nova!
    Oracle Financial Functional Consultant

    Oracle Financial Functional Consultant

    Tata Consultancy Servicesarujá, Brazil
    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre maisÚltima atualização: 18 horas atrás
    • Promovida
    • Nova!
    SAP BPC Architect

    SAP BPC Architect

    Genpactvárzea paulista, Brazil
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Mostre maisÚltima atualização: 18 horas atrás
    • Promovida
    • Nova!
    Senior Data Architect - Databricks (Remote)

    Senior Data Architect - Databricks (Remote)

    AGGRANDIZEitaquaquecetuba, Brazil
    A Aggrandize nasceu em 2015 com a missão de.Guiados por valores como adaptabilidade, colaboração, foco no cliente e visão de dono, oferecemos soluções que transformam desafios em oportunidades.Noss...Mostre maisÚltima atualização: 17 horas atrás
    • Promovida
    • Nova!
    Oracle Financial Consultant

    Oracle Financial Consultant

    THOUGHT BYTEribeirão pires, Brazil
    Job Title : OFSAA Consultant with Thoughtspot Experience.We have requirement for OFSAA (Oracle Financial Services Analytical Applications), OAS and Thoughtspot experienced resources in Brazil.OFSAA ...Mostre maisÚltima atualização: 17 horas atrás
    • Promovida
    • Nova!
    Senior HR / ADM Analyst - Remote

    Senior HR / ADM Analyst - Remote

    INDI Staffing Servicesguarulhos, Brazil
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Mostre maisÚltima atualização: 17 horas atrás
    • Promovida
    • Nova!
    M365 & IAM Engineer

    M365 & IAM Engineer

    TMF Groupguarujá, Brazil
    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudule...Mostre maisÚltima atualização: 17 horas atrás
    • Promovida
    • Nova!
    ServiceNow Architect

    ServiceNow Architect

    VASS US & Canadasantos, Brazil
    We’re looking for an experienced ServiceNow Enterprise Architect to join a global organization.This is a fantastic opportunity to work on a high-impact initiative within an international environmen...Mostre maisÚltima atualização: 17 horas atrás
    • Promovida
    Dynamics 365 Solution Architect

    Dynamics 365 Solution Architect

    Neotalent ConclusionSão Paulo, BR
    Neotalent Conclusion is one of the leading Iberian specialists providing services in Information Technology and Engineering services. As part of the Netherlands-based organization Conclusion, which ...Mostre maisÚltima atualização: 16 dias atrás
    • Promovida
    • Nova!
    Cloud Application Architect

    Cloud Application Architect

    GFT Technologies Brasilpraia grande, Brazil
    Com mais de 35 anos de mercado e localizada em 16 países, a GFT emprega mais de 12.Aqui, a diversidade, a igualdade e a inclusão estão no centro e garantir um ambiente de trabalho seguro para todas...Mostre maisÚltima atualização: 18 horas atrás
    • Promovida
    Architect

    Architect

    DE-YANSão Paulo, BR
    This role merges creative vision with technical expertise, bridging design, production, and fabrication to deliver exceptional innovative environments. You'll lead projects from concept through cons...Mostre maisÚltima atualização: 26 dias atrás
    • Promovida
    • Nova!
    Presales Solutions Architect

    Presales Solutions Architect

    WIZ.AISão Paulo, SP, BR
    We are seeking a dynamic and customer-focused.Customer Success Manager (CSM).The CSM will be the bridge between our customers, presales, and R&D teams, ensuring successful adoption of conversat...Mostre maisÚltima atualização: 11 horas atrás
    • Promovida
    Data Architect

    Data Architect

    TurnKey Tech StaffingArujá, São Paulo, Brazil
    About the Product : For more than 30 years, Carnegie has been a leader and innovator in higher education marketing and enrollment strategy, offering groundbreaking services in the areas of Research,...Mostre maisÚltima atualização: 25 dias atrás
    • Promovida
    • Nova!
    Interface Developer

    Interface Developer

    Insight Globalcabreúva, Brazil
    Company : Insight Global Customer.Domain : Hospitals and Health Care.Location : Remote / Work from Home.Working Hours : 8am-5pm Pacific Standard Time. Minimum 5 years healthcare interface development expe...Mostre maisÚltima atualização: 18 horas atrás
    • Promovida
    • Nova!
    Case Manager (Project Manager)

    Case Manager (Project Manager)

    Sapochnick Law Firmsuzano, Brazil
    Immigration Law Firm, Law offices of Jacob J Sapochnick is growing and developing law firm in the USA that specializes in business, employment, investment, and family immigration to the USA.The law...Mostre maisÚltima atualização: 17 horas atrás