Databricks Data Warehouse Architect About the role : One of the largest companies in the world in the Gaming industry is seeking a hands-onData Architect with DataWarehouse Engineerexpertise inDatabricks (DBX)andAWS-native data servicesto spearhead the design and implementation of a new data warehouse instance for a major product line.
This role will involve building from the ground up—architecting scalable pipelines, optimizing lakehouse performance, and integrating seamlessly with diverse real-time and batch data sources across AWS.
The ideal candidate is passionate aboutdata architecture , thrives in fast-moving environments, and has a proven track record of setting up high-performance lakehouse platforms onDatabrickswith a strong foundation indata warehousing principles .
Key Responsibilities : Design and deploy a newDatabricks Lakehouseinstance tailored to the client's product-level data needs.
Architect and implement robustdata ingestion pipelinesusing Spark (PySpark / Scala) and Delta Lake.
IntegrateAWS-native services(S3, Glue, Athena, Redshift, Lambda) with Databricks for optimized performance and scalability.
Define data models, optimize query performance, and establish warehouse governance best practices.
Collaborate cross-functionally with product teams, data scientists, and DevOps to streamline data workflows.
Maintain CI / CD, preferablyDBXfor data pipelines using GitOps and Infrastructure-as-Code.
Monitor data jobs and resolve performance bottlenecks or failures across environments.
Required Skills & Experience : Databricks / Lakehouse ArchitectureEnd-to-end setup ofDatabricks workspacesandUnity Catalog
Expertise inDelta Lake internals , file compaction, and schema enforcement
AdvancedPySpark / SQLskills for ETL and transformationsAWS Native IntegrationDeep experience withAWS Glue ,S3 ,Redshift Spectrum ,Lambda , andAthena
IAM and VPC configuration knowledge for secure cloud integrations
Data Warehousing & ModelingStrong grasp ofmodern dimensional modeling(star / snowflake schemas)
Experience setting uplakehouse design patternsfor mixed workloads
Automation & DevOpsFamiliarity withCI / CD for data engineeringusing tools like DBX, Terraform, GitHub Actions, or Azure DevOps
Proficient inmonitoring toolslike CloudWatch, Datadog, or New Relic for data pipelines
Bonus / Nice to Have : Experience supportinggaming or real-time analytics workloads
Familiarity withAirflow ,Kafka , orEventBridge
Exposure todata privacy and compliance practices (GDPR, CCPA)
Other Details : Location : Latin America (LATAM) region - Remote, USA - Remote
Length : 1+ Year
Client : Gaming giant
Data Architect • Arujá, São Paulo, Brasil