Data Engineer ID43407

Job Description

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

As a Senior Data Engineer, you’ll play a key role in shaping high-impact data solutions that power smarter decision-making and support a global mission to connect people with meaningful work. You’ll collaborate with diverse teams to build secure, scalable pipelines and drive innovation in cloud-based data infrastructure. This is a chance to grow technically, influence product evolution, and thrive in an open, collaborative culture that values learning and excellence.

WHAT YOU WILL DO

• Develop and maintain secure and efficient data pipelines using DBT, PySpark, and Python in an company-supported cloud environment, integrating all HR data sources to enable analytics and insights for HR COEs and HR leadership;
• Build the infrastructure and tooling required for optimal extraction, transformation, and loading (ETL) of data from various sources using Python, DBT, Terraform, and AWS technologies such as Glue, EMR , and S3;
• Identify, design, and implement internal process improvements, including automating manual workflows, debugging and optimizing data delivery, and re-architecting infrastructure for enhanced scalability;
• Apply the Data Quality Framework in the HRDM repository by developing unit tests, and creating both manual and automated test cases;
• Monitor data pipelines to ensure a minimum of 99.5% data availability;
• Create and maintain data models that are intuitive and easily consumable by business partners;
• Write and update project documentation (most data ingestion scripts are written in Python).

MUST HAVES

PERKS AND BENEFITS

Requirements

4+ years of professional experience as a Data Engineer; Proficiency in Python for object-oriented programming and data scripting; Hands-on experience with Snowflake; Strong experience with SQL; Experience using DBT for data transformations; Experience with Airflow; Familiarity with REST APIs for integration and data ingestion; Experience working with Google BigQuery; Proven track record of handling large-scale and sensitive data securely; Experience with real-time data processing (e.g., from Google Sheets or APIs); Strong documentation skills; Advanced English communication skills.