Zero Day Group
Role Summary We are looking for a Mid-Level Data Engineer to support the delivery of modern cloud-based data solutions within the Oil \& Gas industry. This role focuses on building scalable data pipelines, implementing lakehouse architectures, and supporting enterprise data modernization initiatives using Databricks and cloud technologies. The position offers exposure to client-facing collaboration, where you will work alongside senior engineers and architects in workshops, technical discussions, and delivery engagements while contributing to production-grade solutions in a remote Philippines-based setup. Key Responsibilities Build and maintain scalable data ingestion and transformation pipelines using Databricks, PySpark, and SQL Develop and optimize batch and streaming workflows using Delta Lake, Auto Loader, and Delta Live Tables (DLT) Implement Bronze, Silver, and Gold medallion architecture patterns for structured and semi-structured datasets Integrate data from operational systems, cloud platforms, APIs, IoT feeds, and enterprise applications Support data governance initiatives including metadata management, lineage tracking, schema controls, and access management Perform testing, validation, monitoring, and troubleshooting to ensure pipeline reliability and data quality Document technical designs, data models, and pipeline logic for internal and client delivery purposes Participate in code reviews and contribute to reusable engineering frameworks and best practices Assist with Databricks cluster configuration, workflow scheduling, and cloud resource optimization Collaborate closely with senior engineers, architects, and cross-functional teams to deliver project milestones and resolve technical issues Required Qualifications 3–5 years of experience in Data Engineering or related roles At least 1–2 years of hands-on experience with Databricks Strong proficiency in Python, PySpark, and SQL Experience building cloud-based data pipelines and transformation workflows Working knowledge of Databricks components such as Delta Lake, Auto Loader, Delta Live Tables, and Workflows Experience with at least one cloud platform: Azure (ADF, ADLS Gen2\) AWS (S3, Glue) GCP (GCS, Dataflow) Understanding of batch, streaming, and micro-batch data processing concepts Familiarity with data quality practices, testing methodologies, and clean coding standards Strong communication skills with the ability to collaborate in client-facing and delivery-focused environments Good documentation, analytical, and problem-solving skills Preferred Qualifications Databricks certification is an advantage Exposure to Oil \& Gas, Energy, Industrial, or IoT-related datasets Experience with CI/CD pipelines and DevOps practices for data engineering Familiarity with Unity Catalog, governance tooling, or metadata management platforms Basic understanding of cloud cost optimization and performance tuning Experience working in agile or distributed delivery teams Work Arrangement Location: Philippines (Remote) Employment Type: Full-Time Industry: Oil \& Gas / Energy Client Interaction: Yes — participation in technical discussions, delivery calls, and collaborative workshops
Zero Day Group
