Senior Data Engineer (GCP) - Portugal based

at  BoostIT

Boost IT is a Portuguese technology consultancy company, we are integrated into one of the most entrepreneurial groups in Portugal, with investment in more than 30 companies.
We want to be known for being the most dynamic, energetic and reliable company to operate in the market and, for that, we want to count on you.
If you’re passionate about technology and want to work on the most relevant technology projects, then this ad could be for you!
Boost IT. Doing IT. Better

Tasks

• Data Scheduling & Orchestration: Use tools like Cloud Scheduler, Cloud Run, Cloud Functions, and BigQuery to schedule and manage queries and processes.
• Pipeline Development: Implement Dataproc (PySpark) for creating scalable data pipelines.
• Workflow Orchestration: Employ Cloud Composer to orchestrate data pipelines and ensure seamless operation.
• Data Modelling & Transformation: Work with DBT (Data Build Tool) to transform and model data for optimal analytics and reporting.
• Infrastructure as Code: Deploy infrastructure via Terraform to enable scalable, reproducible environments.
• Reporting & Visualization: Develop and maintain reports in PowerBI to support decision-making.

Requirements

• Experience with GCP Services: Strong expertise with GCP tools and services - Cloud Scheduler, Cloud Run, Cloud Functions, BigQuery, Dataproc, Cloud Composer, DBT and Terraform.
• Additional Cloud Knowledge: Previous experience with Microsoft Azure is a plus but not required.
• Proven experience in data engineering, data pipelines, and cloud infrastructure.
• Strong analytical and problem-solving skills.
• Ability to work in a collaborative environment and communicate effectively with cross-functional teams.
• Fluent English level (spoken and written).
• Based in Portugal or available and interested to realocate to Portugal.

• Data Scheduling & Orchestration: Use tools like Cloud Scheduler, Cloud Run, Cloud Functions, and BigQuery to schedule and manage queries and processes.
• Pipeline Development: Implement Dataproc (PySpark) for creating scalable data pipelines.
• Workflow Orchestration: Employ Cloud Composer to orchestrate data pipelines and ensure seamless operation.
• Data Modelling & Transformation: Work with DBT (Data Build Tool) to transform and model data for optimal analytics and reporting.
• Infrastructure as Code: Deploy infrastructure via Terraform to enable scalable, reproducible environments.
• Reporting & Visualization: Develop and maintain reports in PowerBI to support decision-making