Senior Cloud Data Engineer at Liquid Thought
Cape Town, Western Cape, South Africa -
Full Time


Start Date

Immediate

Expiry Date

26 Sep, 26

Salary

0.0

Posted On

28 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Python, SQL, Google Cloud Platform, ETL, Restful Services, Git, Airflow, Composer, Kubernetes, Docker, BigQuery, Elasticsearch, Data Warehousing, Data Governance, Apache Beam, Apache Spark

Industry

IT Services and IT Consulting

Description
Location: Cape Town (In-Office) Are you passionate about building impactful digital products that reach millions daily? Our client, a top-tier South African company is looking for a talented and experienced Senior Cloud Data Engineer to join their innovative, cross-functional team. You'll work on high-scale systems in the cloud, wrangle complex datasets, and contribute to products that inform, entertain, and inspire. Key Responsibilities: You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from Biquery and Dataproc to Kubernettes and AI Hub. You should ideally dream in Python and speak SQL. You should not be afraid to dive into dirty data and help the team make sense of it. Required Qualifications & Experience: Honours/Master's degree in Computer Science or Software Engineering 5+ years development experience working with Python Data skills (Traditional SQL and No-SQL) Large scale ETL High scale Restful Services Cloud experience (Google cloud platform preferred) Experience with source control (Git) Beneficial Skills: You will be exposed to these in their environment, great if you have it but not a problem if you don't. Scheduling and Orchestration (Airflow/Composer) Containerisation (Kubernetes, Docker) BigQuery Elastic search Data Warehousing concepts Data governance Concepts. Apache beam (Cloud Dataflow) Apache Spark (Dataproc)
Responsibilities
The role involves building high-scale cloud systems and managing complex datasets within the Google Cloud Environment. Key tasks include utilizing tools like BigQuery, Dataproc, and Kubernetes to create impactful digital products.
Loading...