Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Middle Data Engineer (GCP/BigQuery Migration) at Miratech

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

12 Apr, 26

Salary

0.0

Posted On

12 Jan, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Google Cloud Platform, BigQuery, DataStream, Dataflow, Pub/Sub, Java, Spring Boot, CDC Pipelines, Distributed Data Processing, Automated Testing, Data Migration, Data Management Systems, Data Reliability, Data Efficiency, Data Quality

Industry

IT Services and IT Consulting

Description

Company Description Our Client is developing a high-volume Data Lake on Google BigQuery and expanding their data engineering team. We are seeking a Middle Data Engineer to contribute to data migration and pipeline development using modern GCP technology. Job Description In this role, you will help build and maintain data pipelines, implement CDC processes, and support the migration from RDS to BigQuery. You’ll work independently while receiving direction from senior engineers and the Engineering Manager. Working hours: 14:00–23:00 Responsibilities Lead the migration of data from RDS to Google BigQuery. Design, construct, test, and maintain highly scalable data management systems. Ensure systems meet business requirements and industry practices. Integrate new data management technologies and software engineering tools into existing structures. Work with messaging systems and data pipelines. Employ a variety of technologies and tools to marry systems together. Drive the improvements on data reliability, efficiency, and quality. Qualifications 5+ years of hands-on experience with Google Cloud Platform, including: BigQuery, DataStream (CDC), Dataflow, Pub/Sub Strong Java development background. Experience with Spring Boot. Proven expertise in building CDC pipelines and distributed data processing systems. Track record of migrating large datasets from relational databases into BigQuery. Strong knowledge of automated testing (unit, integration, pipeline tests). Ability to work autonomously, make architectural decisions, and own end-to-end delivery.

Responsibilities

The Middle Data Engineer will lead the migration of data from RDS to Google BigQuery and design, construct, test, and maintain scalable data management systems. They will also ensure systems meet business requirements and integrate new technologies into existing structures.