DataOps Engineer (DBA with Cloudera Experience)

at  TALENTSIS PTE LTD

Job Overview: We are seeking a skilled and experienced DataOps Engineer with a strong background in Database Administration (DBA) and Cloudera experience to join our dynamic data team. In this role, you will be responsible for managing and optimizing data infrastructure, ensuring seamless integration, and enabling the efficient flow of data across systems. You will work closely with data engineers, data scientists, and other stakeholders to maintain high-quality data pipelines, manage data storage, and ensure that data environments are reliable and scalable.

QUALIFICATIONS:

• Proven experience as a DataOps Engineer, Database Administrator (DBA), or similar role, with hands-on experience in database administration and data operations.
• Strong experience with Cloudera and Hadoop ecosystem (HDFS, YARN, Spark, Hive, Impala, etc.).
• Proficiency in SQL and database management (relational and non-relational databases).
• Strong understanding of ETL processes and tools, including data integration and transformation techniques.
• Experience in automating data management workflows and orchestration using tools like Apache NiFi, Airflow, or similar.
• Hands-on experience with performance tuning, query optimization, and troubleshooting database and system performance issues.
• Knowledge of data governance, data security, and compliance best practices.
• Familiarity with cloud-based data storage solutions (e.g., AWS, Azure, GCP) and data infrastructure.
• Strong scripting skills (Python, Bash, or similar languages).
• Excellent problem-solving skills and the ability to work under pressure to resolve issues efficiently.Ability to collaborate with cross-functional teams and communicate technical concepts to non-technical stakeholders.
• 
  (EA Reg No: 20C0312)
  Only shortlisted candidates will be notified
  Please email a copy of your detailed resume to denise@talentsis.com.sg for immediate processing

• Administer, monitor, and optimize relational and non-relational databases (e.g., SQL, NoSQL, Hadoop, Cloudera).
• Manage Cloudera environments, ensuring high availability, performance, and security of the data infrastructure.
• Design, implement, and maintain robust data pipelines, ensuring smooth and continuous data flow between various systems and platforms.
• Collaborate with data engineers and developers to design data models and data architecture, ensuring alignment with business needs and best practices.
• Manage and troubleshoot database performance issues, backup/restore operations, and disaster recovery procedures.
• Optimize queries and ensure database tuning for performance, security, and scalability.
• Integrate data from various sources, ensuring proper validation, transformation, and loading (ETL processes).
• Automate and streamline data management processes using tools like Apache NiFi, Airflow, or similar orchestration platforms.
• Implement best practices for data governance, security, and compliance, ensuring data integrity and privacy.
• Provide ongoing support, monitoring, and maintenance of database systems, including Cloudera-based environments.
• Collaborate with other teams to troubleshoot and resolve data pipeline and infrastructure issues, ensuring minimal disruption to data services.
• Participate in capacity planning and performance tuning to ensure optimal data pipeline throughput and storage efficiency.Stay updated on the latest industry trends and technologies to continuously improve data infrastructure and operations.