Collibra DQ Expert || 100% Remote Work Opportunity || Citizen,EAD-H4,GC,GC-

at  Steneral Consulting

REMOTE- NEED SOMEONE WHO HAS PROVEN EXPERIENCE ON COLLIBRA DQ

Notes:

• Someone has worked on Collibra DQ
• How to configurate in the tool
• Run profiling on Spark Cluster
• Use DataProc cluster
• Experience with Google
• Code Python/PySpark
• Collibra Upgrade experience*
• Need someone to lead
• DataProc and Composer
• Understands the products to help drive
• Help with automation. Someone knows Collibra DQ should know Machine Learning
• Currently using out of the box capabilities

Current State of Collibra:

• Been running for 2 years
• Execution issues on automation
• Automation capabilities
• Machine Learning
• Instance isn’t doing well with view

Nice to have:
DataPlex is the governance tool implementing today

QUALIFICATIONS:

• Proven experience with Collibra Data Quality, including configuration and upgrade processes.
• Familiarity with Google Cloud services, particularly DataProc and Composer.
• Strong coding skills in Python and PySpark.
• Understanding of data governance frameworks and best practices.
• Knowledge of machine learning capabilities within Collibra.
• Excellent problem-solving skills and ability to drive projects to completion.

• Configure and optimize Collibra DQ settings to enhance data quality processes.
• Execute data profiling tasks using a DataProc cluster, ensuring efficient data processing.
• Support the upgrade of our Collibra instance, addressing current execution and automation issues.
• Leverage Collibra’s automation capabilities, including out-of-the-box machine learning features, to improve operational efficiency.
• Utilize a strong understanding of Collibra products to drive effective governance and data quality initiatives.
• Work closely with cross-functional teams to integrate Collibra DQ solutions and support data governance efforts.
• Write and optimize Python/PySpark code to enhance data processing and integration tasks.