THE TEAM

Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs. Our mission and yours too should you choose to, is to empower and enable our data community of data engineers, data scientists, analysts, product teams and decision makers to create value.
The Core Data Services team consists of Platform Engineering, Data Engineering, Data Enablement and Operations teams. We are building a highly functional, performant modern enterprise Data Lake while supporting our current data platforms so the focus is on maximizing functionality, creating value and content/data assets, cost optimizations and usability of the data delivery and services and all this is our measure of our success and defines us The Core Data Services Team! We are looking for a Data QA Engineer, You!

TECHNICAL SKILLS/COMPETENCIES

• Agile development methodologies using the Atlassian suite: Jira, Confluence
• Good understanding of Data Lakes, Data Warehouses
• Software development, coding expertise in the Data Science field using Python/Spark/Scala/R/Java
• Any visualization experience is an advantage
• Experience using ANSI SQL and Spark SQL is key to have
• Working knowledge of any of these : Databricks, Snowflake, Teradata, Oracle, Google BigQuery, Hadoop and related stacks
• An understanding of cloud services such as Amazon AWS, Google GCP or Microsoft Azure
• An understanding of streaming (Kafka) and batch based data sources
• An understanding of diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases
• An excellent understanding of the nuances that add complexities around data various data formats, data types, business logic, data pipelines, and data transformation
• Experience using version control systems such as Git and CI/CD workflows and practice

• Document use-case based validation plans and testing strategies designed to prevent defects
• Maintain comprehensive regression test suites
• Develop automation tests for Core Data Platform services and tools using Python, Apache Spark, Delta Lake, AWS S3 etc.
• Participate in building our internal testing framework
• Influence the service development process towards quality-centric methodologies
• Help develop and maintain quality standards that support the SDLC for data pipelines development to release
• Analyze requirements to understand positive, negative, and edge test scenarios
• Execute functional and regression tests; log all technical issues in JIRA for service enhancements
• Serve as a quality advocate on Data Engineering teams to ensure that Test Driven Development processes are being followed