Senior Test Engineer – Data

at  Creditsafe

SENIOR TEST ENGINEER – DATA

Job Title: Senior Test Engineer – Data
Location: Dublin,
Department: Data Cloud
We are currently looking a Senior Test Engineer to join the Data Cloud team in Dublin.
You will be expected to attend the office 50% of the working week, to align with our hybrid working policy.

JOB PROFILE

We are seeking a highly skilled Senior Test Engineer to join our advanced engineering team. This role is critical in ensuring the quality and reliability of our data-driven solutions. Your work matters: Instead of reactively testing code before production, you will proactively participate in code and architecture design from the ideation stages on, providing expert opinion on how to ensure resulting products are up to the highest quality standards of testability, reliability, and visibility. As development work carries on, you will focus on testing data pipelines, APIs, and the infrastructure that supports our high-volume – dozens of data sources, Terabytes of total data with ingestion frequencies from monthly to streaming - high-throughput data platform.
Your expertise will ensure that our data delivery systems are robust, scalable, and meet the needs of our global client base.

SKILLS AND QUALIFICATIONS

• Experience: proven experience in software testing with a focus on data engineering, data pipeline testing, and API testing in complex environments.
• Technical Skills: Strong proficiency in Python for writing test scripts and automation. Experience with AWS services, including Redshift, S3, and DynamoDB, is essential.
• Problem-Solving: High IQ with exceptional analytical skills, capable of understanding and testing complex data flows and integrations.
• Automation Expertise: Proven ability to build and maintain test automation frameworks that integrate with CI/CD pipelines, ensuring consistent and repeatable test results.
• Communication: Excellent communication skills, able to clearly articulate issues, solutions, and recommendations to both technical and non-technical stakeholders.
• Cooperation: Our teams have a focus on constant learning and empowerment – you will not just help us test our code, but help us improve how we design, architect and ensure quality.
• Leadership: Experience mentoring junior test engineers, sharing best practices, and leading testing efforts on complex projects.

• Shift-Left Testing: You will participate with Product and Engineering from the earliest stages to contribute to systems design and architecture, ensuring that quality remains a focus from day zero.
• Data Pipeline Testing: Design and execute automated tests for complex data pipelines that handle billions of objects, ensuring data integrity, accuracy, and performance from ingestion to delivery.
• API Testing: Develop and implement automated tests for our high-availability, low-latency APIs, ensuring they meet performance and reliability standards under various load conditions and deliver to our customers’ expectations.
• Data Validation: Verify the correctness, freshness and completeness of data transformations and integrations across multiple data sources, including Redshift, S3, Aurora, Postgres and DynamoDB.
• Automation: Lead the development and expansion of test automation frameworks using tools like PyTest and Jenkins, integrating them into our CI/CD pipelines for continuous testing.
• Collaboration: Work closely with data engineers, developers, and product owners to understand data flows, business logic, and requirements, ensuring that all new features are tested thoroughly before deployment.
• Troubleshooting: Analyse and troubleshoot issues within the data pipelines and APIs, providing detailed bug reports and working with the engineering team to resolve them.
• Performance Testing: Conduct performance testing on data pipelines and APIs, identifying bottlenecks and working with the team to implement improvements.
  The responsibilities detailed above are not exhaustive and you may be requested to take on additional responsibilities deemed as reasonable by their direct line manager.