About the Opportunity:

This opportunity is to join a team of highly skilled engineers who are enhancing Creditsafe's data offerings with high throughput and scalability as primary goals. Our team is building an ELTL-based Data Warehouse and serving solution coded in Python and leveraging AWS solutions such as Lambdas and ECS for processing, Step Functions and SQS for scheduling and sequencing, S3 for the raw storage layer, Redshift for the data lake and warehouse layers, Aurora and API Gateway for serving, and CloudWatch and X-Ray for monitoring. The platform collects, matches, and enhances over a billion objects from hundreds of providers with daily updates of more than 10 million objects while handling the addition, deletion, and correction of our data and indexes in an auditable manner. The team is also building highly available and low latency APIs to enable our clients with faster data delivery, feeding both frontend and direct-access single and batch queries.

What You Will Be Doing:

• Actively contribute to the codebase and participate in peer reviews.
• Design and build a metadata-driven, event-based distributed data processing platform using technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, and S3.
• Design, develop, and deploy business-critical systems used by thousands of customers, with constant opportunities for learning and growth.
• Build and scale Creditsafe APIs to securely support over 1000 transactions per second using serverless technologies.
• Execute practices such as continuous integration to enable the rapid delivery of working code.
• Collaborate alongside QA with a shift-left-testing approach, focusing on maintainability and quality from the very beginning.
• Understand company and domain data to make recommendations to improve existing products.

What We Are Looking For:

• Demonstrable ability to write clean and efficient code leveraging cloud environments for best performance.
• Proven of development experience within a commercial environment creating production-grade APIs and data pipelines in Python.
• A strong focus on constant learning and growth, seeking to elevate others alongside you.
• A desire to grow your skills through daily technical challenges and enjoy problem-solving, whiteboarding, and collaboration with the team.
• Excellent communication skills, with the ability to explain your views clearly to the team and openness to understanding theirs.
• A proven track record of drawing from deep and broad technical expertise, completing hands-on technical work, and tackling complex technology issues head-on.
• The ability to share your ideas collaboratively via wikis, discussion boards, blog posts, presentations, etc., and share any decisions made and lessons learned for the benefit of others.
• Leveraging AI – using AI coding integrations/IDEs like Copilot/Cursor, chat-agent models like Claude or ChatGPT 4/4o, platforms like Perplexity or others – to enhance your productivity and quality (don't worry, no vibe-coding here; we trust our devs over models).