- What you will be doing?You will actively contribute to the codebase and participate in peer reviews.
- Help to design and build metadata driven, event based distributed data processing platform using technologies such as Python, Spark, Airflow, Iceberg, DynamoDB, AWS Glue, S3.
- You will work on integrating our AWS data lake with other data platforms such as Snowflake and Databricks.
- As an experienced Engineer, you will play a critical role in the design, development, and deployment of our business-critical system.
- You will be building and scaling Creditsafe’s data pipelines combining batch and streaming approaches and targeting sub-100ms latency serving.
- Understanding domain data to make recommendations to improve the existing product.
- Building AI-based solutions leveraging approaches such as semantic search, MCP and agentic workflows.
- Employing various AI tools such as Perplexity, Cursor, CoPilot, etc to aid in all aspects of your work.
- What are we looking for?Track record of successfully implementing and operating production data platforms using Python and AWS.
- Hands-on experience with modern cloud data platforms including Snowflake and/or Databricks.
- You understand and can implement data engineering best practices.
- You demonstrate the ability to write clean & efficient code and combine it with the cloud environment for best performance.
- Proven experience of development experience within a commercial environment creating production grade data pipelines in python.
- We appreciate someone that is looking to grow your skills through daily technical challenges and enjoy problem solving, whiteboarding in collaboration with team.
- You have excellent communication skills, and ability to explain your views clearly to the team and are open to understanding the views of others.
- You share your ideas collaboratively via wikis, discussions boards, etc and share any decisions made, for the benefit of others.
- Be able to take ownership of end-to-end deliverables from planning all the way to production.
- Why Creditsafe?Career Progression: Clearly defined career progression path with opportunities to grow as a technical leader or move into adjacent roles.
- Learning & Development: Access to a plethora of learning resources and courses to perpetually enhance your skills, with weekly dedicated training and focus time.
- Work-Life Balance: Committed to promoting a balanced lifestyle with flexible working hours and hybrid work options.
- Innovation: Engage in exciting projects, harnessing the power of the latest technologies in cloud computing and data management.
Our Technology Stack: Python, Linux, Airflow, AWS DynamoDB, S3, Glue, Athena, Redshift, lambda, API Gateway, Terraform, CI/CD
Incase you would like to apply to this job directly from the source, please click here