Job Description
Your Mission
Join our team at smartclip as a Software Engineer, Data Platforms . Develop and build the systems that process, transform, and refine terabytes of TV and advertising data daily. Your goal: Ensure our data platform is scalable, robust, and technologically state-of-the-art.
- Develop scalable platforms: Design and implement technical solutions for big data applications in an agile, performance-oriented environment.
- Optimize data flows: Continuously develop and optimize our data aggregation pipelines for TV data, advertising and forecasting – primarily based on Spark and Scala.
- Implement cloud-native solutions: Run, manage, and scale your solutions with Docker and Kubernetes in the AWS cloud.
- Focus on quality: Consistently drive test automation forward – from unit tests to complex integration tests. For us, Test Driven Development (TDD) is the way to build reliable systems.
- Explore new technologies: Evaluate new frameworks and tools, share your insights with the team, and help us stay technologically at the forefront of big data development.
Qualifications
Your Skills
You are a software engineer through and through and love the challenge of massive datasets. You transform the complexity of terabytes of data into elegant and efficient code.
- Engineering experience: Bring solid experience in software development, ideally with a strong focus on JVM languages such as Scala or Java and/or Python.
- Big data expertise: Proficient in working with Spark, Hadoop, or similar distributed systems. Experience with Trino, Flowman, or Delta Lake is a plus.
- Infrastructure know-how: Be familiar with CI/CD, Docker, Kubernetes and AWS and use these technologies securely.
- Quality standard: Never deliver code without testing. Focus on efficiency, clean architecture, and pragmatic solutions.
Incase you would like to apply to this job directly from the source, please click here