Data Platform Engineer

at  Milestone Systems Inc

Are you eager to be at the forefront of innovation within Milestone’s cutting-edge Video Management System?
You will join a leading, global provider of video management software and be part of our innovative and entrepreneurial development team. Our mission is to harness the power of machine learning and democratize it within the realm of video data – and by doing so contribute to the future of Milestone. However, doing what we do comes with great responsibility, and for this reason it is crucial that you can stand 100% behind our agenda for ethical tech and responsible use of technology.
As a Data Platform Engineer at Milestone, you will be responsible for designing, building, and maintaining data pipelines and architectures to support our data and AI needs. Your primary duties will include developing scalable data solutions, ensuring data quality and integrity, and collaborating with cross-functional teams to optimize data workflows. You will play a critical role in enabling data flows and driving the success of our data and AI initiatives.

TECHNICAL SKILLS:

• Proficiency in programming languages such as Python, SQL, or similar.
• Strong understanding of data engineering concepts, including ETL processes, data modeling, and data warehousing.
• Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and their data services (e.g., AWS Redshift, Google BigQuery, Azure Data Lake).
• Experience in workflow orchestration tools such as Apache Airflow or Prefect.
• Experience with ML lifecycle management tools such as MLflow, Kubeflow, or similar.
• Familiarity with experiment tracking and model management tools like Weights & Biases, ClearML, or similar.
• Knowledge of database systems, both relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Cassandra).
• Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
• Experience with big data technologies such as Apache Spark, Hadoop, or similar is desirable.

EXPERIENCE:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience as a Data Engineer, Data Architect, or a related role.
• Proven track record of building and maintaining data pipelines and architectures.
• Experience with machine learning technologies and cloud-based data services.
• Experience in designing and implementing ETL processes and data workflow

YOUR RESPONSIBILITIES:

As a member of our team, you will collaborate closely with colleagues on various challenges. Your responsibilities will include:

• Design, develop, and maintain scalable data pipelines to support data ingestion, processing, and storage.
• Implement and optimize ETL (Extract, Transform, Load) processes to ensure data quality and integrity.
• Develop and maintain data architectures that support the creation of data solutions, including enabling the training and productization of data analytics and AI applications.
• Collaborate with data scientists, engineers, and product managers to integrate data tools with analytics and AI applications.
• Ensure data security and compliance with industry standards and best practices.
• Monitor and optimize data workflows to ensure performance, reliability, and scalability.
• Troubleshoot and resolve issues related to data pipelines and architectures.

Are you the right candidate?
We are looking for a candidate who is self-driven and can excel in a dynamic work environment. Key qualifications include:

In addition to the exciting challenges of this role, Milestone provides:

• Opportunities for professional growth and development.
• A supportive company culture and inclusive workplace environment.
• Daily meals, snacks, and beverages in our canteen.
• Office amenities such as company bikes, a gym, massages, and Friday gatherings.
• Monthly company events for team bonding and enjoyment