Principal Engineer (Data)

at  VERSENT

The Principal Engineer provides technical leadership by being the connector from the engineering team to the delivery stakeholders.
Full engineering accountability across architecture, design and quality control is expected in this role, with the aim of creating a solution that meets the customer requirements and solution that is implemented to industry and Versent standards.
Your responsibilities will include:

Architecture and Design

• Produce and gain customer approval on high-level designs, detailed designs, solution architectures, operational and handover documentation; sequencing of projects and backlog that provide clarity and direction for the engineering team
• Collaborate with stakeholders and specialists to get the information required for feasibility assessment

Data Engineering

• Contribute to scoping and understanding customer outcomes and articulate them into commercial documents (Statements of Work, Request for Proposal, Bids and Tenders)
• Lead the selection and development of data engineering methods and tools to solve complex technical and architectural problems at production-level quality
• Provide technical leadership to engineers through code reviews, technical guidance, training and provision of advice around best practices
• Develop organisational policies, standards, and guidelines for the development and secure operation of data services and products
• Work proactively with new starters to develop their understanding of Versent engineering practices and approaches

Data Practice

• Provide technical leadership to engineers to uplift and enhance Versent Engineers skills and practices
• Act as a driver for Versent’s opensource offerings within the internal engineering community - leading, contributing and maintaining as required – to build brand reputation and awareness
• Maintain professional development and knowledge of industry changes and developments for the purposes of their continual growth and application of best practice at Versent
• Contribute to standardisation and reuse of practice specific material for RFPs, Tenders, Statements of Work and client engagement deliverables
• Encourage and motivate innovation communities, teams and individuals to share creative ideas and set-up innovation networks

Skills and Experience Required:

• 10+ years working on AWS or Azure platforms leading medium-to-large engineering or cross-functional teams.
• Hands on experience in Databricks
• Expertise in designing and developing distributed data pipelines using big data technologies on large scale data sets:
• Data lineage and discovery applications i.e. Amundsen, Datahub
• Collection and workflow of data i.e. AWS Kinesis; Airflow
• Integration of disparate data sources i.e. AWS Glue; Fivetran
• Event streaming / data stream processing i.e. Confluent/Kafka; Databricks
• Lead Data Warehouse / Lakehouse architecture implementations i.e. Redshift; S3; Snowflake
• Query processing, transformation and automated test integration i.e. Spark/Databricks; dbt
• Data observability tools i.e. Datadog;
• Application of CI/CD orchestration i.e. Git; Code Commit; CodePipeline, Jenkins, Buildkite
• Schema design, dimensional data modelling i.e. Data Vault 2.0, Star Schema

Our Culture
No cool cliques, just motivated passionate humans generating ideas and devising solutions in a creative, collaborative workspace. We’re building a team and looking for people who can think outside the square and deliver what others might consider impossible.
At Versent, we embrace the notion of Family: working together to achieve outstanding success.
What we offer you

At Versent we invest in our people, with benefits such as:

• Competitive salary package
• Working in a flexible, outcome-driven environment. Outside of client obligations, you can work from the office or home as needed. Also, leave the suit and tie behind and put on a Versent T-shirt instead.
• Weekly internal tech talks; all streamed and recorded so those who can’t make it to the office can still participate. For those who do make it, there’s pizza, beer, wine and soft drinks on tap
• Regular social events, meetups and guest speakers organised and facilitated by our team
• A supportive family culture - If you need help, just ask
• Celebration of the wins – big or small, because we know how hard you work.

And finally, we believe that every human is equal, across every dimension, and we function as an unbiased meritocracy. We strive to have Inclusion front and centre in how we operate and embed the fundamentals of tolerance and understanding in everything we do. This core belief is woven into all our policies.
Curious?
but honestly, we are more interested in you!

Please refer the Job description for details