Principal Engineer - Data Platform

at  Stacklok

London, England, United Kingdom -

Start DateExpiry DateSalaryPosted OnExperienceSkillsTelecommuteSponsor Visa
Immediate01 Jun, 2024Not Specified01 Mar, 20241 year(s) or aboveSynchronization,State Management,Leadership,Data Synchronization,Programming Languages,Reliability,Management Skills,Research,Python,Postgresql,Technical Proficiency,Interpersonal Skills,It,Data Integrity,Elasticsearch,Communication Skills,Data SystemsNoNo
Required Visa Status:
CitizenGC
US CitizenStudent Visa
H1BCPT
OPTH4 Spouse of H1B
GC Green Card
Employment Type:
Full TimePart Time
PermanentIndependent - 1099
Contract – W2C2H Independent
C2H W2Contract – Corp 2 Corp
Contract to Hire – Corp 2 Corp

Description:

Stacklok is an innovative software supply chain security startup founded by Kubernetes co-founder, Craig McLuckie and Sigstore founder, Luke Hinds. Our mission is to make it easier to securely develop software. With our deep expertise in open-source technologies and commitment to enhancing software security, we are seeking highly skilled and motivated individuals to join our team. This is a rare opportunity to join a startup at an early stage, and to be part of a team that is committed to building something truly innovative and impactful. Learn more about Stacklok’s mission, virtues, and leadership, HERE.

ELEVATOR PITCH

Stacklok just launched two new products, Trusty and Minder, that help developers and open source communities keep their software secure and choose safer dependencies. As we look to the future, it’s critical that our SaaS systems perform to meet the needs and demands of our customers. In order to ensure that, we are seeking a Principal Data Engineer.
As a Principal Data Engineer, you will have a leadership role owning Stacklok’s Big Data system that will power our Software as a Service (SaaS) platform. You will optimize massive ingestion pipelines, architectures, and data models. Additionally, you will analyze and architect solutions to enhance data store performance, address state synchronization challenges, and streamline reconciliation processes, leveraging your expertise in Python and Go. The backend systems span both SQL (Postgres) and NoSQL (Elastic Search).

DESIRED SKILLS & EXPERIENCE

  • Technical Proficiency:
  • Expertise in Python and Go programming languages.
  • Strong experience with large-scale data systems, including PostgreSQL and Elasticsearch.Familiarity with data store performance tuning and optimization.


    • Data Management Skills:

    • Proven track record in data synchronization, state management, and reconciliation within an enterprise grade commercial SaaS product.
    • Hands-on experience with eventing systems and message brokers.Ability to architect and maintain scalable data pipelines.


      • Systems Architecture:

      • Experience in designing and owning the architecture of complex data systems.Capability to develop performance-centric solutions for SaaS platforms.


        • Analytical and Problem-Solving Skills:

        • Strong analytical skills with the ability to solve complex problems and provide practical solutions.Ability to work on large-scale, complex systems with a focus on performance and reliability.


          • Leadership and Communication:

          • Experience in mentoring junior engineers.
          • Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.Ability to plan and execute complex engineering projects to a successful outcome


            • Collaboration and Teamwork:

            • Ability to work collaboratively in a cross-functional team environment.
            • Strong interpersonal skills and a proven track record of successful team collaboration.

              LI-Hybrid

            Acclimatize to the team, understanding the workflows, processes, and ongoing projects. This includes getting to know team members, the company culture, and the specific tools and technologies used by Stacklok.

            • Take full ownership of the data infrastructure architecture, ensuring it is optimally designed for large-scale data handling and synchronization.
            • Lead initiatives to significantly enhance the performance and efficiency of our SaaS platform, focusing on data-intensive operations.
            • Develop and maintain robust procedures for data reconciliation, ensuring data integrity and consistency.
            • Research and implement state-of-the-art solutions to meet evolving data management needs

            Responsibilities:

            ROLE SUCCESS: 6-12 MONTH EXPECTATIONS

            Acclimatize to the team, understanding the workflows, processes, and ongoing projects. This includes getting to know team members, the company culture, and the specific tools and technologies used by Stacklok.

            • Take full ownership of the data infrastructure architecture, ensuring it is optimally designed for large-scale data handling and synchronization.
            • Lead initiatives to significantly enhance the performance and efficiency of our SaaS platform, focusing on data-intensive operations.
            • Develop and maintain robust procedures for data reconciliation, ensuring data integrity and consistency.
            • Research and implement state-of-the-art solutions to meet evolving data management needs.

              • Work closely with cross-functional teams to align the data architecture with the overall company objectives and customer requirements.

            IN THIS ROLE, YOU WILL HAVE THE OPPORTUNITY TO:

            Be the driving force behind architectural decisions, shaping how our SaaS platform evolves in handling data efficiently.

            • Work with cutting-edge tools and technologies in BigData, state synchronization gaining expertise in high-performance, scalable systems.
            • Play a crucial role in defining the direction of our data strategies, significantly impacting how data is leveraged across the organization.
            • Collaborate with top-tier professionals in the field, enhancing your knowledge and contributing to a culture of excellence.

              • Lead efforts to embed a performance-centric approach in all aspects of our data handling and processing.
                We know from experience that not ticking every box on the skills sections stops many from applying. Please apply regardless of your self-assessment - we want to hear from you! We have seen engineers succeed with a diverse range of skills and experiences.


            REQUIREMENT SUMMARY

            Min:1.0Max:12.0 year(s)

            Information Technology/IT

            IT Software - Other

            Software Engineering

            Graduate

            Proficient

            1

            London, United Kingdom