Principal Elasticsearch Engineer

at  Cognite

Cognite is a global leader in industrial software with our Industrial DataOps platform, Cognite Data Fusion®, at the core. We were awarded the 2022 Technology Innovation Leader for Global Digital Industrial Platforms.
The Product team is the team responsible for developing Cognite Data Fusion as a robust and scalable platform for solving industrial data problems at Cognite. The industrial data problem is at the heart of transforming asset-intensive industries to be safer, more sustainable and more profitable. Cognite’s Cognite Data Fusion makes the operational data available at scale and adds value to the data through data processing. This enables asset-intensive industries to make data-driven decisions. Our platform is built on many different technologies, each good at solving various challenges. To build the best possible product, we believe in autonomous teams with developers, designers and product managers working closely together.
Cognite Data Fusion contextualizes operational data at scale, enabling asset-intensive industries to make data-driven decisions. We use the latest technologies ️ and work closely with end users to iterate quickly towards better product experiences \uD83D\uDCBB. That means that our users have the best data quality possible and ensure better insights for the user through data science and physical process modeling

WE BELIEVE MOST OF THESE SHOULD MATCH YOUR EXPERIENCE:

• 3+ years of experience with Elasticsearch or similar tools used for logging use cases
• Experience with large Cloud deployments on either AWS, GCP, or Azure
• Specifically 3+ years of experience with blob storage
• You can explain the tradeoffs of blob storage, and the tradeoffs storage technologies that use them. You understand how the logging tool lifecycles data in and out of blob storage.
• A master degree in Computer Science or a similar amount of experience
• Comfortable with Python or similar programming languages to make automations. You don’t need strong programming skills, but should be able to make or change simple scripts, integrations and automations.
• You enjoy sharing knowledge, and can calibrate who needs to know what
  Don’t meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. We are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway. You may be just the right candidate for this or other roles.

ABOUT THE ROLE:

Our platform generates operational and audit logs and provides capabilities similar to operational logging to our customers for alarms and events coming from industrial control systems. Just as a Kubernetes pod generates logs and telemetry, industrial assets like pumps and sensors do as well.
As a Principal Elasticsearch Engineer, you will play a crucial role in maintaining and improving Cognite’s logging and log-like infrastructure. Your expertise will help Cognite’s industrial customers and Cognite ensure that all logs are collected, stored and analyzed effectively, enabling our teams to quickly identify and troubleshoot any issues that may arise.

A TYPICAL DAY AS A COGNITER WILL CONTAIN THE FOLLOWING TASKS & RESPONSIBILITIES:

• Help plan, deploy, upgrade, monitor, and troubleshoot our Elasticsearch clusters and related infrastructure
• Work with service teams on improving observability
• Help architect and operate logging and log-like capabilities in our data platform, identifying what requirements can be met with what indexing strategies
• Make sure we use cloud storage and compute resources in the most efficient manner possible, likely relying heavily on S3 API-compatible blob storage