Engineering Manager, Data Ingestion - Mercari at Mercari, inc.

Minato, , Japan -

Full Time

Start Date

Immediate

Expiry Date

17 Sep, 26

Salary

0.0

Posted On

19 Jun, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

People Management, Technical Strategy, Distributed Systems, Data Pipelines, Go, Python, Java, Scala, Apache Beam, Apache Spark, Apache Flink, Google BigQuery, Google Cloud Platform, Confluent Cloud, Apache Kafka, Apache Airflow

Industry

Software Development

Description

本ポジションは日本語JDの用意がありません。 Engineering Manager, Data Ingestion - Mercari Employment Status: Full-time Work Hours: Full Flextime (no core time) Office: Roppongi For more details, see the Overview of Our Positions section on our Careers site. About Mercari Circulate all forms of value to unleash the potential in all people "What can I do to help society thrive with the finite resources we have?" The Mercari marketplace app was born in 2013 out of this thought by our founder Shintaro Yamada as he traveled the world. We believe that by circulating all forms of value, not just physical things and money, we can create opportunities for anyone to realize their dreams and contribute to society and the people around them. Mercari aims to use technology to connect people all over the world and create a world where anyone can unleash their potential. For more information about Mercari Group’s mission, see Mercari’s Culture Doc Organization/Team Mission Mercari Engineering Principles Mercari Engineering Principles are a shared understanding that serves as the foundation of engineering beliefs and behavior at Mercari. The Engineering Principles are designed to complement the organizational identity (Mercari’s mission, values, and culture) from an engineering viewpoint. These principles ultimately help us achieve Mercari’s mission by defining the ideal state we seek to realize in the long term. Passion For The Product Grow Together Solve Through Mechanisms Collaborate Openly For more details, please see the following link: Engineering Culture At Mercari, data drives decision-making across product, marketing, and machine learning. As Engineering Manager for the Data Ingestion Team, you will lead the foundational systems that collect, process, and deliver high-volume event and operational data across Mercari Group — owning the technical strategy, people leadership, and operational health of the platform, in close partnership with Data Management, BI Analytics, SRE, and Platform Engineering. As part of the Japan Business JB Data (Data Ingestion team), you will also be collaborating with the following teams: - Data Management Team - Data Analytics Teams - Machine Learning Teams (Search, Recommendation, Credit, Anti-Fraud, etc.) - Product Teams (Marketing, CRM, Customer Support, Anti-Fraud, etc.) Through these partnerships, the team enables reliable, scalable, and timely data delivery to support analytics, experimentation, machine learning, and business decision-making across Mercari. See here for more information about our mission and values. Work ResponsibilitiesTeam Leadership & People Management Lead, mentor, and grow a team of Data Ingestion Engineers. Foster a culture of psychological safety, operational excellence, ownership, and continuous improvement. Support engineers through coaching, performance management, career development, and technical mentorship. Hire and onboard engineers to strengthen team capability and diversity. Manage execution planning, prioritization, and delivery of roadmap initiatives. Technical Strategy & Platform Ownership Define and drive the long-term technical vision and roadmap for Mercari’s data ingestion. Lead architectural discussions and technical decision-making for large-scale distributed data systems. Drive improvements in scalability, reliability, maintainability, and developer productivity. Partner with stakeholders to align platform investments with company-wide data strategy and business goals. Establish engineering standards, operational practices, and self service ownership and pipeline management. Reliability, Operations & Cost Optimization Oversee the reliability and operational health of mission-critical ingestion pipelines and event processing systems. Lead incident management and post-incident reviews for high-severity production issues. Drive continuous improvements in observability, SLIs/SLOs, monitoring, and operational readiness. Partner with FinOps and infrastructure teams to optimize platform costs while maintaining performance and reliability. Improve resource efficiency through partitioning, clustering, right-sizing, storage lifecycle management, and pipeline optimization. Unique Challenges Sustain a high-volume, mission-critical platform with a lean team. Over the past two years the platform has shifted to a self-service model for backend teams. You will keep this model resilient and reliable while the team operates lean, partnering with FinOps on major platform contracts such as BigQuery Enterprise Edition and Confluent Cloud. Expand the platform's frontier. Grow ingestion coverage to 3rd-party, unstructured, and company-wide data sources (e.g. HR, Finance), and help drive JB Data's Data × AI direction. Qualifications Required Experience/Skills Shared belief in Mercari’s mission and values. Experience in writing design documents or technical proposals and reaching agreements with stakeholders. Experience designing, developing, and operating large-scale services and/or distributed systems or data pipelines using a variety of programming languages including Go, Python, Java, Scala. Excellent communication skills to effectively collaborate with stakeholders and explain complex technical risks to non-technical leadership. Preferred Experience/Skills Experience with streaming data processing frameworks like Apache Beam or Spark or Flink. Experience with Data Warehouse technologies like Google BigQuery, Amazon Redshift, Hive/Hadoop or Snowflake. Familiarity with monitoring and alerting tools. Experience with Google Cloud Platform (Dataflow, Pubsub, Kubernetes Engine, Compute Engine) Experience with Confluent Cloud or Apache Kafka. Experience with Workflow engines like Argo Workflow or Apache Airflow. Experience publishing and contributing to OSS. Language English: Independent (CEFR - B2) Japanese: Independent (CEFR - B2) For details about CEFR, see here. Learn More About Mercari Group Careers site: https://careers.mercari.com/en/ Mercan: https://mercan.mercari.com/en/ Social media: X / Linkedin Data Processing overview (Japanese Only) Data Streaming for server side logging (Japanese Only) Data Processing batch pipeline overview (Japanese Only) Data Processing Change Data Capture (Japanese Only) Recruiting at Mercari At Mercari Group, we value empathizing with and embodying the mission and values of the Group and each company. To promote the creation of an organization that maximizes the total amount of value exhibited by all members, we would like to understand the experience and skills of each candidate as accurately as possible. Recruiting cycle at Mercari Group Application screening Skill assessment: For engineering positions, you will be asked to complete a skill assessment on HackerRank or GitHub. For non-engineering positions, you may be asked to complete an assessment depending on the position. (The timing of the assessment may coincide with the interview process.) Interview: The number of interviews may vary depending on the position. Reference check: We will ask for online references around the timing of the final interview. Offer: Offers will be determined carefully in consideration of the final interview and the reference check. Learn more about our recruiting process here. Equal Opportunity Hiring Here at Mercari, we work to realize a world in which no one’s potential is limited by their background and everyone has the opportunity to freely create value. We also firmly believe that a mindset of Inclusion & Diversity is essential for us to achieve our mission. This, of course, extends to our hiring practices as well. Mercari is committed to eliminating discrimination based on age, gender, sexual orientation, race, religion, physical disability, and other such factors so that anyone who shares our mission and values can join us, regardless of their background. For more details, please read our I&D statement. Please read and acknowledge our Privacy Policy prior to submitting your application.

Responsibilities

Lead and mentor a team of Data Ingestion Engineers while defining the long-term technical vision for Mercari's data ingestion platform. Oversee the reliability, scalability, and cost optimization of mission-critical data pipelines and event processing systems.