Job details

Accelerate your business with the power of data! Databricks is hiring Data Engineers.

Job Summary

To further accelerate our company-wide data-driven management, we are currently working on a project to consolidate our data infrastructure onto Databricks (Lakehouse Platform) and migrate our BI environment to Databricks SQL and Databricks AI/BI (Dashboards/Genie). We are seeking a data engineer to maximize the potential of Databricks and build and lead an environment where our analysts and business departments can perform advanced data analysis and visualization without stress. [Specifically...] ・Building and operating data pipelines (ETL/ELT): Implementing efficient data processing jobs using PySpark, Databricks SQL, and Databricks Workflows ・Data modeling in Lakehouse: Designing and developing Silver (cleansing) and Gold (business mart) layers based on the medallion architecture ・BI migration and dashboard enhancement: Promoting migration from existing BI to Databricks AI/BI (Dashboards), and optimizing and tuning query performance using Databricks SQL ・Data governance and metadata management: Developing data catalogs using Unity Catalog and managing access permissions appropriately ・Data utilization control and support: Developing usage documentation for developed data marts and formulating development standards and operational rules for internal data analysts

Required skills

• Practical experience with Databricks (experience using Delta Lake, Unity Catalog, Databricks SQL, etc.) • Experience developing and operating data processing pipelines on a cloud environment (AWS, Azure, or GCP)

Welcome skills

• Experience or understanding of designing data marts (such as Star Schema) and data modeling in DWH/data lake environments. • Experience with data modeling and building CI/CD environments using dbt (data build tool). • Experience building dashboards and designing data sources using Databricks AI/BI or any other BI tool. • Experience processing spatial data. • Experience with system collaboration and requirements definition with other system development teams or data science teams.

Desired candidate profile

・Someone who enjoys communicating with other departments and external stakeholders. ・Someone who can not only collect data but also pursue "how the data will be used" and "how to design queries to speed up execution." ・Someone who takes responsibility for data integrity, quality, and governance (security), and can diligently refine the infrastructure. ・Someone who can smoothly collaborate and reach consensus with other departments and stakeholders such as data analysts.

Application Overview

salary

Expected annual salary: ¥5,410,000 - ¥7,300,000 Standard annual salary (excluding overtime pay): ¥4,680,000 - ¥6,750,000 Base salary: ¥255,000 - ¥380,000 Bonus: Based on performance evaluation, approximately 6 months' worth of base salary per year Overtime pay: Paid separately according to hours worked (Expected annual salary is based on 30 hours of overtime per month)

Work place

[Head Office] 35th Floor, Tokyo Port City Takeshiba Office Tower, 1-7-1 Kaigan, Minato-ku, Tokyo [Satellite Office] WeWork Hareza Ikebukuro, 20F, Hareza Tower, 1-18-1 Higashi-Ikebukuro, Toshima-ku, Tokyo

Employment type

full-time employee

Work system

[Work Style] ■ Super flexible (no core time, 7:00-22:00) ■ One day in the office per week, remote work possible for the rest of the time [Allowances] ■ Commuting allowance [Insurance] ■ Comprehensive social insurance [Holidays and Leave] ■ Complete two-day weekend (Saturday and Sunday) ■ National holidays ■ Year-end and New Year holidays ■ Annual paid leave (granted from the first day of employment) ■ Special paid leave ■ Bereavement leave ■ Maternity leave ■ Childcare leave *Men have taken this leave before and after childcare ■ Refreshment leave (after 5 years of service)

trial period

Yes (for 3 months, no change in conditions)

Employee benefits

■ Benefit One (Free Netflix, discounts on restaurants, theme parks, etc.) ■ Unlimited rides with HELLO CYCLING/HELLO MOBILITY ■ Company library (Company-funded purchase of books necessary for work, shared within the company after reading) ■ Congratulatory and condolence payments (Wedding bonuses, birth bonuses, etc.)