Principal Engineer, AI System Architect at Samsung Semiconductor
San Jose, California, USA -
Full Time


Start Date

Immediate

Expiry Date

05 Jul, 25

Salary

341940.0

Posted On

05 Apr, 25

Experience

15 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Good communication skills

Industry

Information Technology/IT

Description

PLEASE NOTE:

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.

Responsibilities

WHAT YOU’LL DO

The Architecture Research Lab (ARL) is tackling two of the biggest challenges in AI today—memory bandwidth and communication bottlenecks. By leveraging Samsung’s world-leading memory technologies, we are developing next-generation AI systems that break through these limitations while improving developer productivity.

This effort spans:

  • Hardware: Memory, networking, compute, and power optimization.
  • Software: System software, frameworks, and runtime optimization.
  • Application & Performance Modeling: Developing tools to guide architectural decisions.

We are seeking an AI System Architect to help shape the future of AI systems through innovative system-level hardware design, performance modeling, and hardware/software co-design.
Location: Hybrid, working onsite at our San Jose office/headquarters 3 days per week with the flexibility to work remotely the remainder of your time
Job ID: 42536

KEY RESPONSIBILITIES

  • Architect next-generation AI systems to address modern AI challenges and achieve state-of-the-art system-level performance
  • Provide technical leadership, driving system component direction and selection in the area of the compute, memory and network topologies; analyze bottlenecks and come up with innovative solutions
  • Supervise the development and validation of analytical and simulation-based system models to project AI system performance.
  • Leverage modeling infrastructure for design space exploration and system-level optimization.
  • Collaborate effectively with other HW/SW architects, application experts, and performance modeling experts across sites and time zones
  • Occasional domestic and international travel (<10%).

    What You Bring

  • PhD in Computer Science, Electrical Engineering, or a related field with 15+ years of experience in system architecture for large-scale computing, with specific AI focus preferred.

  • Deep expertise in AI system design, and knowledges in LLMs, DLRMs, and other representative AI workloads.
  • Strong understanding of compute, memory, and networking bottlenecks in AI systems.
  • Proven experience in AI hardware architecture at both system and component levels.
  • Background in hardware/software co-design for AI systems.
  • Hands-on experience in developing analytical and event-driven simulation models.
  • Experience in ML compilers and runtime optimization preferred.
  • Familiarity with AI software stacks and frameworks preferred.
  • Strong leadership skills with a track record of setting technical direction and guiding teams.
  • Excellent verbal, presentation, and written communication skills.
  • A collaborative mindset, curiosity, and resilience in solving complex challenges.

LI-SF1

Loading...