High Performance Computing (HPC) Storage Engineer

at  Hudson River Trading

The Research & Development team at Hudson River Trading (HRT) builds and maintains the computers, networks, data storage, operating systems, and software that allow our trading strategies and research environment to operate worldwide 24/7. We are looking for an experienced Storage Engineer who enjoys being challenged, appreciates an open and collaborative organizational structure, and thrives in a fast-paced environment.
In this role, you will take over the management of our existing storage infrastructure and be responsible for the design, automation, and management of future storage solutions to support our large-scale research environment. This is an exciting opportunity to join a small team focused on HPC storage and help set the direction for storage solutions at HRT. You’ll have plenty of freedom to research, propose, and test new hardware and software to improve the performance and usability of our research environment.

QUALIFICATIONS

• Expertise with enterprise storage solutions such as NetApp and Isilon
• 5+ years of experience in HPC-like environments with large scale storage deployments greater than 1PB
• Extensive experience with Linux troubleshooting and NFS
• Strong knowledge of Linux software RAID, ZFS, and other Linux filesystems
• Proficient Python and shell scripting
• Knowledge of distributed file systems used for large-scale cluster computing (Lustre, CephFS, GPFS, etc.) is a plus
• Strong communication skills
• Ability to analyze and solve problems under quick turnaround times
• Ability to manage time efficiently, balancing independent and collaborative workflows
• Eager to learn and apply new skills quickly

• Design and manage a variety of storage solutions
• Research and experiment with new storage solutions
• Troubleshoot complex storage, OS, and networking issues
• Build tools to improve the performance and monitoring of storage clusters