Senior UNIX Administrator

at  New York ISO

The New York Independent System Operator (NYISO) manages the efficient flow of electricity on more than 11,000 circuit-miles of high-voltage transmission lines, dispatching power from hundreds of generating units across the state.
The NYISO’s Information Technology department invites applications for a full-time Senior UNIX Administrator to join our Team.
The Senior UNIX Administrator is responsible for administering large, multi-site UNIX server environments and operating systems, software package installation, upgrades, system integrity, security, disaster recovery and performance. The Administrator will also maintain IT automation and cloud technologies. This position will adhere to server administration and user standards and procedures. This individual will lead or participate on project teams and collaborate with application developers and infrastructure peers as necessary. The Administrator will also perform backup and restoration procedures, support audit efforts and ensure compliance with corporate and regulatory standards; mentors and trains associate and UNIX Administrators; establishes and maintains working relationships with IT partners, business customers, and vendors. The successful candidate will ensure UNIX and Linux systems adhere to all established NYISO and regulatory (i.e. NERC CIP) standards and provide 24x7 technical support on a rotational basis.

QUALIFICATIONS:

• Bachelor’s Degree (BS), Computer Science, Information Systems, Red Hat Certified Engineer or greater, or similar technical program preferred.
• Seven years experience as a UNIX or Linux Server Administrator.

ADDITIONAL REQUIREMENTS

• Ability to read, analyze and interpret common scientific and technical journals, financial reports and legal documents. Ability to respond to common inquiries or complaints from members of the business community. Ability to speak effectively before other technical staff and stakeholders.
• Ability to define problems, collect data, establish facts and draw valid conclusions. Ability to interpret an extensive variety of technical instructions in mathematical or diagram form and deal with several abstract and concrete variables.
• Intermediate competency in Windows operating environment using MS Office applications, e-mail and Internet programs.
• Advanced hands-on experience with UNIX/Linux OS administration including IBM/AIX, HP/HP-UX, and RedHat/Linux systems, server virtualization technologies, server automation technologies and server clustering technologies.
• Thorough knowledge of advanced networking concepts, storage area networking concepts, file system management concepts, system backup concepts and hardware administration/support.
• Desirable competencies: Cisco UCS, VMware ESXi, VMware vCenter, Red Hat Satellite, Red Hat Ansible Tower, IBM Power VM and Veritas InfoScale.

• Performs advanced and/or highly complex work with minimal or no supervision. Establishes work plan for department based on organizational goals; sets independent objectives to accomplish specific tasks supporting the larger plan.
• Leads functional or virtual departmental or inter-departmental teams and demonstrates accountability for completion of team-wide objectives. Acts as key contributor and represents team for larger organizational teams; regularly interacts with peer departments, business partners, market participants, vendors, and other external constituents. Leads functional or virtual teams and demonstrates accountability for completion of team-wide objectives.
• Demonstrates the highest proficiency with assigned technology platforms and disciplines; has broad knowledge of ancillary information technologies, methodologies and platforms. Has broad knowledge of IT service management, governance, continuity, financial, project, and lifecycle management. Has basic understanding of the energy vertical, energy markets, the electric industry, and the NYISO’s business & operations.
• Represents the organization to external entities. May speak or present at external conferences and seminars or write papers and formal correspondence on behalf of the NYISO.
• Creates, installs, patches and upgrades UNIX, Linux and VMware operating systems and server software packages.
• Performs on-going performance tuning, hardware upgrades, and resource optimization.
• Leads and participates in capacity planning and system lifecycle management
• In partnership with other subject matter experts and our Business Continuity department, design, test and implement complex solutions that support high availability and inter-site and intra-site fail over capabilities. This includes a monthly review of recovery plans and yearly testing for cyber infrastructure protection (CIP) assets.
• Provisions and controls user permissions and privileges with strict adherence to access guidelines following SOC1 and CIP standards
• Due to the significance of the industry and the organization’s role within it, a rigorous change management process must be adhered to in order to minimize risks to the computing environment. Must demonstrate adherence to these processes. Subject matter experts are expected to champion their changes from initiation through deployment.
• Provides technical support to software development, infrastructure, IT operations and inter-departmental teams.
• Participates in and/or leads in-depth troubleshooting and root cause analysis in inter-disciplinary teams.
• Designs and maintains UNIX systems to adhere to all established NYISO and regulatory (i.e. NERC CIP, SOC1) standards. Requires ability to interpret and follow complex policies and procedures. Per compliance policies: maintain up to date written documentation, perform prescribed recovery tests, complete required paperwork and attestations. Subject matter expert is held accountable for adherence to these standards.
• Manages data and information requests to support internal and external audit requests. Audit requests are from external auditors as well as industry specific regulation agencies e.g. NERC, FERC. Investigate and resolve any compliance issue. Targeting zero deviations from the compliance policies and procedures.
• Provides 24x7 technical support on a rotational basis. Due to our industry, advanced troubleshooting skills and analytics are required to ensure production services are restored within very short timeframe. For example, some services require a restoration time within 30 minutes. Subject matter experts are expected to be available within five minutes.
• Mentors and trains associate and UNIX administrators.
• Establishes and communicates NYISO UNIX and Linux server standards and policies and procedures.
• Participates in on-going IT strategic planning with primary focus on UNIX and VMware server technologies.
• Leads and/or participates in system lifecycle management
• Participates in procurement activities and support contract management
• Leads and/or participates in license management and compliance
• Understands networking and storage technologies and participates in planning and troubleshooting network and storage services for Unix and VMware infrastructure
• Creates and maintains detailed documentation of Linux, Unix and VMware configurations and functions
• Familiarity with Microsoft Active Directory
• Establishes and maintains working relationship with key strategic vendors to understand technical direction of server technologies. Subject matter expert is responsible to identify correct hardware and software for NYISO requirements, then size, configure and implement the identified solution.
• Direct impact and responsibility for the organization’s security posture as related to system integrity and security. This includes zero-day analysis and response, advanced security system hardening knowledge and techniques, analysis and implementation of industry security protocols like CIS benchmarks. Subject matter expert is held accountable for adherence to all prescribed security standards and protocols
• Develop and champion innovative solutions that improve operational efficiency through the automation of administrative tasks necessary to maintain portfolio of infrastructure assets.