JOB DESCRIPTION

We are seeking a Systems Engineer to assist with strategic planning and oversee implementation of the sponsor’s cloud-based data environment. The Sponsor supports analysts through the provision of large datasets, methodologies, and data visualizations to address pressing intelligence questions. The Sponsor requires support developing and maintaining a cloud-based data environment to transport, store, extract, transform, and load (ETL), and disseminate data solutions. The Sponsor needs experienced support in data engineering, cloud architecture, and application development. The work includes engaging regularly with data scientists, analysts, and managers. You will assist with strategic planning and oversee implementation of the Sponsor’s cloud-based data environment, to include mapping of data sources and access controls. You will develop code, data models, and documentation to Sponsor standards; provide systems administration and programming support for ETL processes and data infrastructure efforts; and train and conduct knowledge transfer to team members on issues and technologies related to Sponsor ETL process, on premise high capacity compute cluster, and administrative duties. You will coordinate with external data and platform providers to ensure the smooth functioning of the Sponsor’s systems and data flows, and to accomplish any needed changes and coordinate with experts to assist with technical aspects required to acquire new datasets or data management technologies for inclusion in the Sponsor’s environment. You will also support the cross-domain transfer and integration of data.
,

REQUIRED SKILLS

• Experience serving as a technical liaison between system engineers, data engineers, data scientists, analysts, and non-technical managers and personnel
• AWS cloud services, including long-term storage options, and cloud-based database services such as Databricks or Elastic MapReduce (EMR)
• SQL database structures and mapping between SQL databases
• Demonstrated experience in large-scale data migration efforts
• Database architecture, performance design methodologies, and system-tuning recommendations
• Familiarity with Glue, Hive, and Iceberg or similar
• Demonstrated experience with Python, Bash, and Terraform
• DevSecOps solutions and tools
• Implementing CI/CD pipelines using industry standard process
  ,

DESIRED SKILLS

• Demonstrated experience with the Sponsor’s data environment and on-premises compute structure
• Experience with Data Quality and Data Governance concepts and experience
• Knowledge of maintaining, supporting, and improving the ETL process through the implementation and standardization of data flows with Apache Nifi and other ETL tools
• Apache Spark
• Experience with the Sponsor’s data environment and on-premises compute structure
  ,

Please refer the Job description for details