POSITION OVERVIEW

We are looking for a Software Engineer who wants to learn and work with building modern data pipelines. The Data Software Engineer will be responsible for developing, implementing, and managing the Company’s data solutions on the Amazon Web Services (AWS) platform. This position will play a vital role in designing and building scalable data pipelines, optimizing data workflows, and ensuring the availability and integrity of our data infrastructure.

QUALIFICATION REQUIREMENTS

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Must be at least 21 years of age.

• Bachelor’s degree in computer science or related field, or equivalent work experience and/or equivalent combination of education and experience
• At least three (3) years experience in software engineering, with demonstrated experience in CI/CD principles.
• Experience in monitoring and alerting of integrated systems, using tools such as Grafana and PagerDuty.
• Experience with Agile software development methodologies
• Experience with data orchestration and workflow management tools such as Apache Airflow and Git
• Excellent problem-solving and critical thinking skills
• Must be willing and able to work a flexible schedule to include holidays, nights, and weekends
• Work in a fast-paced, busy, and somewhat stressful environment

PREFERRED SKILLS

• Data engineering experience, with a demonstrated track record of deploying and supporting complex solutions.
• Proficiency in AWS services such as Glue, Macie, S3, Redshift, and Databricks / Snowflake.
• Strong programming skills in languages including Python, SQL. Experience with C# or Java is a plus.
• Experience with data modeling, ETL/ELT processes, and data integration techniques and tools
• Knowledge of data governance, data quality, and data security principles

LANGUAGE SKILLS

Ability to read and interpret documents in English, such as safety rules, operating and maintenance instructions, and procedure manuals. Ability to read and communicate verbally in English. Written communication skills in English may also be required.

ESSENTIAL DUTIES AND RESPONSIBILITIES

The following and other duties may be assigned as necessary:

• Collaborate with product leads and stakeholders analyze user requirements, identify functional and non-functional needs, and translate them into technical specifications.
• Interpret and contribute to data pipeline architecture, including component breakdown, data flow, and system interactions, considering scalability, performance, and maintainability.
• Write clean, efficient, and well-documented code (SQL, Python, PySpark) and frameworks, adhering to coding standards and best practices.
• Conduct thorough unit testing to ensure code quality, identify bugs, and implement necessary fixes.
• Integrate work product into the overall system, perform system testing, and validate upon deployment into UAT and PROD environments.
• Monitor data platform performance, address production issues, implement bug fixes, and provide ongoing maintenance and support.
• Create and maintain technical documentation, including design documents, data catalogs, data lineage, and data quality.
• Work effectively within cross-functional teams, product leads, and other engineers to deliver work on time and with appropriate scope & quality.
• Stay current on emerging technologies, explore new development tools and methodologies to optimize software development processes.
• Continuously identify and implement opportunities for automation, optimization, and streamlining of data engineering processes

SUPERVISORY RESPONSIBILITIES

This position does not have supervisory responsibilities.

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Must be at least 21 years of age.

• Bachelor’s degree in computer science or related field, or equivalent work experience and/or equivalent combination of education and experience
• At least three (3) years experience in software engineering, with demonstrated experience in CI/CD principles.
• Experience in monitoring and alerting of integrated systems, using tools such as Grafana and PagerDuty.
• Experience with Agile software development methodologies
• Experience with data orchestration and workflow management tools such as Apache Airflow and Git
• Excellent problem-solving and critical thinking skills
• Must be willing and able to work a flexible schedule to include holidays, nights, and weekends
• Work in a fast-paced, busy, and somewhat stressful environmen