Data Engineer - Python & AWS

at  Intone Networks

Data Engineer with AWS and Python Python Developer with AWS Project Details: • What does the End Goal look like? • What current phase are they in? • Tech stack of the environment? • Not project based/Ongoing need? You will be supporting a large initiative for Enterprise Data Services working with the Cargo Business Unit. You will be moving data sources to new tools, remapping and creating new tables, and using python and glue to manage the data. Must Haves / Required Skills: Python - Strong AWS skills: Glue, S3, eventbridge, airflow - Experience converting jobs from ETL to AWS - Native objects is a strong plus -PLSQL, complex SQL querying - AWS lambda - they use lambda, but glue is more important because it can carry a larger load of data - experience building ETL pipelines -Computer Science degree!! Qualifications: • Bachelor of Science degree in Computer Science or equivalent • At least 4-6 years of post-degree professional experience • At least 3 years of Airline industry experience • 2+ years development experience building and maintaining ETL pipelines • 2+ years of experience working with database technologies and data development such as Python, PLSQL, etc. • Experience in mentoring junior team members through code reviews and recommend adherence to best practices • Deep understanding of writing test cases to ensure data quality, reliability and high level of confidence • Track record of advancing new technologies to improve data quality and reliability • Continuously improve quality, efficiency, and scalability of data pipelines • Expert skills working with queries/applications, including performance tuning, utilizing indexes, and materialized views to improve query performance • Identify necessary business rules for extracting data along with functional or technical risks related to data sources (e.g. data latency, frequency, etc.) • Develop initial queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define a path to deployment • Familiar with best practices for data ingestion and data design• Bachelor of Science degree in Computer Science or equivalent • At least 4-6 years of post-degree professional experience • At least 3 years of Airline industry experience • 2+ years development experience building and maintaining ETL pipelines • 2+ years of experience working with database technologies and data development such as Python, PLSQL, etc. • Experience in mentoring junior team members through code reviews and recommend adherence to best practices • Deep understanding of writing test cases to ensure data quality, reliability and high level of confidence • Track record of advancing new technologies to improve data quality and reliability • Continuously improve quality, efficiency, and scalability of data pipelines • Expert skills working with queries/applications, including performance tuning, utilizing indexes, and materialized views to improve query performance • Identify necessary business rules for extracting data along with functional or technical risks related to data sources (e.g. data latency, frequency, etc.) • Develop initial queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define a path to deployment • Familiar with best practices for data ingestion and data desig

Please refer the Job description for details