JOB DESCRIPTION:

• Responsible for designing and building data pipelines.
• Designing and implementing solutions and developing applications utilizing airflow, dataflow, Apache beam, snowflake or GCP components.
• Reading, extracting, transforming, staging, and loading data to multiple targets, using Hadoop, Hive, Snowflake, BigQuery, and Cloud Storage.
• Migrating existing data processing from standalone or legacy technology scripts to distributed framework processing.
• Working with gigabytes/terabytes of data and dealing with the challenges of transforming and enriching such large datasets.
• Utilizing Google Cloud Platform and strong big data technology foundation
• Designing and Architecting data model to modernize legacy data warehouses.
• Writing ELT jobs using DBT to maintain data lineage and data auditability.
• Designing architecture of CI/CD pipelines to perform continuous build and isolate multiple environments.

EXPERIENCE/QUALIFICATIONS

• Master’s or foreign academic equivalent in Business Analytics, Computer Science, Statistics, Data Science or any related field plus one (1) year of experience. Location: Northridge, CA, telecommuting permitted, HQ in Naperville, IL. Approx. 25% domestic travel required. Travel Expenses to be paid by employer. One year of experience with Hadoop, Spark, Pig, Hive, Snowflake, BigQuery, Kubernetes, and Dataflow required.
  SALARY: $116,334 per year
  BENEFITS: Medical Insurance, Dental, Life Insurance, Paid Time Off, 401(k)
  WHERE TO APPLY: SpringML, Inc. dba Egen Solutions, 40 Shuman Blvd, Suite 204, Naperville, IL;
  Email: hr@egen.ai

Please refer the Job description for details