Data Engineer

at  Edmentum

WHO WE ARE

Edmentum is a dynamic educator and student-focused company dedicated to tech-enabled learning solutions. Our goal is to ensure that all students have access to flexible learning environments and educators have the tools they need to support their students. We are on a mission to create innovative, proven learning technology, partnering with educators to ignite student potential. We are a Remote First organization with a strong commitment to excellence, innovation, and customer satisfaction.

EDUCATION AND EXPERIENCE

• Bachelor’s degree in Computer Science, Information Management Systems, or related field; or equivalent work experience.
• Programming Skills: 3+ years with Python and SQL, with 2+ years specifically using Spark (PySpark DataFrames).
• Data Engineering Experience:
• 2+ years with relational databases, such as SQL Server or Postgres.
• 1+ years with non-relational data lakes or warehouses (e.g., BigQuery, Snowflake, Databricks Delta Lake, or Redshift).
• Data Processing Tools:
• 1+ years with batch ETL tools (Databricks ETL preferred).
• 1+ years with streaming data tools (e.g., Kinesis, AWS Lambda).
• 1+ years managing complex data workloads with job administration and scheduling tools, such as Apache Airflow.

TECHNICAL SKILLS

• Software Engineering: Experience with Gitflow in multi-environment team deployments.
• Cloud Expertise: Proficiency with AWS data tools (preferred) including EMR, S3, EC2, Kinesis, and ECS.
• Databricks Tools: Familiarity with the Databricks platform, including Delta Lake and Unity Catalog.
• Proficiency in an additional programming language (e.g., C#, Scala, Java, Node.js).
• Foundational Knowledge: Understanding of Data Lake architecture patterns, cloud infrastructure, operations, and the software development lifecycle.

SOFT SKILLS AND COMPETENCIES

• Problem-Solving Skills: Strong critical-thinking abilities, capable of developing elegant solutions to complex data challenges.
• Communication Skills: Able to effectively articulate key considerations of complex technical topics, both verbally and in writing.
• Business Insight: Ability to understand business problems deeply and design data solutions that effectively address them.
• Ownership and Accountability: Demonstrated pride of ownership, ensuring high-quality solutions throughout their lifecycle.
• Team Collaboration and Ethics: Commitment to inclusion, integrity, cross-functional teamwork, and alignment with Edmentum’s mission and values.

• Design, develop, and implement scalable data pipelines to collect, connect, centralize, and curate data from diverse internal and external sources, ensuring seamless data flow throughout the ecosystem.
• Collaborate with a high-performing development team to build best-in-class data pipelines, contributing to key data initiatives that drive the data lake infrastructure in AWS.
• Create purpose-built data architecture solutions for data users, such as data marts, third-party integrations, and dimensional models, optimizing for efficient, flexible data consumption across the organization.
• Develop and maintain APIs, microservices, and related libraries that support core capabilities within our technology ecosystem, enabling targeted functionality and robust data interactions.
• Engage closely with data-focused colleagues in Application Development, Business Intelligence, Data Science, and Research to align data solutions with broader organizational goals and drive impactful data initiatives.