Data Engineer (IGT1 Lanka: Sitecore) at IFS NORTH AMERICA INC

Colombo, Western Province, Sri Lanka -

Full Time

Start Date

Immediate

Expiry Date

11 Feb, 26

Salary

0.0

Posted On

13 Nov, 25

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, ETL, Big Data, Elasticsearch, SQL, Hadoop, Spark, Python, Java, NoSQL, Microservices, Agile, CI/CD, AWS, Azure, Airflow

Industry

Software Development

Description

Company Description About IGT1 Lanka IGT1 Lanka is a rapidly growing offshore technology and talent solutions company based in Port City Colombo. We are a fully owned subsidiary of IGT I Holdings Sweden AB, funded by the three of world’s leading private equity firms; EQT Group, Hg, and TA Associates. We’re also proud to be a sister company of IFS, Sri Lanka’s largest and most established technology company. At IGT1 Lanka, we partner with global businesses to scale operations, accelerate innovation, and build world-class SaaS platforms through high-quality offshore delivery. Our people-first culture champions diversity, teamwork, and continuous learning, creating an environment where talent thrives. With a team of over 400 professionals and counting, we are always looking for passionate, skilled individuals who want to make a global impact while being part of something extraordinary. Through our offshore collaboration model, you'll be embedded within the team of one of our esteemed international clients, contributing directly to high-impact, enterprise-level initiatives. About the client: Sitecore At Sitecore, their mission is to simplify how brands reach, engage, and serve people by delivering intelligent, personalized digital experiences that connect the world. They empower the world’s most iconic brands to build lifelong relationships with their customers seamlessly, smartly, and at scale. As the leading provider of agentic digital experience software, Sitecore brings together content, commerce, and data into one composable platform that enables brands to deliver millions of meaningful, adaptive experiences every day. Trusted by global leaders such as American Express, Porsche, Starbucks, and L’Oréal, Sitecore helps brands transform engagement through experiences that are not only personalized but predictive and dynamic. Job Description About the role: We are looking for a Data Engineer to join Sitecore's Data Platform group. In this position, you will work in a small, dynamic team to build data infrastructure and manage the overall data pipeline. You will be responsible for expanding and optimizing data and data pipeline architecture, as well as optimizing dataflow and collection of data from cross functional teams. Key Responsibilities Design, develop, and maintain a generic ingestion framework capable of processing various types of data (structured, semi-structured, unstructured) from customer sources. Implement and optimize ETL (Extract, Transform, Load) pipelines to ensure data integrity, quality, and reliability as it flows into the centralized datastore like Elasticsearch. Ensure the ingestion framework is scalable, secure, efficient and capable of handling large volumes of data in real-time or batch processes. Continuously monitor and enhance the data ingestion process to improve performance, reduce latency, and handle new data sources and formats. Develop automated testing and monitoring tools to ensure the framework operates smoothly and can quickly adapt to changes in data sources or requirements. Provide documentation, support, and training to other team members and stakeholders on using the ingestion framework. Implement large-scale near real-time streaming data processing pipelines. Design, support and continuously enhance the project code base, continuous integration pipeline, etc. Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics. Perform POCs and evaluate different technologies and continue to improve the overall architecture. Qualifications Preferred Skills and Experience 6-24 months experience building and optimizing Big Data pipelines, architectures and data sets. Experience in Elasticsearch, its architecture and optimal querying of data. Strong analytic skills related to working with unstructured datasets. Experience supporting and working with cross-functional teams in a dynamic environment. Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data systems. Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems. Candidates must have 6-24 months of experience in a Data Engineer role with a Bachelors or Masters Degree in Computer Science or Information Systems or equivalent field. Candidate should have knowledge of using following technologies/tools: Experience working on Big Data processing systems like Hadoop, Spark, Spark Streaming, or Flink Streaming. Experience with SQL systems like Snowflake or Redshift Experience in two or more of these integration technologies; Java/Python, React, Golang, SQL, NoSQL (Mongo), Restful API. Versed in Agile, APIs, Microservices, Containerization etc. Experience with CI/CD pipeline running on GitHub, Jenkins, Docker, EKS. Knowledge of at least one distributed datastores like MongoDb, DynamoDB, HBase. Experience using batch scheduling frameworks like Airflow (preferred), Luigi, Azkaban etc is a plus. Experience with AWS or Azure cloud services: Additional Information We embrace flexibility and hybrid work opportunities to support diverse needs and lifestyles, while also valuing inclusive workplace experiences. By fostering a sense of community, we drive innovation, strengthen connections, and nurture belonging. Our commitment ensures you can work in a way that suits you best, while also engaging with colleagues to share ideas and build meaningful relationships. #Li-Hybrid

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

The Data Engineer will design, develop, and maintain a generic ingestion framework for processing various types of data from customer sources. Responsibilities include optimizing ETL pipelines and ensuring data integrity and reliability.