Data Engineer Sr at PALO IT

, , Mexico -

Full Time

Start Date

Immediate

Expiry Date

29 Jan, 26

Salary

0.0

Posted On

31 Oct, 25

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Big Data, Hadoop, Spark, Python, Apache Airflow, Data Quality, Data Security, Data Governance, Relational Databases, Non-relational Databases, Agile, Debugging, Troubleshooting, Data Reliability, ELK

Industry

IT Services and IT Consulting

Description

Who We Are Build. Scale. Sustain. PALO IT is a global technology consultancy that crafts tech as a force for good. We design, develop and scale digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We do the right thing, and we do it right. We're proud to be a World Economic Forum New Champion, and a B Corp-certified company. We are small enough to care locally, big enough to deliver globally (5 continents, 18 offices, +650 experts from +50 nationalities) We are robust and resilient (100% independent and 0 debt) We are entrepreneurs and passionate experts: We invest in what we believe genuinely and work as a collective intelligence We are positive, courageous, caring, doers and committed to excellence About Gen-e2 While the market is still largely AI-augmenting delivery, we have reinvented the SDLC to be AI First. Our approach is a game-changer in productivity and quality, with a strong collaboration between IA generative and our best Talents: We now generate 95% of the entire product — code, documentation, infrastructure as code, and even design — with GitHub Copilot. The quality consistently exceeds the output of our best traditional engineering teams. A product repository houses all product artefacts, giving AI full project context for higher-quality generation. A library of rules and prompts defines coding standards, design principles, and security guidelines, ensuring enterprise-grade quality and scalability. With Gen-e2, we deliver end-to-end products 2–3× faster than traditional approaches, while raising the bar for engineering excellence. Your Role As a Data Engineer, your mission is to fuel a data-driven culture across the organization by designing scalable pipelines, transforming raw data into actionable insights, and empowering decision-makers with robust platforms. Design, develop, and maintain data pipelines on our Big Data platform. Integrate and manage large datasets from multiple structured and unstructured sources. Optimize batch and real-time data processing using Hadoop, Spark, and Python. Implement and maintain workflow orchestration using Apache Airflow. Ensure data quality, security, and governance across the pipeline. Collaborate with Decision Science, engineering, and product teams to deliver data solutions that support experimentation and machine learning. Document data architectures, transformation logic, and process flows. Who You Are Degree in Computer Science, Computer Engineering, or a related field. Proven experience in Big Data tools and frameworks: Hadoop, Sqoop, Spark, Airflow, Hive. Strong hands-on skills with Python and working knowledge of Avro. Solid understanding of relational (Oracle, PostgreSQL) and non-relational databases. Familiar with log monitoring stacks such as ELK. Comfortable working in Agile environments and collaborating across diverse teams. Adept at debugging, troubleshooting, and ensuring data reliability at scale. B2 level of English or higher. Nice to Have Experience in technology consulting firms or large-scale data-driven projects. Familiarity with CI/CD pipelines and project management tools. More About PALO IT We’re eager to adapt to change, learn from our experiences and move to meet our planet’s urgent needs. We are continuously taking action to: Become a climate net-zero company Deliver projects with a positive impact Train 100% of our workforce on impact Achieve B Corp certification among all our offices across the globe Continuously measure & improve employee happiness Our clients are amongst the world's most successful companies. We innovate with both established Fortune 1000s, SMEs and start-ups who aim to make an impact, become global leaders and address the world's most complex challenges. What We Offer Stimulating working environments Unique career path International mobility Internal R&D projects Knowledge sharing Personalized training Entrepreneurship & intrapreneurship For more on our team culture and benefits: Check out our careers page. And our PALOCast with direct testimonies from our Palowans! PALO IT is an equal opportunity employer that values merit, qualifications, and abilities. We prioritize privacy and data security. For more information on our privacy practices, please refer to our Privacy Policy.

Responsibilities

As a Data Engineer, you will design, develop, and maintain data pipelines on our Big Data platform while integrating and managing large datasets from multiple sources. Your role will also involve optimizing data processing and ensuring data quality and governance across the pipeline.