Big data Enginee at Consort Group

Lisbon, , Portugal -

Full Time

Start Date

Immediate

Expiry Date

30 Jun, 26

Salary

0.0

Posted On

01 Apr, 26

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, SQL, PySpark, Hive, Hadoop, Dataiku DSS, Data Engineering, Data Quality, Financial Data, Credit Risk, Stress Testing

Industry

IT Services and IT Consulting

Description

Every moment counts. Especially those you live to the fullest. Welcome to Consort Group. For over 30 years, Consort Group has been helping companies leverage their data and infrastructure. It is backed by two leaders, Consortis and Consortia, and places people and social responsibility at the heart of its values. This is your future team Established in 2021, Consort Portugal supports the strategic offshoring choices of our clients, particularly in Europe, and brings our expertise in infrastructure services to the Portuguese market. With a team of around 45 employees, our Service Center based in Porto is developing a dynamic nearshore business, offering the French and European markets an environment of excellence and high potential. Big data Enginee This is your mission Are you passionate about data engineering, large-scale data processing, and financial analytics? Then this position is for you. As a Big Data Engineer, you will be responsible for developing and maintaining large-scale data pipelines and supporting advanced financial stress-testing processes in our ecosystem. Build side: Develop and maintain data pipelines in a Big Data environment to support financial data processing. Implement data ingestion, preparation, and transformation workflows using modern data tools. Contribute to the design and optimization of large-scale datasets used for financial modelling and simulations. Collaborate with international teams to build robust and scalable data processing solutions. Ensure data quality, consistency, and traceability within the data lifecycle. Run side: Manage data collection, ingestion, and preparation processes using Big Data technologies. Perform data cleaning, transformation, and consolidation using tools such as Dataiku DSS, PySpark, Hive, and Hadoop. Monitor and improve data quality frameworks and validation processes. Contribute to the maintenance and testing of data processing workflows supporting financial analytics. Support quarterly data production cycles used for risk and financial stress-testing exercises. This is your background You have a first professional experience or academic background in data engineering, data science, or software development within data-driven environments. You enjoy working with large datasets, building efficient data pipelines, and solving complex data processing challenges. You are looking for an environment where you can develop your technical skills while contributing to strategic financial data platforms used in large-scale analytical exercises. This is your career path. You have a strong interest in Big Data technologies and data engineering practices. You enjoy working with complex datasets, understanding financial data structures, and contributing to large-scale analytical platforms. You are looking for an environment where you can grow your expertise in data engineering while collaborating with international teams on high-impact data projects. This is your expertise: Technologies & tools (within an Agile, DevOps, Data team): Python for data processing SQL for data querying and transformation PySpark for large-scale distributed data processing Hive / Hadoop ecosystem Dataiku DSS (Data Science Studio) for data preparation and analytics Knowledge of data engineering principles and data quality frameworks An understanding of financial data, credit risk concepts, or stress-testing models is considered a plus. This is how you work as part of a team: Team player with strong collaboration mindset Client-oriented and proactive attitude Strong autonomy and adaptability in dynamic environments High ethical standards and reliability Results-driven mindset with strong attention to quality Language Skills : English: C1 Portuguese: B2 This is our commitment At Consort Group, you are an expert who we support so that every assignment becomes a step that counts. Attentive and human onboarding A truly hands-on management style Continuous training opportunities Concrete commitments: inclusion, equality, solidarity A comprehensive HR package: health insurance, TR card, CSE, pension plan A culture of feedback and meaningful projects The recruitment process: An initial phone call with our recruitment team An HR interview and a job interview with a business engineer A test or technical interview with one of our experts A final meeting with your future manager or project manager And if we're a good fit, we'll get started together Good to know Location: Lisbon Contract: Permanent contract Remote work: Hybrid Job category: Data Engineering / Big Data / Data Platforms What you will do here, you won't do anywhere else. This moment is yours.

Responsibilities

As a Big Data Engineer, you will develop and maintain large-scale data pipelines and support advanced financial stress-testing processes. You will collaborate with international teams to build robust data processing solutions and ensure data quality throughout the data lifecycle.