Azure Data Engineer with DevSecOps

at  Luxoft

PROJECT DESCRIPTION

We are seeking a highly skilled Azure Data Engineer with DevSecOps experience to join our team. The ideal candidate will have strong expertise in Azure cloud services, data engineering, and DevSecOps practices, with a focus on automation, security, and the full software development lifecycle. You will be responsible for developing, maintaining, and optimizing data pipelines and infrastructure on Azure, ensuring security and best practices are implemented across all aspects of development and deployment.

SKILLS

Must have
5+ years of experience in Data Engineering and DevSecOps with strong expertise in Azure cloud services.
Proficiency in Python, Spark, and experience with Databricks.
Hands-on experience with CI/CD tools such as Azure DevOps, Jenkins, SonarQube, and GitHub.
Experience in process automation using YAML scripting, Shell scripting, and Python.
Strong understanding of Azure IaaS/PaaS services and networking concepts.
Familiarity with DevSecOps tools and practices, particularly in security monitoring, logging, and alerting.
Experience working with Linux (RHEL) and Windows systems.
Experience in JIRA or other ticketing systems like ServiceNow.
Nice to have
Experience with Docker, Kubernetes, and Ansible for automation and container orchestration.
Knowledge of Azure Service Bus, Azure Functions, and Azure Monitor.
Associate-Level Public Cloud Certifications (Azure preferred).
Previous experience supporting Cloud Migration projects.
Knowledge of Scaled Agile Framework (SAFe) methodologies.

Design, develop, and maintain scalable data pipelines and architectures on Azure using services like Databricks, Azure Data Factory (ADF), Blob Storage, and Azure Machine Learning.
Build and optimize CI/CD pipelines using tools such as GitHub Actions, Jenkins, and Azure DevOps.
Implement DevSecOps practices including security monitoring, logging, and alerting to ensure secure data operations.
Integrate SonarQube/AquaSec and other DevSecOps tools into the continuous integration and deployment processes.
Automate processes using YAML scripting, Python, and Shell scripting.
Collaborate with development, data, and security teams to ensure seamless integration of DevOps practices across all projects.
Maintain and troubleshoot Linux-based and Windows systems (with a focus on RHEL).
Manage networking concepts and cloud infrastructure, including Virtual Networks, Firewalls, DNS, and Load Balancers.
Monitor performance and troubleshoot issues with cloud infrastructure using tools like PowerBI and Grafana.
Ensure compliance with Azure security standards and best practices.