AWS Data Engineer

at  eMerge IT Recruitment

An information technology and business consulting company that provides highly specialised solutions to large and small enterprises in both the private and public sectors seeks a highly motivated and experienced AWS Data Engineer to join their Global Markets division. In this role, you will work closely with our traders, quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business. The ideal candidate should have a strong background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs using PySpark or AWS Glue Spark.

EXPERIENCE AND QUALIFICATIONS:

• Bachelor’s degree in Computer Science, Information Systems, or related field.
• AWS Certified Machine Learning – Specialty Certificate
• Must have experience with AWS Glue Jobs using PySpark or AWS Glue Spark
• 5 Years Python/C# Development
• 3 Years AWS Data Engineering
• Strong SQL and C# or Python programming knowledge
• Objective oriented principles in C# or Python
• AWS technical certifications (Developer Associate or Solutions Architect)
• services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM)
• Experience working with RDBMS databases, such as Postgres, SQL Server
  The Reference Number for this position is NG58761 which is a Permanent Hybrid position based in Johannesburg offering a cost to company salary negotiable from R500k to R650k Per Annum based experience and ability. Contact Nokuthula at nokuthulag@ e-merge.co.za or call her on 011 463 3633 to discuss this and other opportunities.
  Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website www.e-merge.co.za for more great positions.
  Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals

• Creating data models that can be used to extract information from various sources
• Lead the design, implementation, and successful delivery of large-scale, critical, or

difficult data solutions involving a significant amount of data

• Utilise expertise in SQL and have a strong understanding of ETL and data modelling
• Ability to ingest data into AWS S3, perform ETL into RDS or Redshift
• Use AWS Lambda (C# or Python) for event-driven data transformations
• Designing and implementing security measures to protect data from unauthorized

access or misuse

• Maintaining the integrity of data by designing backup and recovery procedures
• Work on automating the migration process in AWS from development to production