Software Engineer at Exigo Tech
Victoria, Victoria, Australia -
Full Time


Start Date

Immediate

Expiry Date

08 Feb, 27

Salary

50000.0

Posted On

10 Nov, 26

Experience

6 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Yes

Skills

Industry

Information Technology & Services

Description

Role OverviewWe are seeking an experienced Software Developer to design, build, and support scalable backend services and distributed data-processing solutions. The role combines .NET-based API development with Python and PySpark engineering across Apache Spark, Hadoop-YARN, Trino, Delta Lake, Docker, PostgreSQL, and Linux environments. The successful candidate will translate business and reporting requirements into secure, maintainable, production-ready solutions and contribute to performance, reliability, and platform scalability.

  • ResponsibilitiesDesign, develop, test, deploy, and maintain backend services using C#, .NET Core, and ASP.NET Web API.
  • Build secure, reliable RESTful APIs that expose processed reporting data and integrate application and data platforms.
  • Develop and optimize high-volume reporting and data-processing pipelines using Python, PySpark, and Apache Spark.
  • Implement data transformation, validation, reconciliation, and error-handling controls to support accurate, dependable outputs.
  • Work with Spark in standalone and cluster modes, including driver and executor behavior, resource allocation, job execution, and performance tuning.
  • Contribute to scalable Hadoop-YARN architectures and support the migration or improvement of distributed workloads.
  • Use Trino for distributed SQL processing and Delta Lake / Delta Parquet for efficient storage, querying, and data management.
  • Package and deploy Spark, Trino, and related services using Docker; maintain consistent configuration across environments.
  • Deploy, monitor, and troubleshoot workloads in production Linux environments, including job scheduling through cron and crontab.
  • Technical SkillsCore programming : C#, Python, SQL; C++ exposure is advantageous
  • Backend engineering : .NET Core, ASP.NET Web API, RESTful APIs, clean architecture principles
  • Data and distributed systems : Apache Spark, PySpark, Hadoop, YARN, Trino, Delta Lake / Delta Parquet
  • Infrastructure and operations : Docker, Linux (Ubuntu), cron / crontab, Spark cluster configuration and deployment
  • Database : PostgreSQL
  • Additional exposure : Angular, Unity (C#), or Unreal Engine (C++) is advantageous but not essential


Responsibilities
Loading...