Role Overview We are seeking an experienced Software Developer to design, build, and support scalable backend services and distributed data-processing solutions. The role combines .NET-based API development with Python and PySpark engineering across Apache Spark, Hadoop-YARN, Trino, Delta Lake, Docker, PostgreSQL, and Linux environments. The successful candidate will translate business and reporting requirements into secure, maintainable, production-ready solutions and contribute to performance, reliability, and platform scalability.

• ResponsibilitiesDesign, develop, test, deploy, and maintain backend services using C#, .NET Core, and ASP.NET Web API.
• Build secure, reliable RESTful APIs that expose processed reporting data and integrate application and data platforms.
• Develop and optimize high-volume reporting and data-processing pipelines using Python, PySpark, and Apache Spark.
• Implement data transformation, validation, reconciliation, and error-handling controls to support accurate, dependable outputs.
• Work with Spark in standalone and cluster modes, including driver and executor behavior, resource allocation, job execution, and performance tuning.
• Contribute to scalable Hadoop-YARN architectures and support the migration or improvement of distributed workloads.
• Use Trino for distributed SQL processing and Delta Lake / Delta Parquet for efficient storage, querying, and data management.
• Package and deploy Spark, Trino, and related services using Docker; maintain consistent configuration across environments.
• Deploy, monitor, and troubleshoot workloads in production Linux environments, including job scheduling through cron and crontab.