Data Platform Architect at PRODAPT NORTH AMERICA INC

Chennai, tamil nadu, India -

Full Time

Start Date

Immediate

Expiry Date

15 Mar, 26

Salary

0.0

Posted On

15 Dec, 25

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Software Engineering, Architectural Design, Data Ingestion, Data Processing, Data Storage, Data Consumption, Apache Spark, Kubernetes, Object Storage, Apache Iceberg, Delta Lake, Hudi, Data Governance, Batch Processing, Stream Processing, Infrastructure as Code

Industry

technology;Information and Internet

Description

Overview Data Platform Architect Responsibilities Key Responsibilities Architectural Vision & Strategy: Design and own the end-to-end architecture for our data platform, encompassing data ingestion, processing, storage, and consumption layers. System Design: Create detailed architectural diagrams, design documents, and technical specifications for new platform capabilities. Define the standards for how services interact. Technology Evaluation & Governance: Research, evaluate, and prototype new technologies (e.g., table formats, query engines, streaming platforms). Establish and govern technical standards and best practices across all data engineering teams. Cross-Functional Leadership: Collaborate with engineering leaders, product managers, data scientists, and business stakeholders to ensure the platform architecture meets current and future needs. Act as the key technical advisor for all things data. Non-Functional Requirements: Drive the strategy for key architectural concerns, including scalability, security, data governance, performance, and cost optimization. Prototyping & Frameworks: Develop proof-of-concepts and foundational frameworks that engineering teams can build upon, ensuring architectural principles are correctly implemented Requirements Required Qualifications 10+ years of software engineering experience, with at least 4 years in a dedicated Architect role. Proven experience designing and architecting large-scale, distributed data systems from the ground up. Deep expertise in the modern data stack, including deep knowledge of Apache Spark, Kubernetes, and object storage systems like MinIO or S3. Extensive experience with open table formats like Apache Iceberg, Delta Lake, or Hudi, and a strong understanding of their internal workings. Demonstrated ability to think strategically, influence without authority, and communicate complex technical concepts to both technical and non-technical audiences. Experience creating formal architectural artifacts (e.g., ADRs, design docs, sequence diagrams). Preferred Qualifications Experience designing multi-tenant data platforms. Expertise with interactive MPP query engines like Trino or Presto. Knowledge of data governance and data cataloging solutions. Experience with both batch and stream processing architectures (e.g., Kafka, Flink). Familiarity with Infrastructure as Code (Terraform, Pulumi).

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

The Data Platform Architect is responsible for designing and owning the architecture of the data platform, including data ingestion, processing, storage, and consumption. They will also collaborate with various stakeholders to ensure the architecture meets current and future needs.