Responsibilities

• Performing data quality, profiling and validation on data sets
• Developing distributed data processing pipelines and applications
• Handling data issues of both structured and unstructured data sets
• Troubleshooting and root cause analysis on data pipelines
• Monitoring data quality and stability
• Effectively contribute to both data consumption data storage environment
• Collaborate with data science and business intelligence teams for analytical solutions
• Ensuring the transfer of experience within the team
• Coordinate and lead junior/mid data engineers
• Effectively contribute to technical decisions about data architectures and pipelines
• Research best practices for data pipelines