Senior Data Engineer LatAm
at Provectus
Remote, , Costa Rica -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 19 Jan, 2025 | Not Specified | 20 Oct, 2024 | 5 year(s) or above | Python,English,Airflow,Real Time Data,Communication Skills,Data Engineering,Aws,Sql,Apache Spark | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
Join us at Provectus to be a part of a team that is dedicated to building cutting-edge technology solutions that have a positive impact on society. Our company specializes in AI and ML technologies, cloud services, and data engineering, and we take pride in our ability to innovate and push the boundaries of what’s possible.
We are seeking a talented and experienced Senior Data Engineer. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects, build internal solutions, and engage in R&D activities, providing an excellent environment for professional growth.
REQUIREMENTS:
- 5+ years of hands-on experience in data engineering, with a strong emphasis on Databricks and Apache Spark.
- Expertise in cloud platforms (AWS preferred, GCP, or Azure) preferably with relevant certifications.
- Proficiency with cloud data warehouse technologies (Snowflake/Redshift/Clickhouse).
- Proven experience in handling batch data workflows using Airflow or similar tools.
- Experience in handling real-time data using Kafka and streaming processing frameworks.
- Strong command of Python and SQL for building scalable and efficient data pipelines.
- Strong communication skills with the ability to collaborate effectively in English.
- Exceptional problem-solving skills and the ability to thrive in fast-paced environments.
Responsibilities:
- Collaborate with clients to understand their IT environments, applications, business requirements, and digital transformation objectives.
- Collect, process, and manage large volumes of structured and unstructured data from diverse sources.
- Work directly with Data Scientists and ML Engineers to design and maintain robust, resilient data pipelines that power Data Products.
- Define and develop data models that unify disparate data across the organization.
- Design, implement, and optimize ETL/ELT pipelines, ensuring scalability, performance, and maintainability.
- Leverage Databricks and Apache Spark to perform complex data transformations and processing.
- Build, test, and deploy scalable data-driven solutions in collaboration with cross-functional teams.
REQUIREMENT SUMMARY
Min:5.0Max:10.0 year(s)
Information Technology/IT
IT Software - DBA / Datawarehousing
Software Engineering
Graduate
Proficient
1
Remote, Costa Rica