Senior Data Engineer LatAm

at  Provectus

Remote, , Costa Rica -

Start DateExpiry DateSalaryPosted OnExperienceSkillsTelecommuteSponsor Visa
Immediate19 Jan, 2025Not Specified20 Oct, 20245 year(s) or abovePython,English,Airflow,Real Time Data,Communication Skills,Data Engineering,Aws,Sql,Apache SparkNoNo
Add to Wishlist Apply All Jobs
Required Visa Status:
CitizenGC
US CitizenStudent Visa
H1BCPT
OPTH4 Spouse of H1B
GC Green Card
Employment Type:
Full TimePart Time
PermanentIndependent - 1099
Contract – W2C2H Independent
C2H W2Contract – Corp 2 Corp
Contract to Hire – Corp 2 Corp

Description:

Join us at Provectus to be a part of a team that is dedicated to building cutting-edge technology solutions that have a positive impact on society. Our company specializes in AI and ML technologies, cloud services, and data engineering, and we take pride in our ability to innovate and push the boundaries of what’s possible.
We are seeking a talented and experienced Senior Data Engineer. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects, build internal solutions, and engage in R&D activities, providing an excellent environment for professional growth.

REQUIREMENTS:

  • 5+ years of hands-on experience in data engineering, with a strong emphasis on Databricks and Apache Spark.
  • Expertise in cloud platforms (AWS preferred, GCP, or Azure) preferably with relevant certifications.
  • Proficiency with cloud data warehouse technologies (Snowflake/Redshift/Clickhouse).
  • Proven experience in handling batch data workflows using Airflow or similar tools.
  • Experience in handling real-time data using Kafka and streaming processing frameworks.
  • Strong command of Python and SQL for building scalable and efficient data pipelines.
  • Strong communication skills with the ability to collaborate effectively in English.
  • Exceptional problem-solving skills and the ability to thrive in fast-paced environments.

Responsibilities:

  • Collaborate with clients to understand their IT environments, applications, business requirements, and digital transformation objectives.
  • Collect, process, and manage large volumes of structured and unstructured data from diverse sources.
  • Work directly with Data Scientists and ML Engineers to design and maintain robust, resilient data pipelines that power Data Products.
  • Define and develop data models that unify disparate data across the organization.
  • Design, implement, and optimize ETL/ELT pipelines, ensuring scalability, performance, and maintainability.
  • Leverage Databricks and Apache Spark to perform complex data transformations and processing.
  • Build, test, and deploy scalable data-driven solutions in collaboration with cross-functional teams.


REQUIREMENT SUMMARY

Min:5.0Max:10.0 year(s)

Information Technology/IT

IT Software - DBA / Datawarehousing

Software Engineering

Graduate

Proficient

1

Remote, Costa Rica