Senior Data Engineer
at Stability AI
Berlin, Berlin, Germany -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 07 Nov, 2024 | Not Specified | 09 Aug, 2024 | N/A | Cloud Storage,Communication Skills,Data Loading,Software Development,Database,Snowflake,Unstructured Data,Aws,File Systems,Python | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
QUALIFICATIONS:
- Proven background within large-scale distributed workloads
- Experience with large-scale data loading for machine learning training runs
- Experience with cloud storage and file systems. AWS (S3) is strongly preferred, but open to other cloud platforms
- Experience with Python
- Experience with large-scale data processing and software development for unstructured data.
- Expertise in database, data lake, and data warehouse technologies (Redshift, BigQuery, Snowflake).
- Experience working with machine learning projects and ideally some deep learning / computer vision knowledge
- Good teamwork and communication skills based on experience working with a distributed international team with timezone and cultural differences
- Excellent communication skills to effectively collaborate with users, solve issues, and provide guidance
- Attention to detail and the ability to document processes and solutions effectively
How To Apply:
Incase you would like to apply to this job directly from the source, please click here
Responsibilities:
ABOUT THE ROLE:
We are looking for a talented Data Engineer to be part of our Data team. You will work alongside a growing multidisciplinary team of talented research scientists and machine learning engineers to improve and scale the efficiency within our models. You will contribute in building the data infrastructure that manages our data and powers the training of all Stability AI models. The position is based in Germany, remote.
RESPONSIBILITIES:
- Clean, normalize, and preprocess data in a scalable, parallelizable way to prepare it for ingestion into our machine learning model training pipelines while ensuring data quality
- Design, implement, and maintain scalable data infrastructure for generative AI
- Develop tools to search and serve the data at scale
- Collaborate with cross-functional teams to understand and meet their data requirements
- Develop and manage data processing pipelines to support machine learning teams
- Maintain and improve data quality and integrity across various databases and data stores
- Manage and organize large-scale unstructured data, including image, text, audio, video and 3D
REQUIREMENT SUMMARY
Min:N/AMax:5.0 year(s)
Information Technology/IT
IT Software - DBA / Datawarehousing
Software Engineering
Graduate
Proficient
1
Berlin, Germany