Senior Data Engineer I
at LexisNexis
Cape Town, Western Cape, South Africa -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 28 Jan, 2025 | Not Specified | 31 Oct, 2024 | 5 year(s) or above | Data Engineering,Platforms,Testing,Azure,Aws,Production Systems,Apache Spark,Jenkins,Data Flow,Continuous Improvement,Automation,Data Security,Computer Science,Versioning,Features,Data Privacy | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
Do you have excellent experience building data pipelines?
Do you enjoy collaborating cross-functionally to deliver on common goals?
Join us in shaping a more just world.
About Us
LexisNexis, a part of RELX, is a leading global provider of legal, regulatory, and business information. We help customers increase productivity and improve decision-making and outcomes. Our 10,500 experts and innovative tools help us shape a better world for our customers and communities.
About the Role
At LexisNexis we develop the legal profession’s most innovative products for data analysis, visualization, and research. We use the latest techniques in AI, machine learning, and data visualization to uncover insights about judges’ rulings, build forecasts of likely outcomes, and reveal critical connections in massive datasets spanning the law, news, and finance.
Responsibilities
As a senior machine learning operations engineer on our team, you will work on new product development in a small team environment writing production code in both run-time and build-time environments. You will help propose and build data-driven solutions for high-value customer problems by discovering, extracting, and modeling knowledge from large-scale natural language datasets. You will prototype new ideas, collaborating with other data scientists as well as product designers, data engineers, front-end developers, and a team of expert legal data annotators. You will get the experience of working in a start-up culture with the large datasets and many other resources of an established company. You will also:
- Develop and implement a strategy for continuous improvement of our Machine Learning Ops including versioning, testing, automation, reproducibility, deployment, monitoring, and data privacy
- Develop and report on ML Ops metrics such as deployment frequency, lead time for changes, mean time to restore, and change failure rate
- Collaborate with data scientists, data engineers, API engineers, and the dev ops team
- Build scalable data ingestion and machine learning inference pipelines
- Scale up production systems to handle increased demand from new products, features, and users
- Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
- Automate and handle the life-cycle of the systems and platforms that process our data
Requirements
- Masters degree in Software Engineering, Data Engineering, Computer Science or related field
- 5 years of relevant work experience
- Strong Scala and Python background
- Experience with Apache Spark and/or Ray
- Knowledge of AWS, GCP, Azure, or other cloud platform
- Knowledge of current principles and frameworks for ML Ops
- Experience with ML Ops technologies such as ML Flow, DVC, Grafana, DataHub, Databricks
- Experience with machine learning technologies such as PyTorch, TensorFlow, AWS Sagemaker
- Experience with CI/CD pipelines, including Jenkins or Git Actions
- Experience with Docker containerization or Kubernetes orchestration
- Experience in improving data security and privacy, and managing and reducing cloud costs
- Knowledge of API development and machine learning deployment
Work in a way that works for you
We promote a healthy work/life balance across the organization, with various flexible and remote working options available to employees
Working with Us
LexisNexis Legal & Professional is proud to be an equal-opportunity employer. We are committed to equal opportunity employment regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. Together, we are building a diverse and inclusive workplace.
Working for you
We believe in a healthy work/life balance. We know that your well-being and happiness are key to a long and successful career.
About our Team
LexisNexis is a data and analytics company with 10,500 colleagues serving customers in more than 150 countries. We’re one of the largest information and analytics companies on the planet. We design solutions that help our customers increase productivity, improve decision-making and outcomes, and be more successful.
LexisNexis, a division of RELX, is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form:
https://forms.office.com/r/eVgFxjLmAK
, or please contact 1-855-833-5120.
Please read our
Candidate Privacy Policy
Responsibilities:
Please refer the Job description for details
REQUIREMENT SUMMARY
Min:5.0Max:10.0 year(s)
Information Technology/IT
IT Software - System Programming
Software Engineering
Graduate
Computer Science, Software Engineering, Engineering
Proficient
1
Cape Town, Western Cape, South Africa