Senior Data Engineer and Team Leader

at  International Data Group Inc

Overview:
Join a team that is building a leading intelligence platform for IT vendors!
IDC seeks a skilled, motivated, and dedicated Senior Data Engineer and Team Leader to help build some of the most advanced sophisticated data products. You will design and launch innovative analytical products through data operations in this role. You can showcase your industry-leading data design skills, work within a standard product development lifecycle, and collaborate with multiple development teams.
We are looking for someone with experience working with large data sets and developing tools for handling these data, someone who can lead a team of talented and visionary individuals. If you want to do something more than write simple CRUD applications, join our team! Do a job that AI can not replace. Your work here will be varied and exciting, as you can touch many fields.

QUALIFICATIONS

• BA/BS in Computer Science, Mathematics, Statistics, Data Engineering or 3-5 years of experience in a role requiring the application of these skills
• 3-5 years of relevant work experience in a Technical role
• Experience managing individuals for team outcomes
• Proficiency with Python scripts
• Proficiency with SQL and any major platforms, preferably Snowflake or PostgreSQL; alternatively, I can use any other database such as MySQL, Oracle, or Microsoft SQL.

Nice to haves:

• Familiar with Machine Learning, Gen AI
• Familiar with AWS stack or any other cloud environments

• Lead a small team of Data Analytics engineers, mentor them, help them find opportunities, and create an environment where they can develop themselves however they want.
• Developing tools/data apps for research analysts that help them with data quality analysis, modeling data, data cleaning, ML forecasting, etc. Most of the above-mentioned are created with Python scripts using statistical, mathematical, and algorithmic principles.
• Prototype, test, and deploy end-to-end data operation pipelines.
• Design the architecture for ingesting, cleaning, transforming, and loading data from source to destination.
• Integrate and reconcile independent data sources into a single source.
• Create automated matching tools to match data across multiple data sources.
• Collaborate with technical and analyst teams to gather requirements.
• Provide support and oversight for team members.