Big Data Engineer (with Scala and Spark)

at  Grid Dynamics

ABOUT US:

Grid Dynamics is the engineering services company known for transformative, mission-critical cloud solutions for retail, finance and technology sectors. We architected some of the busiest e-commerce services on the Internet and have never had an outage during the peak season. Founded in 2006 and headquartered in San Ramon, California with offices throughout the US and Eastern Europe, we focus on big data analytics, scalable omnichannel services, DevOps, and cloud enablement.

PROJECT DESCRIPTION:

Advertising Platforms group makes it possible for people around the world to easily access informative and imaginative content on their devices while helping publishers and developers promote and monetize their work. Today, our technology and services power advertising in Search Ads in of the biggest search and news providers. Our platforms are highly-performant, deployed at scale, and setting new standards for enabling effective advertising while protecting user privacy. You will develop distributed systems to establish, refine and automate our anti-fraud processes across our advertising surfaces.

REQUIREMENTS:

• Strong knowledge of Scala
• In-depth knowledge of Hadoop and Spark
• Processing and computation frameworks: Kafka, Spark, Dataframe/SQL API - DB engines: Oracle, Postgres, Teradata, Cassandra.
• Implementing Data Lakes, Data Warehousing or analytics systems is an advantage
• Understanding of the best practices in data quality and quality engineering
• Ability to quickly learn new tools and technologies
• English languages are required
• Good understanding of distributed computing technologies, approaches, and patterns

QUALIFICATIONS

• Strong knowledge of Scala
• In-depth knowledge of Hadoop and Spark
• Processing and computation frameworks: Kafka, Spark, Dataframe/SQL API - DB engines: Oracle, Postgres, Teradata, Cassandra.

ABOUT US

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization, and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India

ROLE OVERVIEW

We are looking for an experienced and technology-proficient Big Data Engineer to join our team!
Our customer is one of the world’s largest technology companies based in Silicon Valley with operations all over the world. In this project, we are working on the bleeding edge of Big Data technology to develop a high-performance data analytics platform, which handles petabytes datasets.

RESPONSIBILITIES:

• Running big data analytics, and building large scale data infrastructure
• Detecting meaningful data patterns
• Assuring the integrity of our data
• Measuring fraud activity and its impact on campaign and user performance
• Analyzing the results of mitigations against fraud

ESSENTIAL FUNCTIONS

• Running big data analytics, and building large scale data infrastructure
• Detecting meaningful data patterns
• Assuring the integrity of our data
• Measuring fraud activity and its impact on campaign and user performance
• Analyzing the results of mitigations against fraud