Senior Spark Engineer_Neustar, Hyderabad

5 - 7 Years

Job Description

Job Description:

The Senior Engineer of DNA Spark is a data and technical leader responsible to design and develop the next generation of data processing on Hadoop/ Spark platform. The technical leader in this role will work closely with various teams including data acquisition, data products & data sciences to build the web services platform exposing these services to the end customers.


Design and implementation of application build, release, deployment, and configuration activities. (Application Lifecycle Management)
Design and implementation of monitoring & notification systems for the various services
Continuously review and enhance processes and operating procedures needed to maintain the most cost effective enterprise-grade cloud infrastructure.
Identify and promote best practices and patterns for the setup, configuration and management including databases, servers, and network and storage systems.
Maintain a team-oriented working environment that promotes a high level of personal commitment and accountability and a continued focus on quality and efficiency.
A hands on Individual contributor and able to lead the team, designing and developing the data processing & ML code on Spark.
Prototype and program data transformations and entity resolutions on petabyte-scale data on Hadoop/ Spark clusters.
Understand the data patterns and design and implement the code and debug ML models for entity resolution in Spark. Work on Spark code performance improvement.
Run along the cutting edge with an all-star lineup of experts in computer science, software engineering, marketing science, operation research and marketing strategy.
Skills and Experience
5 - 8 years of experience in Deployment, testing and supporting Big Data Applications using Spark.
Ability to use a wide variety of open source technologies and tools
Ability to code and script. Strong grasp of automation tools
Commanding knowledge of Linux, expertise in at least one scripting language (Python/Perl/Shell), experience with continuous integration using Jenkins, experience of working in a Scrum team, and experience of using GIT for version control.

Nice to have
Hands on with Java and AWS infrastructure.
Able to resolve crisis situations and guide the team to quick resolution.
Responsible for performing end-to-end incident management. Responsible for time-critical User Service/ Infrastructure restoration, technical troubleshooting in system.
Escalating and communicating in a timely fashion the status of major incidents and problems with IT and business stakeholders including executive management.
Continuously raise the bar on what defines customer service delivery.
Understand enterprise product development and technical environments such as Micro Services, J2EE, SQL databases, networking, and load balancers.
Create and maintain complete and accurate documentation for the purpose of operational audits including security and compliance.

Salary: INR 16,00,000 - 22,50,000 P.A.

Industry:IT-Software / Software Services

Functional Area:IT Software - Application Programming, Maintenance

Role Category:Programming & Design

Role:Team Lead/Technical Lead

Employment Type:Permanent Job, Full Time


Desired Candidate Profile

Please refer to the Job description above


Doctorate:Doctorate Not Required

Company Profile

Arise Global Services Private Limited

Arise Global Services is a skilled and dynamic company engaged in Human Resource Consulting services, primarily concentrating on Information Technology, ITES,BPO services to name a few. We specialize in search and recruitment at all levels and offer cost effective solutions to all employers, regardless of size, to ensure that all business can get quality staff affordably.
View Contact Details+

Recruiter Name:Madhavi

Contact Company:Arise Global Services Private Limited