What Add job title, key skills
Scroll for more!

Senior Hadoop Administrator

Zoek Pin Pune, Pune Division, Maharashtra

Permanent (Full time)

Posted 10 days ago

Job DescriptionThe Senior Hadoop Administrator is a critical datacenter leadership position responsible for driving the design, implementation and ongoing support of the Big Data platforms at PubMatic. The successful candidate will be responsible for managing a large scale data warehouse with 7 Petabytes of storage across hundreds of millions of users, with over 400 Terabytes of new data being ingested everyday, via a platform that serves over 10 trillion advertiser bids per month, across display, mobile, video, native and other formats of a Senior Hadoop Administrator, you will be responsible for installing, configuring and maintaining multiple Hadoop clusters. You will be responsible for design and architecture of the Big Data Platform, work with development teams to optimize different Hadoop deployments and code in to multiple and Tasks:Manage large scale Hadoop environments, handle builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring. Evaluate and recommend systems software and hardware for the enterprise system including capacity our Hadoop infrastructure to meet changing requirements for scaling, reliability, performance and with core production support personnel in IT and Engineering to automate deployment and operations of the infrastructure. Manage, deploy, and configure infrastructure with Ansible or other automation tool metrics and measures of utilization and capacity by planning to implement new/upgraded hardware and software including storage to work well with a global team of highly motivated and skilled personnel - interaction and dialogue are requisites in our dynamic environment. Research and recommend innovative solutions, and where possible, automated approaches for system administration tasks. Identify approaches that leverage our resources, provide economies of scale, and simplify remote/global support issues. Cluster Health:Monitor and maintain cluster connectivity and cluster to get the best performance for our faulty nodes and programmatically isolate them to avoid process/job file system to maintain data locality and track of all the Hadoop jobs and recommend and terminate resource intensive jobsCluster Security:Define and setup ACL clusters for data loss and protect against and manage compute, memory, storage, number of name-node objects for individual pools and user dashboards to identify security threats on the CapacityAdd and remove nodes as and optimize cluster latest software versions on the software and tools by coordinating with business, customer success and engineering and maintain software libraries upon project evaluate new and mentor junior Hadoop daily scrums to coordinate with software development agile and articulate technical details with stake project plan and status at steering committee + years of professional experience supporting production medium to large scale Linux years of professional experience working with Hadoop (HDFS & MapReduce) and related technology deep understanding of Hadoop design principals, cluster connectivity, security and the factors that affect distributed system on Kafka, HBase and Hortonworks is mandatory. MapR and MySQL experience a understanding of automation tools (puppet, chef, ansible).Expert experience with at least one if not most of the following languages; python, PERL, Ruby, or experience with remote monitoring and event handling using Nagios, ability to create automation with chef, puppet, ansible or a collaboration & communication skills, the ability to participate in an interdisciplinary written communications and documentation of best practices related to security, performance, and disaster QualificationsBE/BTech/BS/BCS/MCS/MCA in Computers or interpersonal, written, and verbal communication skills. LI-MD1Additional InformationCoronavirus notice: PubMatic is actively working to ensure candidate and employee safety. Currently, all hiring and onboarding processes at PubMatic will be carried out remotely through virtual meetings until further : Our benefits package includes the best of what leading organizations provide, such as stock options, paternity/maternity leave, healthcare insurance, broadband reimbursement. As well, when we’re back in the office, we all benefit from a kitchen loaded with healthy snacks and drinks and catered lunches and much more!Diversity and Inclusion: PubMatic is proud to be an equal opportunity employer; we don’t just value diversity, we promote and celebrate it. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Report job View Company Page
Apply on Hirer's Site
Apply on Hirer's Site
Similar Jobs