About the Company
A globally recognized leader in information technology, consulting, and business process services, the company specializes in leveraging cognitive computing, hyper-automation, robotics, cloud, analytics, and emerging technologies. With over 220,000 employees serving clients across six continents, the company is dedicated to sustainability and corporate citizenship, driving digital transformation and success for clients worldwide.
About the Role
The Hadoop Administrator will manage Big Data platforms like Hadoop, Kafka, HBase, and Spark, focusing on troubleshooting, root cause analysis, and implementing high-availability solutions. The role includes handling capacity expansions, automating tasks, and setting up observability systems to monitor performance. Collaboration with Level 3 teams on cluster optimization and new use cases is key. The administrator will create standard operating procedures and automate processes using tools like Shell scripting, Ansible, or Python. This role ensures platform reliability, security, and performance, aligning with service level agreements while driving continuous improvement.
Mandatory Skills
-
Expertise in Hadoop and Linux administration
-
Experience with Hadoop clusters and Kafka
Key Responsibilities
-
Perform Big Data Administration and Engineering tasks across multiple open-source platforms, including Hadoop, Kafka, HBase, and Spark.
-
Troubleshoot and debug complex issues; conduct root cause analysis of production incidents.
-
Develop and document learning materials; identify and implement high-availability solutions for services with single points of failure.
-
Plan and execute timely capacity expansions and upgrades to avoid scaling issues and bugs; automate repetitive tasks to reduce manual errors.
-
Tune alerting and set up observability to proactively detect performance issues and problems.
-
Collaborate with Level 3 teams to review new use cases and strengthen cluster performance and reliability.
-
Create standard operating procedures and guidelines for platform management and utilization.
-
Employ DevOps tools and disciplines (including incident, problem, and change management) in daily operations.
-
Ensure the Hadoop platform meets performance and service level agreement requirements.
-
Perform security remediation, automation, and self-healing as needed.
-
Focus on automation and reporting, reducing manual effort through tools such as Shell scripting, Ansible, Python, or other programming languages.