About the Company
Innova Solutions is a global provider of IT and business transformation services. With over 50,000 professionals worldwide, the company helps clients succeed by delivering innovative technology solutions. Innova Solutions is committed to fostering an inclusive work environment and ensuring equal opportunity for all employees.
About the Role
A leading technology solutions company is looking for a Hadoop Developer to support critical initiatives requiring expertise in the Hadoop ecosystem. The role involves working closely with internal and external teams to design, develop, test, and implement software solutions using Hadoop, Hive, Spark, and other Big Data technologies. The candidate should have experience in Python, Scala, and Unix shell scripting. Familiarity with HBase, Kafka, and performance tuning is preferred, along with banking domain experience, particularly in compliance and risk.
Key Responsibilities
-
Design, develop, and support Hadoop-based software applications.
-
Collaborate with technical teams to deliver effective solutions.
-
Implement and maintain Hadoop ecosystem components: HDFS, Hive, Spark.
-
Develop and optimize SQL queries for Big Data systems.
-
Support performance tuning, capacity planning, and troubleshooting.
-
Assist with data analysis, performance bottlenecks, and improvements.
-
Collaborate with business units to define and implement technical solutions.
-
Handle upgrades and configuration maintenance for sharded clusters.
-
Provide leadership and mentoring to junior team members.
Required Skills
-
5+ years of experience with Hadoop, Hive, Spark, and Big Data technologies.
-
Strong expertise in PySpark and SQL.
-
Experience with Kafka, HBase, and other NoSQL databases.
-
Skilled in Unix shell scripting and automation.
-
Familiarity with Agile methodologies.
-
Experience with cloud platforms (AWS, GCP, Azure) is a plus.
-
Experience in the banking or financial sector (compliance and risk).
-
Excellent problem-solving and communication skills.
Preferred Skills
-
Knowledge of Scala programming.
-
Experience with UI/UX development.
-
Familiarity with HIVE 3.0 (CDP platform).
-
Exposure to Python or Java programming languages.