About the Company

Insight Global is an international staffing and professional services firm specializing in delivering talent and technical solutions to Fortune 1000 companies across various industries. With a global presence and dedication to empowering individuals, Insight Global provides top-tier staffing services to tackle complex challenges for clients worldwide.

About the Role

This role will involve building new data pipelines, identifying data gaps, and providing automated solutions to enhance analytical capabilities and data delivery. The developer will help obtain data from the System of Record and establish real-time data feeds for automated analysis. The role is hybrid and based in one of the Bank of America hubs

Required Skills

5-8 years of experience with Hadoop/Big Data and Distributed Systems
Strong focus on real-time data streaming (including structured streaming)
Proficiency in SQL (MySQL, HIVE, Impala, SPARK SQL)
Data ingestion experience from message queues, file shares, REST APIs, and relational databases
Experience with data formats like JSON, CSV, XML, Parquet
Hands-on experience with Spark, Sqoop, Kafka, MapReduce, NoSQL databases (HBase, SOLR, etc.), CDP or HDP, Cloudera or Hortonworks, ElasticSearch, Kibana, and Jupyter Notebook
Programming skills in Scala, Python, PHP, or Shell Scripting
Experience with Linux operating systems and Cloudera Manager Portal/YARN
Knowledge of resource contention issues in shared clusters/cloud environments

Additional Skills

Experience with Spark Structured Streaming
Performance tuning for Spark/MapReduce or SQL jobs
End-to-end design and build of Near-Real-Time and Batch Data Pipelines
Experience with Agile development and SDLC
Familiarity with Source Code and Version Control systems (SVN, Git, Bitbucket)
Experience working with Jenkins and Jar management

Full details of this position are available on the official website linked below:

Apply Now