Software Developer / Big Data Developer
We are now looking for a BigData Developer that will involved into the creation of customer solutions. As a Software Developer, will be involved in all phases of the software development lifecycle; working towards accurately engineered information systems, containing software as the major component, to meet agreed business requirements.
To be successful in the role you must have
The Bigdata Engineer shall build the solutions which architect has crafted.
Develop, maintain, test and evaluate BigData solutions.
Builds Large Scale data processing systems.
Understands how to apply technologies to seek BigData problems and to develop innovative BigData solutions.
Collecting, Parsing, Managing, Analysing and visualizing large sets of data to turn information into insights using multiple platforms.
Crafting efficient and robust ETL workflows.
Detailing requirements and resolve ambiguities.
Craft and develop data applications using selected tools and frameworks as required and requested.
Perform tasks such as writing scripts, web scraping, calling APIs, write SQL queries, etc.
Support business decisions with ad hoc analysis as needed (PoC’s).
Solution Acceptance (UAT) towards Customer.
Identify Scope Creep, Change Requests during delivery phase.
10+ Years of demonstrated ability in data engineering.
Bachelor’s Degree or more in Computer Science or a related field.
A proven track record of data management showing your magnificent execution and attention to detail.
Solid understanding of and experience with statistics.
Programming experience, ideally in Java, Spark, Scala, Kafka, Hive, Scoop, Oozie, languages to meet goals and objectives.
Experience in Distributed file system like HDFS, GlusterFS.
Experience in NSQL databases.
Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
A willingness to explore new alternatives or options to tackle data mining issues, and utilize a combination of industry standard methodologies, data innovations and your experience to get the job done.