Information Technology







Talk to us
+44 (0) 1322 316231

Big Data Developer

(Big Data, Kafka, NiFi, Hive, Spark, Scala, Bash scripts, Jenkins, Oozie, Unix Shell scripting, AWS, EMR, Presto, EKS, Jankins, DevOps, Scrum, Kanban)

Our customer a company specialising in Data Intelligence are searching for a Big Data Developer to work from their headquarters in Valencia.

The engineer's tasks involve creating or extending new solutions in a dynamic environment, using Big Data ecosystem: Kafka, NiFi, Hive, Spark, Scala, Bash scripts, Jenkins, Oozie, etc. The engineer will be involved in the introduction of the customers bespoke platform to a Big Data environment, and with the evolution and expansion of the platform with similar tools.

Skills / Requirements

* +3 years of experience with at least 3 of the main tools in the Big Data stack
* Ability to work in a team-oriented environment
* Good knowledge of the Hadoop ecosystem:
 Kafka
 NiFi
 Hive
 Scala
 Spark
 Spark SQL
* Cloud providers
 Google Cloud: BigQuery/Table, DataProc, Kubernetes
 AWS: EMR, Presto, EKS
* Big data stack (Cloudera/Hortonworks/MapR)
* UNIX Shell Scripting
* Git
* Degree in Computer Engineering or similar

Other valuable skills:
* CI/CD, Jenkins, DevOps, Scrum/Kanban

More information available on application

Talk to us
+44 (0) 1322 316231

Skillbase Group Ltd
The Brewhouse, Old Bexley Business
Park, Bourne Road, Bexley, Kent DA5 1LR
United Kingdom

Telephone UK:  +44 (0)1322 310 333
Belgium local number:  02 401 91 69

Skillbase Consulting Ireland Ltd
2nd floor 50A
Rosemount Business Park
Rosemount Park Drive
Ballycoolin, Dublin 11 Ireland
Irish Number:    09 146 0330