Big Data Administrator

Saudi Arabia

Job ID SNS-0292

Posted On
27-Mar-2019
(1532 days ago)

Job type
Contract

Sector
Technology

Install Cloudera-Hadoop from scratch for different environments (Dev, Test, Cert, Production, Disaster Recovery).
Install and configure Kafka to facilitate real-time streaming applications.
Provide support and maintenance and its eco-systems include HDFS, Yarn, Hive, Impala, Spark, Kafka, HBase.
Implement Hadoop Security like Kerberos, Cloudera Key Trustee Server and Key Trustee Management Systems.
Enable Sentry for RBAC (role-based access control) to have a privilege level access to the data in HDFS as per the security policies.
Enable data encryption at rest and at motion with TLS/SSL to meet the security standards.
Design and Implementation of Backup and Disaster Recovery strategy based out of Cloudera BDR utility for Batch applications and Kafka mirror maker for real-time streaming applications.
Optimize and Performance tuning of the cluster by changing the parameters based on the benchmarking results such as Teragen/Terasort.
Participate in detailed technical design, development, implementation and support of Big Data applications using existing and emerging technology platforms.
Work with large streams of data with tools like Hadoop, Spark, Kafka, Flume, and Cassandra.
Be part of development projects that utilize big data skills to define and develop high-performance, cutting edge solutions
Participate in all levels of the development lifecycle, including direct client interaction
Collaborate and work in an agile team environment
Consult with client and team members on technical design approaches.
Back to list