Robotics Prcocess Automation, LLC
Hadoop Amin
Robotics Prcocess Automation, LLC, Charlotte, North Carolina, United States, 28245
Hadoop Administrator Job Description
Responsible for the implementation and ongoing administration of Hadoop infrastructure. Align with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and expand existing environments. Work with data delivery teams to set up new Hadoop users, including Linux users, Kerberos principals, and testing HDFS, Hive, and MapReduce access. Provide operational expertise such as troubleshooting, understanding system capacity, bottlenecks, and basics of memory, CPU, OS, storage, and networks. Deploy Hadoop clusters, add/remove nodes, monitor jobs, configure high availability for name-node, schedule, and take backups. Perform performance tuning of Hadoop clusters and MapReduce routines. Monitor Hadoop cluster performance, capacity, connectivity, and security. Manage and review Hadoop log files and monitor file system health. Support and maintain HDFS. Collaborate with infrastructure, network, database, application, and business intelligence teams to ensure data quality and availability. Work with application teams to install updates, patches, and upgrades for operating systems and Hadoop components. Preferred Qualifications
Minimum 4-5 years of recent Hadoop Administration experience with strong knowledge of Hadoop architecture, installation, configuration, monitoring, security, resource management, maintenance, and performance tuning. Experience as an RDBMS DBA is a plus. Knowledge of Hadoop components such as HDFS, Sentry, Kafka, Spark, Hive, YARN, Zookeeper. Proficiency in scripting and programming languages like Python, Scala, Bash. Understanding of Hadoop stack including HDFS, Hive, HBase, Cassandra, Scoop, Oozie, Spark. Knowledge of relational and non-relational databases, data handling standards, and sensitive data. Experience with system upgrades, patches, compliance, and audit support. ROBOTIC PROCESS AUTOMATION LLC is an equal opportunity employer, inclusive of female, minority, disability, and veterans. Employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status, or other protected statuses. We comply with applicable labor and employment laws and do not require U.S. citizenship or lawful permanent residency unless legally necessary.
#J-18808-Ljbffr
Responsible for the implementation and ongoing administration of Hadoop infrastructure. Align with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and expand existing environments. Work with data delivery teams to set up new Hadoop users, including Linux users, Kerberos principals, and testing HDFS, Hive, and MapReduce access. Provide operational expertise such as troubleshooting, understanding system capacity, bottlenecks, and basics of memory, CPU, OS, storage, and networks. Deploy Hadoop clusters, add/remove nodes, monitor jobs, configure high availability for name-node, schedule, and take backups. Perform performance tuning of Hadoop clusters and MapReduce routines. Monitor Hadoop cluster performance, capacity, connectivity, and security. Manage and review Hadoop log files and monitor file system health. Support and maintain HDFS. Collaborate with infrastructure, network, database, application, and business intelligence teams to ensure data quality and availability. Work with application teams to install updates, patches, and upgrades for operating systems and Hadoop components. Preferred Qualifications
Minimum 4-5 years of recent Hadoop Administration experience with strong knowledge of Hadoop architecture, installation, configuration, monitoring, security, resource management, maintenance, and performance tuning. Experience as an RDBMS DBA is a plus. Knowledge of Hadoop components such as HDFS, Sentry, Kafka, Spark, Hive, YARN, Zookeeper. Proficiency in scripting and programming languages like Python, Scala, Bash. Understanding of Hadoop stack including HDFS, Hive, HBase, Cassandra, Scoop, Oozie, Spark. Knowledge of relational and non-relational databases, data handling standards, and sensitive data. Experience with system upgrades, patches, compliance, and audit support. ROBOTIC PROCESS AUTOMATION LLC is an equal opportunity employer, inclusive of female, minority, disability, and veterans. Employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status, or other protected statuses. We comply with applicable labor and employment laws and do not require U.S. citizenship or lawful permanent residency unless legally necessary.
#J-18808-Ljbffr