Innova Solutions
Hadoop Engineer
Location: Charlotte, NC / Chicago, IL (3 Days/week Onsite)
Position Type: Contract – Long Term Contract
Position: Hadoop Engineer
A client of Innova Solutions is immediately hiring for a Hadoop Engineer to support NextGen Platforms built around Big Data Technologies such as Hadoop, Spark, Kafka, Impala, HBase, Docker, Ansible, and more.
Responsibilities
Work on complex, major or highly visible tasks across multiple projects requiring diverse expertise.
Provide subject matter expertise in managing Hadoop and Data Science Platform operations focused on Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker‑Container Cluster Management and Administration.
Integrate solutions with other applications and platforms outside the framework.
Manage platform operations across all environments, including upgrades, bug fixes, deployments, metrics & monitoring, disaster recovery, incident/problem/capacity management.
Serve as a liaison between client partners and vendors, coordinating with project managers to deliver technical solutions that meet user needs.
Apply strong knowledge of Hadoop Architecture, HDFS, and the Hadoop Administrator’s role.
Design and maintain integrated AD/Kerberos authentication.
Set up optimum cluster configurations.
Debug and troubleshoot YARN.
Analyze Hadoop log files, compression, encoding, and file formats.
Work with Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, and Postgres.
Maintain strong technical skills in Unix/Linux, databases (Sybase/SQL/Oracle), Java, Python, Perl, shell scripting, and infrastructure.
Operate monitoring, alerting, and job scheduling systems.
Perform frequent, incremental code testing and deployment.
Utilize automation/DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket.
Apply experience in Big Data Technologies.
Qualifications
Experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite, etc.
Hands‑on with Hadoop log analysis, compression, and encoding.
Experience setting up optimum cluster configurations.
Knowledge of Hadoop log files, compression, encoding, and file formats.
Expert level knowledge of Cloudera Hadoop components: HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, Postgres.
Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, shell scripting, infrastructure.
Experience in Monitoring, Alerting, and Job Scheduling Systems.
Comfort with frequent, incremental code testing and deployment.
Mastery of automation/DevOps tools – Ansible, Jenkins, SVN, Bitbucket.
Experience working on Big Data Technologies.
Certification in Cloud, Docker‑Container, OpenShift Technologies.
Ideal Candidate Profile The ideal candidate will have expertise in Hadoop, Kafka, Spark, Cloudera, and OpenShift.
Pay & Benefits Pay Range:
$65.00 – $70.00 per hour (dependent on education, experience, location, duties, certifications, etc.)
Benefits:
Medical & pharmacy coverage, dental/vision insurance, 401(k), health savings account (HSA), flexible spending account (FSA), life insurance, pet insurance, short‑term and long‑term disability, accident & critical illness coverage, prepaid legal & ID theft protection, sick time, and other paid leaves as required by law.
Contact Phone: (+1) 646-442-0534
Email: prashant.saurav@innovasolutions.com
Equal Opportunity Innova Solutions is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to providing a work environment free of discrimination and harassment on the basis of race, color, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at hr@innovasolutions.com or (770) 493-5588. Innova Solutions encourages all interested and qualified candidates to apply for employment opportunities.
#J-18808-Ljbffr
Position Type: Contract – Long Term Contract
Position: Hadoop Engineer
A client of Innova Solutions is immediately hiring for a Hadoop Engineer to support NextGen Platforms built around Big Data Technologies such as Hadoop, Spark, Kafka, Impala, HBase, Docker, Ansible, and more.
Responsibilities
Work on complex, major or highly visible tasks across multiple projects requiring diverse expertise.
Provide subject matter expertise in managing Hadoop and Data Science Platform operations focused on Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker‑Container Cluster Management and Administration.
Integrate solutions with other applications and platforms outside the framework.
Manage platform operations across all environments, including upgrades, bug fixes, deployments, metrics & monitoring, disaster recovery, incident/problem/capacity management.
Serve as a liaison between client partners and vendors, coordinating with project managers to deliver technical solutions that meet user needs.
Apply strong knowledge of Hadoop Architecture, HDFS, and the Hadoop Administrator’s role.
Design and maintain integrated AD/Kerberos authentication.
Set up optimum cluster configurations.
Debug and troubleshoot YARN.
Analyze Hadoop log files, compression, encoding, and file formats.
Work with Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, and Postgres.
Maintain strong technical skills in Unix/Linux, databases (Sybase/SQL/Oracle), Java, Python, Perl, shell scripting, and infrastructure.
Operate monitoring, alerting, and job scheduling systems.
Perform frequent, incremental code testing and deployment.
Utilize automation/DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket.
Apply experience in Big Data Technologies.
Qualifications
Experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite, etc.
Hands‑on with Hadoop log analysis, compression, and encoding.
Experience setting up optimum cluster configurations.
Knowledge of Hadoop log files, compression, encoding, and file formats.
Expert level knowledge of Cloudera Hadoop components: HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, Postgres.
Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, shell scripting, infrastructure.
Experience in Monitoring, Alerting, and Job Scheduling Systems.
Comfort with frequent, incremental code testing and deployment.
Mastery of automation/DevOps tools – Ansible, Jenkins, SVN, Bitbucket.
Experience working on Big Data Technologies.
Certification in Cloud, Docker‑Container, OpenShift Technologies.
Ideal Candidate Profile The ideal candidate will have expertise in Hadoop, Kafka, Spark, Cloudera, and OpenShift.
Pay & Benefits Pay Range:
$65.00 – $70.00 per hour (dependent on education, experience, location, duties, certifications, etc.)
Benefits:
Medical & pharmacy coverage, dental/vision insurance, 401(k), health savings account (HSA), flexible spending account (FSA), life insurance, pet insurance, short‑term and long‑term disability, accident & critical illness coverage, prepaid legal & ID theft protection, sick time, and other paid leaves as required by law.
Contact Phone: (+1) 646-442-0534
Email: prashant.saurav@innovasolutions.com
Equal Opportunity Innova Solutions is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to providing a work environment free of discrimination and harassment on the basis of race, color, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at hr@innovasolutions.com or (770) 493-5588. Innova Solutions encourages all interested and qualified candidates to apply for employment opportunities.
#J-18808-Ljbffr