ClifyX
We are seeking a skilled and experienced Big Data Platform Engineer who has 7+ years of experience with a strong background in both development and administration of big data ecosystems. The ideal candidate will be responsible for designing, building, maintaining, and optimizing scalable data platforms that support advanced analytics, machine learning, and real-time data processing.
Key Responsibilities
Install, configure, and manage big data tools such as Hadoop, Spark, Kafka, Hive, HBase, and others.
Monitor cluster performance, troubleshoot issues, and ensure high availability and reliability.
Implement security policies, access controls, and data governance practices.
Manage upgrades, patches, and capacity planning for big data infrastructure.
Design and develop scalable data pipelines using tools like Apache Spark, Flink, NiFi, or Airflow.
Build ETL/ELT workflows to ingest, transform, and load data from various sources.
Optimize data storage and retrieval for performance and cost-efficiency.
Collaborate with data scientists and analysts to support model deployment and data exploration.
Qualifications 7+ years of experience in big data platform engineering, strong background in Hadoop ecosystem, and expertise in Spark, Kafka, and data pipeline development.
#J-18808-Ljbffr
Key Responsibilities
Install, configure, and manage big data tools such as Hadoop, Spark, Kafka, Hive, HBase, and others.
Monitor cluster performance, troubleshoot issues, and ensure high availability and reliability.
Implement security policies, access controls, and data governance practices.
Manage upgrades, patches, and capacity planning for big data infrastructure.
Design and develop scalable data pipelines using tools like Apache Spark, Flink, NiFi, or Airflow.
Build ETL/ELT workflows to ingest, transform, and load data from various sources.
Optimize data storage and retrieval for performance and cost-efficiency.
Collaborate with data scientists and analysts to support model deployment and data exploration.
Qualifications 7+ years of experience in big data platform engineering, strong background in Hadoop ecosystem, and expertise in Spark, Kafka, and data pipeline development.
#J-18808-Ljbffr