Diverse Lynx
Big Data Engineer/ Developer
Diverse Lynx - Jersey City, New Jersey, United States, 07390
Work at Diverse Lynx
Overview
- View job
Overview
Position:- Big Data Engineer/ Developer
Location:- Jersey City, NJ (Hybrid)
Type:-Full Time
we're looking for a Big Data Engineer/ Developer who loves solving complex problems across a full spectrum of technologies. The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. The big data engineer will help ensure that our technological infrastructure operates seamlessly in support of business objectives.
Responsibilities
Develop and maintain data pipelines using ETL processes
Take responsibility for Apache Hadoop development and implementation
Work closely with data science team to implement data analytics pipelines
Help define data governance policies and support data-versioning processes
Maintain security and data privacy, working closely with data protection officer
Analyze vast number of data stores to uncover insights
Required skills and qualifications
Experience with Python, Spark, and Hive
Understanding of data-warehousing and data-modeling techniques
Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R)
Strong data engineering skills with Azure cloud platform
Experience with streaming frameworks such as Kafka
Knowledge of Core Java, Linux, SQL, and any scripting language
Good interpersonal skills and positive attitude
Preferred skills and qualifications
Degree in computer science, mathematics, or engineering
Expertise in ETL methodology for corporate-wide solution design using DataStage
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location:- Jersey City, NJ (Hybrid)
Type:-Full Time
we're looking for a Big Data Engineer/ Developer who loves solving complex problems across a full spectrum of technologies. The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. The big data engineer will help ensure that our technological infrastructure operates seamlessly in support of business objectives.
Responsibilities
Develop and maintain data pipelines using ETL processes
Take responsibility for Apache Hadoop development and implementation
Work closely with data science team to implement data analytics pipelines
Help define data governance policies and support data-versioning processes
Maintain security and data privacy, working closely with data protection officer
Analyze vast number of data stores to uncover insights
Required skills and qualifications
Experience with Python, Spark, and Hive
Understanding of data-warehousing and data-modeling techniques
Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R)
Strong data engineering skills with Azure cloud platform
Experience with streaming frameworks such as Kafka
Knowledge of Core Java, Linux, SQL, and any scripting language
Good interpersonal skills and positive attitude
Preferred skills and qualifications
Degree in computer science, mathematics, or engineering
Expertise in ETL methodology for corporate-wide solution design using DataStage
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.