Ventures Unlimited Inc
Ventures Unlimited is a service centric organization. Our success begins with our ability to apply our relationships, leverage technologies, and identify talent - often in combination - to an endless array of real-world customer needs
Job Description **** FULL TIME PERMANENT POSITION******
Position : Hadoop Lead with Python Location:
Beaverton, OR Duration:
Full Time
Responsibilities
Design and implement MapReduce jobs to support distributed processing using Java, Python, Hive, and Pig; Ability to design and implement end-to-end solution.
Build libraries, user defined functions, and frameworks around Hadoop.
Research, evaluate and utilize new technologies/tools/frameworks around Hadoop ecosystem.
Develop user defined functions to provide custom Hive and Pig capabilities.
Define and build data acquisition and consumption strategies.
Define & develop best practices.
Work with support teams in resolving operational & performance issues.
Work with architecture/engineering leads and other teams on capacity planning.
Work with Site-Operations team on configuration/upgrades of the cluster.
Excellent communication skills.
Qualifications
MS/BS degree in a computer science field or related discipline.
8+ years’ experience in large-scale software development.
Experience with data warehousing, dimensional modeling and ETL development (including familiarity).
Strong Java programming, shell scripting, Python, and SQL.
Strong development skills around Hadoop, MapReduce, Hive, Pig, Impala.
Strong understanding of Hadoop internals.
Good understanding of AVRO and JSON.
Experience with build tools such as Maven.
Experience with databases like Oracle.
Experience with performance/scalability tuning, algorithms and computational complexity.
Proven ability to work cross‑functional teams to deliver appropriate resolution.
Experience with open‑source NoSQL technologies such as HBase and Cassandra.
Experience with messaging & complex event processing systems such as Kafka and Storm.
Machine learning framework (Nice to have).
Statistical analysis with Python, R or similar.
#J-18808-Ljbffr
Job Description **** FULL TIME PERMANENT POSITION******
Position : Hadoop Lead with Python Location:
Beaverton, OR Duration:
Full Time
Responsibilities
Design and implement MapReduce jobs to support distributed processing using Java, Python, Hive, and Pig; Ability to design and implement end-to-end solution.
Build libraries, user defined functions, and frameworks around Hadoop.
Research, evaluate and utilize new technologies/tools/frameworks around Hadoop ecosystem.
Develop user defined functions to provide custom Hive and Pig capabilities.
Define and build data acquisition and consumption strategies.
Define & develop best practices.
Work with support teams in resolving operational & performance issues.
Work with architecture/engineering leads and other teams on capacity planning.
Work with Site-Operations team on configuration/upgrades of the cluster.
Excellent communication skills.
Qualifications
MS/BS degree in a computer science field or related discipline.
8+ years’ experience in large-scale software development.
Experience with data warehousing, dimensional modeling and ETL development (including familiarity).
Strong Java programming, shell scripting, Python, and SQL.
Strong development skills around Hadoop, MapReduce, Hive, Pig, Impala.
Strong understanding of Hadoop internals.
Good understanding of AVRO and JSON.
Experience with build tools such as Maven.
Experience with databases like Oracle.
Experience with performance/scalability tuning, algorithms and computational complexity.
Proven ability to work cross‑functional teams to deliver appropriate resolution.
Experience with open‑source NoSQL technologies such as HBase and Cassandra.
Experience with messaging & complex event processing systems such as Kafka and Storm.
Machine learning framework (Nice to have).
Statistical analysis with Python, R or similar.
#J-18808-Ljbffr