New Jersey Staffing
Software Developer
Multiple openings. Build automated scalable distributed data solutions using AWS architecture and Big Data Technologies. Participate in business and system requirements sessions. Conduct fusion sessions. Conduct requirements elicitation, detailed analysis and create technical specifications. Create conceptual, logical, and physical (operational and dimensional) data models. Work on AWS step functions to orchestrate the end-to-end movement and processing of data along the way. Build automated workflows with both event and time-based triggers to start the workflows once the files arrive in the S3 Buckets. Work on lambda functions with Python to implement business logic. Work on CFT to manage all the AWS services used in the project and progressed across different development zones. Optimization and performance tuning of hive queries. Promoting the code to various environments like develop, pre-prod and master branches using bit-bucket. Collaborate with the infrastructure, network, database, application and BI teams to ensure data quality and availability. Coordinate the team members and meeting the sprint deadlines. Work with Core Java, Scala, Python, Unix Shell Scripting, Oracle, SQL Server 2008, My SQL, UNIX, Windows Server, Health Care Domain, AWS Cloud, Step Function, Glue, Lambda, EMR, Hive, Hudi, kinesis, Spark, Spark Streaming, EMR, CFT, Redshift. 40 hrs/wk. Must have Master's degree or equivalent in Computer Science, Electr Engineering, Information Technology, or a related field (will accept a Bachelor's degree plus 5 years of progressive post baccalaureate experience in lieu of a Master's) and 2 years experience (or 2 years experience as Tech Lead, Manager Data Engineering, or related occupation). Must have 2 years experience participating in business and system requirements sessions; Conducting fusion sessions; Requirements elicitation, detailed analysis and creating technical specifications; Creating conceptual, logical, and physical (operational and dimensional) data models; Working with Core Java, Scala, python, Unix shell scripting, SQL server, UNIX, Health Care Domain, AWS Cloud, Hive, Hudi, Redshift. Must be willing to travel/relocate to unanticipated locations throughout the US on short notice for extended periods of time. Telecommuting permitted.
Multiple openings. Build automated scalable distributed data solutions using AWS architecture and Big Data Technologies. Participate in business and system requirements sessions. Conduct fusion sessions. Conduct requirements elicitation, detailed analysis and create technical specifications. Create conceptual, logical, and physical (operational and dimensional) data models. Work on AWS step functions to orchestrate the end-to-end movement and processing of data along the way. Build automated workflows with both event and time-based triggers to start the workflows once the files arrive in the S3 Buckets. Work on lambda functions with Python to implement business logic. Work on CFT to manage all the AWS services used in the project and progressed across different development zones. Optimization and performance tuning of hive queries. Promoting the code to various environments like develop, pre-prod and master branches using bit-bucket. Collaborate with the infrastructure, network, database, application and BI teams to ensure data quality and availability. Coordinate the team members and meeting the sprint deadlines. Work with Core Java, Scala, Python, Unix Shell Scripting, Oracle, SQL Server 2008, My SQL, UNIX, Windows Server, Health Care Domain, AWS Cloud, Step Function, Glue, Lambda, EMR, Hive, Hudi, kinesis, Spark, Spark Streaming, EMR, CFT, Redshift. 40 hrs/wk. Must have Master's degree or equivalent in Computer Science, Electr Engineering, Information Technology, or a related field (will accept a Bachelor's degree plus 5 years of progressive post baccalaureate experience in lieu of a Master's) and 2 years experience (or 2 years experience as Tech Lead, Manager Data Engineering, or related occupation). Must have 2 years experience participating in business and system requirements sessions; Conducting fusion sessions; Requirements elicitation, detailed analysis and creating technical specifications; Creating conceptual, logical, and physical (operational and dimensional) data models; Working with Core Java, Scala, python, Unix shell scripting, SQL server, UNIX, Health Care Domain, AWS Cloud, Hive, Hudi, Redshift. Must be willing to travel/relocate to unanticipated locations throughout the US on short notice for extended periods of time. Telecommuting permitted.