Java /Scala data engineer
Dallas TX / Atlanta GA (Day 1 onsite) anyone location can be given
subcon ***/hr
5 to 7 + years of software development experience in below skills:
Python, Scala, Java, Telecom domain knowledge, Data-Warehouse/ DataBricks knowledge, NoSQL-JSON-Document store (e.g. MongoDB), Data-Mapper (e.g. Nifi), Data Analytics, Spark, Kafka and Azure technology
Competent Big Data/Databrick engineer, who is independent, results driven and is capable of taking business requirements and building out the technologies to take it to production.
Big Data
Engineer with expert level experience in Hadoop ecosystem and real time analytics tools including PySpark/Scala Spark/Hive/Hadoop CLI/MapReduce/ Storm/Kafka/Lambda Architecture/Mongo
Familiar with job scheduling challenges in Hadoop
Experienced in creating and submitting Spark jobs Experience in high performance tuning and scalability
Experience in working on real time stream processing technologies like Spark structured streaming, Kafka Expertise in Python/Spark and their related libraries and frameworks
Experience in building pipeline and efforts involved in deployment
Unix/Linux expertise; comfortable with Linux operating system and Shell Scripting
Experience in Azure cache
Design, Development, Unit and Integration testing of complex data pipelines and to handle data volumes to derive insights
Ability to optimize code to be able to run efficiently with stipulated SLA
Excellent problem solving skills, with attention to detail, focus on quality and timely delivery of assigned tasks
The pay range for this role is ***k - ***k per annum including any bonuses or variable pay. *** also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate
Thanks
Regards
*** is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities.
Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at
Yantran LLC