Digital Technologies Inc
Senior ETL Hadoop Developer
Digital Technologies Inc, California, Missouri, United States, 65018
Description:
Position requires resource to work with business team to understand data requirements and work with source systems Requires extracting data from source systems and loading into Hadoop(Spark) Requires investing and resolving data and system issues, provide support
Proven experience in Designing & building data lake on Hadoop using latest technologies Experience in building integration layer to integrate data from multiple systems to Hadoop Experience in Architecture and solution design of analytics on Hadoop Experience in building pipeline to ingest data into Hadoop Working experience in dealing with data in multiple formats (csv, txt, xml, JSON) 10 Years of experience in building DW/ETL applications 5+ Years of experience in working with Hadoop echo system Working experience with Hive, Spark, Python, Hadoop libraries Experience in building data lake in Hadoop is must Experience in building ETL and data aggregations Experience with sqoop/ flumes/ spark is required Excellent SQL knowledge is required Experience in working in extracting data from RDBMS, SAS applications using API's
Must have skills
10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge
Nice to have skills
Visualization skills, Power BI experience.experience
Roles and responsibilities
Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract #J-18808-Ljbffr
Position requires resource to work with business team to understand data requirements and work with source systems Requires extracting data from source systems and loading into Hadoop(Spark) Requires investing and resolving data and system issues, provide support
Proven experience in Designing & building data lake on Hadoop using latest technologies Experience in building integration layer to integrate data from multiple systems to Hadoop Experience in Architecture and solution design of analytics on Hadoop Experience in building pipeline to ingest data into Hadoop Working experience in dealing with data in multiple formats (csv, txt, xml, JSON) 10 Years of experience in building DW/ETL applications 5+ Years of experience in working with Hadoop echo system Working experience with Hive, Spark, Python, Hadoop libraries Experience in building data lake in Hadoop is must Experience in building ETL and data aggregations Experience with sqoop/ flumes/ spark is required Excellent SQL knowledge is required Experience in working in extracting data from RDBMS, SAS applications using API's
Must have skills
10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge
Nice to have skills
Visualization skills, Power BI experience.experience
Roles and responsibilities
Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract #J-18808-Ljbffr