Diverse Lynx
ETL Architect
Diverse Lynx - West Chester, Pennsylvania, United States, 19388
Work at Diverse Lynx
Overview
- View job
Overview
. At least 8+ years of experience architecting and implementing complex ETL pipelines preferably with Spark toolset.2. At least 4+ years of experience with Java particularly within the data space3. Technical expertise regarding data models, database design development, data mining and segmentation techniques4. Good experience writing complex SQL and ETL processes5. Excellent coding and design skills, particularly in Java/Scala and Python and or Java.6. Experience working with large data volumes, including processing, transforming and transporting large-scale data7. Experience in AWS technologies such as EC2, Redshift, Cloud formation, EMR, AWS S3, AWS Analytics required.8. Big data related AWS technologies like HIVE, Presto, Hadoop required.9. AWS certification is preferable: AWS Developer/Architect/DevOps/Big Data10. Excellent working knowledge of Apache Hadoop, Apache Spark, Kafka, Scala, Python etc.11. Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy12. Good understanding & usage of algorithms and data structures13. Good Experience building reusable frameworks.14. Experience working in an Agile Team environment.15. AWS certification is preferable: AWS Developer/Architect/DevOps/Big Data16. Excellent communication skills both verbal and written"