Sr. Data Engineers

CCC Intelligent Solutions Inc. seeks Sr. Data Engineers for Chicago, IL location to develop large scale end to end data pipeline apps, covering multiple data sources spread across data center & AWS cloud. Master’s in Comp Sci/Comp Eng/Mgmt Info Systems/Business Analytics/related field +3 yrs exp w/ sw dev/data processing or analysis req’d. Req’d skills: Programming w/ Python & PySpark; Massively Parallel Processing & distributed resource mgmt w/YARN in AWS EMR; columnar storage formats (Parquet, ORC) & Apache Hudi; ETL pipeline orchestration using Apache Airflow; Building & optimizing data pipelines w/Apache Kafka; Advanced SQL for profiling & validation; Presto; PostgreSQL; Unix scripting & root cause analysis of data & processes; CI/CD tools (Git, GitHub Actions, Jenkins); Agile methodologies & metadata-driven dev; AWS tools - EMR, S3, RDS, Redshift, CloudWatch, Bedrock, MWAA; Machine learning; predictive modeling using DataRobot. Some telecommuting permitted. $130,707/yr - $139,000/yr.Apply online: https://cccis.com/about/careers/ REF: 14213