PRI Global
Cloud Data Engineer only on w2(USC or GC ) (St Louis)
PRI Global, Saint Louis, Missouri, United States, 63103
Cloud Data Engineering (Production Support)
St Louis, MO(Hybrid)
Contract
Local consultants will be considerded
Only on w2(USC or GC)
Core Responsibilities Production support for Databricks notebooks, Spark streaming apps, and APIs. Ownership of Level 1 / Bronze batch ingestion for ~60 data sources. Work includes: Data ingestion from various relational DBs or AWS
Delta Lake. Adding new tables/columns, change management, GDPR/purge processes. Product optimization: upgrades, resiliency work, performance improvements. Occasional new development for shared-service tools, not business-facing projects.
Required Technical Skills Python
(must have) Spark fundamentals
(architecture, DataFrames, Spark SQL) Databricks
experience Relational DB experience
(Oracle, SQL Server, Postgres; not a DBA) Understanding of Delta Lake
Nice-to-Haves: Spark streaming API development experience Azure experience preferred; AWS acceptable Scala not required
Local consultants will be considerded
Only on w2(USC or GC)
Core Responsibilities Production support for Databricks notebooks, Spark streaming apps, and APIs. Ownership of Level 1 / Bronze batch ingestion for ~60 data sources. Work includes: Data ingestion from various relational DBs or AWS
Delta Lake. Adding new tables/columns, change management, GDPR/purge processes. Product optimization: upgrades, resiliency work, performance improvements. Occasional new development for shared-service tools, not business-facing projects.
Required Technical Skills Python
(must have) Spark fundamentals
(architecture, DataFrames, Spark SQL) Databricks
experience Relational DB experience
(Oracle, SQL Server, Postgres; not a DBA) Understanding of Delta Lake
Nice-to-Haves: Spark streaming API development experience Azure experience preferred; AWS acceptable Scala not required