Open Systems Technologies
Data Engineer - Databricks
A financial firm is looking for a
Data Engineer - Databricks
to join their team.
This role is remote. Pay:
$100-130/hr US Citizens or GC Holders Only No c2c - W2 Only Qualifications: Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field 7+ years of experience in designing and building large-scale solutions in an enterprise setting 3+ years designing and building solutions in the cloud Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architectures Expertise in building Cloud Database Management Systems in Databricks Lakehouse or analogous architectures Deep SQL expertise, data modeling, and experience with data governance in relational databases Experience with data warehousing concepts, methodologies, and frameworks using technologies like Vertica, Teradata, SparkSQL, Hadoop, Kafka Refined skills using scripting languages (e.g., Python, bash) Ability to design and develop data pipelines considering security, scalability, uptime, and reliability Expertise in relational and dimensional data modeling UNIX administration and general server administration experience Experience with CI/CD pipelines Experience with Big Data query and transformation tools such as Presto, Hive, SparkSQL, Cassandra, Solr (plus) Experience using Spark, Kafka, Hadoop or similar distributed data technologies (plus) Experience with Agile methodologies (preferred) Experience with ETL/ELT tools like Talend, Informatica (plus) Experience with Cloud Data Warehouses such as Redshift, BigQuery or similar (plus)
#J-18808-Ljbffr
A financial firm is looking for a
Data Engineer - Databricks
to join their team.
This role is remote. Pay:
$100-130/hr US Citizens or GC Holders Only No c2c - W2 Only Qualifications: Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field 7+ years of experience in designing and building large-scale solutions in an enterprise setting 3+ years designing and building solutions in the cloud Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architectures Expertise in building Cloud Database Management Systems in Databricks Lakehouse or analogous architectures Deep SQL expertise, data modeling, and experience with data governance in relational databases Experience with data warehousing concepts, methodologies, and frameworks using technologies like Vertica, Teradata, SparkSQL, Hadoop, Kafka Refined skills using scripting languages (e.g., Python, bash) Ability to design and develop data pipelines considering security, scalability, uptime, and reliability Expertise in relational and dimensional data modeling UNIX administration and general server administration experience Experience with CI/CD pipelines Experience with Big Data query and transformation tools such as Presto, Hive, SparkSQL, Cassandra, Solr (plus) Experience using Spark, Kafka, Hadoop or similar distributed data technologies (plus) Experience with Agile methodologies (preferred) Experience with ETL/ELT tools like Talend, Informatica (plus) Experience with Cloud Data Warehouses such as Redshift, BigQuery or similar (plus)
#J-18808-Ljbffr