Capital One
Senior Data Engineering Lead (Python, Spark, Airflow)
Capital One, Mc Lean, Virginia, us, 22107
Join Capital One as a Senior Data Engineering Lead!
Are you passionate about technology and eager to tackle complex business challenges in a dynamic, collaborative environment? At Capital One, you will work alongside a team of innovators and disruptors aimed at delivering meaningful solutions that meet real customer needs. As a Senior Data Engineering Lead, you will be instrumental in driving significant transformation and innovation within our organization.
What You'll Be Responsible For:
Work closely with Agile teams to design, develop, test, implement, and maintain integrated technical solutions using cutting-edge development tools and technologies.
Collaborate with a team of skilled developers experienced in machine learning, microservices, and full-stack systems.
Apply programming languages such as Python, Java, and Scala, alongside Open Source RDBMS and NoSQL databases, as well as Cloud-based data warehousing solutions like Redshift and Snowflake.
Demonstrate your enthusiasm for technology by continuously exploring new tools, contributing to community initiatives, and mentoring fellow engineers.
Partner with digital product managers to deliver robust cloud-based solutions that empower millions of Americans towards financial wellness.
Conduct unit testing and peer reviews to ensure that your code is expertly designed, efficient, and optimized for performance.
Basic Qualifications: Bachelor's Degree.
At least 4 years of experience in application development (Internship experience not included).
A minimum of 2 years working with big data technologies.
At least 1 year of experience in cloud computing (AWS, Microsoft Azure, Google Cloud).
Preferred Qualifications: 7+ years of application development experience, particularly with Python, SQL, Scala, or Java.
4+ years of experience in a public cloud environment (AWS, Microsoft Azure, Google Cloud).
Experience of 4+ years with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, etc.).
4+ years in real-time data and streaming applications.
A strong background with NoSQL implementations (Mongo, Cassandra) for 4+ years.
4+ years of experience with data warehousing technologies (Redshift or Snowflake).
4+ years of proficiency with UNIX/Linux systems, including basic commands and shell scripting.
Experience with Agile engineering practices for 2+ years.
This role is based in McLean, VA, with an annual salary range of $193,400 - $220,700 for the Lead Data Engineer position. Candidates in other locations will have salaries commensurate with their respective regions. You may also be eligible for performance-based incentives. Capital One values diversity and is an equal opportunity employer. We foster an inclusive environment that promotes creativity and innovation. Join us in building solutions that drive financial empowerment for millions.
Collaborate with a team of skilled developers experienced in machine learning, microservices, and full-stack systems.
Apply programming languages such as Python, Java, and Scala, alongside Open Source RDBMS and NoSQL databases, as well as Cloud-based data warehousing solutions like Redshift and Snowflake.
Demonstrate your enthusiasm for technology by continuously exploring new tools, contributing to community initiatives, and mentoring fellow engineers.
Partner with digital product managers to deliver robust cloud-based solutions that empower millions of Americans towards financial wellness.
Conduct unit testing and peer reviews to ensure that your code is expertly designed, efficient, and optimized for performance.
Basic Qualifications: Bachelor's Degree.
At least 4 years of experience in application development (Internship experience not included).
A minimum of 2 years working with big data technologies.
At least 1 year of experience in cloud computing (AWS, Microsoft Azure, Google Cloud).
Preferred Qualifications: 7+ years of application development experience, particularly with Python, SQL, Scala, or Java.
4+ years of experience in a public cloud environment (AWS, Microsoft Azure, Google Cloud).
Experience of 4+ years with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, etc.).
4+ years in real-time data and streaming applications.
A strong background with NoSQL implementations (Mongo, Cassandra) for 4+ years.
4+ years of experience with data warehousing technologies (Redshift or Snowflake).
4+ years of proficiency with UNIX/Linux systems, including basic commands and shell scripting.
Experience with Agile engineering practices for 2+ years.
This role is based in McLean, VA, with an annual salary range of $193,400 - $220,700 for the Lead Data Engineer position. Candidates in other locations will have salaries commensurate with their respective regions. You may also be eligible for performance-based incentives. Capital One values diversity and is an equal opportunity employer. We foster an inclusive environment that promotes creativity and innovation. Join us in building solutions that drive financial empowerment for millions.