Logo
Capital One

Lead Data Engineer (Python, PySpark, AWS)

Capital One, Williamsburg, Virginia, us, 23187

Save Job

Are you passionate about innovative technology and eager to tackle complex business challenges? Join Capital One and be part of a dynamic team of creators and disruptors dedicated to addressing genuine customer needs. As a Data Engineer at Capital One, you will drive a groundbreaking transformation, leveraging your expertise to marry data with cutting-edge technologies. About Us: The Card Tech team operates within the larger Technology organization at Capital One. We collaborate closely with our Business Partners in the Card division to develop technology solutions that empower our customers and enhance our applications. Your Role: Work collaboratively in Agile teams to design, develop, test, implement, and maintain innovative technical solutions using full-stack development tools.

Engage with a talented team specializing in machine learning, distributed microservices, and comprehensive systems development.

Utilize programming languages such as Python, Java, and Scala, and harness open-source RDBMS, NoSQL databases, and cloud-based data warehousing services (like Redshift and Snowflake).

Stay updated with technology trends, explore new tools, participate in tech communities, and mentor fellow engineers.

Collaborate with digital product managers to create robust cloud-based solutions that enhance financial empowerment for millions of Americans.

Conduct unit tests and peer reviews for your code to ensure high-quality, efficient, and optimally performing solutions.

Basic Qualifications: Bachelor's Degree.

Minimum 3 years of experience in application development (internship experience excluded).

At least 1 year of experience with big data technologies.

Preferred Qualifications: 5+ years of experience in application development using Python.

2+ years of experience with public cloud platforms (AWS, Microsoft Azure, Google Cloud).

3+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL).

2+ years of experience with real-time data and streaming applications.

2+ years of experience with NoSQL databases (DynamoDB, Cassandra).

2+ years in data warehousing (Redshift or Snowflake).

3+ years of experience with UNIX/Linux, including basic commands and shell scripting.

2+ years of experience with Agile engineering practices.

This position is not eligible for employment sponsorship or immigration support. The annual salary range for this role is $144,200 - $164,600. Capital One provides a performance-based incentive compensation package, which may include cash bonuses and/or long-term incentives. As an equal opportunity employer, Capital One promotes a diverse and inclusive workplace. We uphold non-discrimination in compliance with applicable laws, including those relevant to criminal background inquiries. If you require accommodations during the application process, please contact Capital One Recruiting. Capital One Financial operates different entities. Note that positions posted in Canada are for Capital One Canada, in the UK for Capital One Europe, and in the Philippines for Capital One Philippines Service Corp.