Logo
Capital One

Lead Data Engineer (Python, Spark & AWS)

Capital One, Baltimore, Maryland, United States, 21276

Save Job

Lead Data Engineer (Python, Spark, AWS) Are you enthusiastic about innovating in the tech world? Do you thrive on tackling complex business challenges in a dynamic, collaborative, and inclusive environment? At Capital One, you’ll join a vibrant community of innovators dedicated to solving real problems and enhancing customer experiences. We are looking for

Data Engineers

who are eager to fuse data with cutting-edge technologies and drive significant transformations within our organization. What You'll Do: Engage with Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies.

Collaborate with a skilled team of developers experienced in machine learning, distributed microservices, and full-stack systems.

Utilize programming languages such as Java, Scala, Python along with Open Source RDBMS and NoSQL databases, plus cloud-based data warehousing services like Redshift and Snowflake.

Stay updated on technological trends, experiment with and learn new technologies, and participate in tech communities while mentoring fellow engineers.

Work closely with digital product managers to deliver robust cloud-based solutions that empower millions of Americans in their financial journeys.

Conduct unit tests and peer reviews to ensure your code is meticulously designed, elegantly coded, and optimally tuned for performance.

Basic Qualifications: Bachelor's Degree.

Minimum of 3 years of experience in application development (internship experience does not apply).

At least 1 year of experience in big data technologies.

Preferred Qualifications: 5+ years of application development experience utilizing Python, SQL, Scala, or Java.

2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud).

3+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL).

2+ years experience working on real-time data and streaming applications.

2+ years of experience in NoSQL technologies (Mongo, Cassandra).

2+ years of data warehousing experience (Redshift or Snowflake).

3+ years of UNIX/Linux experience, including basic commands and shell scripting.

2+ years of experience utilizing Agile engineering practices.

This position does not offer sponsorship for employment authorization at this time. The minimum and maximum annual salaries for this role are listed below, based on specific locations: McLean, VA: $158,600 - $181,000; Plano, TX: $144,200 - $164,600; Richmond, VA: $144,200 - $164,600. Actual salary may vary based on experience and interviews. This role also includes eligibility for performance-based incentive compensation, which can include cash bonuses and/or long-term incentives. Capital One provides a comprehensive and inclusive range of health, financial, and other benefits that support your overall well-being. Learn more about these benefits on our Capital One Careers website. Please note: This role will accept applications for a minimum of 5 business days. Capital One is an equal opportunity employer committed to non-discrimination in compliance with applicable laws. If you need an accommodation during the application process, please reach out, and we will ensure confidentiality and support.