Logo
Capital One

Senior Data Engineering Lead (Python, AWS, SQL, AI, ML)

Capital One, Williamsburg, Virginia, us, 23187

Save Job

Are you passionate about pioneering innovative technology solutions? Do you thrive on tackling complex business challenges in a dynamic and collaborative environment? At Capital One, you'll join a diverse group of creators and innovators dedicated to solving real-world problems and meeting genuine customer needs. We are looking for a Senior Data Engineering Lead who is excited about integrating data with cutting-edge technologies, playing a crucial role in driving transformation within our organization. Key Responsibilities: Work collaboratively with Agile teams to design, develop, test, implement, and support comprehensive technical solutions using full-stack development tools.

Lead a team of developers specializing in machine learning, distributed microservices, and full-stack systems.

Utilize programming languages such as Python, Java, and Scala, along with Open Source RDBMS and NoSQL databases, and cloud-based data warehousing services like Redshift and Snowflake.

Stay on top of technology trends, experiment with emerging tools, engage in technology communities, and mentor fellow engineers.

Collaborate with digital product managers to deliver robust cloud-based solutions that empower millions of Americans in their financial journeys.

Conduct thorough unit tests and peer reviews to ensure high-quality, well-optimized code.

Basic Qualifications: Bachelor's degree.

A minimum of 6 years of application development experience (Internship experience excluded).

At least 2 years working with big data technologies.

A minimum of 1 year of cloud computing experience (AWS, Microsoft Azure, Google Cloud).

Preferred Qualifications: Master's degree.

9+ years of application development experience including Python, SQL, Scala, or Java.

4+ years of experience with public cloud platforms (AWS, Microsoft Azure, Google Cloud).

5+ years working with distributed data/computing tools (e.g., MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL).

4+ years of experience in real-time data and streaming applications.

4+ years deploying scalable and responsible AI solutions on cloud platforms.

Experience developing AI/ML algorithms or technologies.

4+ years of NoSQL implementation experience (Mongo, Cassandra).

4+ years of data warehousing experience (Redshift or Snowflake).

4+ years of experience with UNIX/Linux commands and shell scripting.

2+ years of experience with Agile engineering practices.

Capital One is committed to promoting a diverse and inclusive work environment and encourages applications from qualified individuals.