Logo
Perficient

Lead Data Engineer (SDET) - REMOTE

Perficient, New York, New York, United States

Save Job

Job Description

Perficient is a global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the world's most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of our AI-First strategy, we empower every employee to build AI fluency and actively engage with AI tools to drive innovation and efficiency. We break boundaries, obsess over outcomes, and shape the future for our clients. Join a company where bold ideas and brilliant minds converge to redefine what's possible - while building a career filled with growth, balance, and purpose.

Job Overview:

We are seeking a highly skilled and detail-oriented

Lead Data Engineer (SDET)

to join our Data Engineering team in United States. The ideal candidate will have hands-on experience with ETL development and testing, SQL, and test automation tools, and will be responsible for designing, developing, and executing automated tests to ensure the quality and reliability of data pipelines and analytics platforms.

As a Lead Technical Consultant you will participate in all aspects of the software development lifecycle which includes estimating, technical design, implementation, documentation, testing, deployment and support of application developed for our clients. As a member working in a team environment you will work with solution architects and developers on interpretation/translation of wireframes and creative designs into functional requirements, and subsequently into technical design.

Perficient is always looking for the best and brightest talent and we need you! We're a quickly-growing, global digital consulting leader, and we're transforming the world's largest enterprises and biggest brands. You'll work with the latest technologies, expand your skills, and become a part of our global community of talented, diverse, and knowledgeable colleagues.

Responsibilities

Strong programming and development skills. Design and implement ETL pipelines and automated test frameworks for data validation. Develop and execute SQL queries to analyze data and validate data transformations to ensure data integrity. Utilize testing tools like

ICEDQ

and

QuerySurge

for automated data testing and monitoring. Collaborate with other data engineers and developers to understand data flows and business logic. Perform root cause analysis of issues to fix or work with development teams to resolve defects. Integrate automated tests into CI/CD pipelines using tools like

Jenkins

and

GitHub . Conduct API testing for data services and integrations. Develop and utilize

Unix/Linux

scripts Core Technologies & Tools:

ETL Tools / Informatica:

Used for extracting, transforming, and loading data across systems. SQL:

Essential for querying and validating data across relational databases. Testing Tools:

Specialized tools for automated testing (e.g., ICEDQ / QuerySurge) GitHub:

Version control and collaboration on test scripts and automation frameworks. Jenkins:

CI/CD pipeline integration for automated testing and deployment. Unix/Linux:

Command-line proficiency for scripting, log analysis, and environment setup. Python / PySpark:

Scripting and data processing for test automation and validation. API Testing:

Experience with RESTful services, using tools like Postman or REST Assured. Preferred Knowledge & Skills:

AWS Services:

Familiarity with cloud-based data storage, compute, and analytics services (e.g., S3, Lambda, Glue). Software Design:

Understanding of modular, scalable, and maintainable software architecture. Test Design & Techniques Qualifications

Bachelor's degree in Computer Science, Engineering, or related field. 8+ years of experience in Data Engineering or SDET roles. Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Nice to Have:

Experience with data lake and data warehouse development and testing. Familiarity with Agile/Scrum methodologies. Certifications in AWS, Informatica, or software testing.

The salary range for this position takes into consideration a variety of factors, including but not limited to skill sets, level of experience, applicable office location, training, licensure and certifications, and other business and organizational needs. The new hire salary range displays the minimum and maximum salary targets for this position across all US locations, and the range has not been adjusted for any specific state differentials. It is not typical for a candidate to be hired at or near the top of the range for their role, and compensation decisions are dependent on the unique facts and circumstances regarding each candidate. A reasonable estimate of the current salary range for this position is $73,008 to $170,640. Please note that the salary range posted reflects the base salary only and does not include benefits or any potential variable compensation programs. Information regarding the benefits available for this position are in this overview.

WHO WE ARE

Perficient is a leading global digital consultancy. We imagine, create, engineer, and run digital transformation solutions that help our clients exceed customers' expectations, outpace competition, and grow their business. With unparalleled strategy, creative, and technology capabilities, our colleagues bring big thinking and innovative ideas, along with a practical approach to help our clients - the world's largest enterprises and biggest brands succeed.

WHAT WE BELIEVE

At Perficient, we promise to challenge, champion, and celebrate our people. You will experience a unique and collaborative culture that values every voice. Join our team, and you'll become part of something truly special.

We believe in developing a workforce that is as diverse and inclusive as the clients we work with. We're committed to actively listening, learning, and acting to further advance our organization, our communities, and our future leaders... and we're not done yet.

Perficient, Inc. proudly provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a protected veteran in accordance with applicable federal, state and local laws. Perficient, Inc. complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Perficient, Inc. expressly prohibits any form of unlawful employee harassment based on race, color, religion, gender, sexual orientation, national origin, age, genetic information, disability, or covered veterans. Improper interference with the ability of Perficient, Inc. employees to perform their expected job duties is absolutely not tolerated.

Applications will be accepted until the position is filled or the posting is removed.

Disability Accommodations:

Perficient is committed to providing a barrier-free employment process with reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or accommodation due to a disability, please contact us.

Disclaimer:

The above statements are not intended to be a complete statement of job content, rather to act as a guide to the essential functions performed by the employee assigned to this classification. Management retains the discretion to add or change the duties of the position at any time.

#LI-AN1

#LI-Remote

About Us

Perficient is always looking for the best and brightest talent and we need you! We're a quickly growing, global digital consulting leader, and we're transforming the world's largest enterprises and biggest brands. You'll work with the latest technologies, expand your skills, experience work-life balance, and become a part of our global community of talented, diverse, and knowledgeable colleagues.