Visionary Innovative Technology Solutions LLC
AWS Data Engineer
Visionary Innovative Technology Solutions LLC, Virginia, Minnesota, United States, 55792
Seeking an AWS Data Engineer to design, build, and maintain scalable data pipelines and ETL solutions using Python/Pyspark and AWS managed services to support analytics and data product needs.
Key Responsibilities
Build and maintain ETL pipelines using
Python
and
PySpark
on AWS Glue and other compute platforms Orchestrate workflows with AWS Step Functions and serverless components ( Lambda ) Implement messaging and event-driven patterns using AWS
SNS
and
SQS Design and optimize data storage and querying in Amazon
Redshift Write performant
SQL
for data transformations, validation, and reporting Ensure data quality, monitoring, error handling and operational support for pipelines Collaborate with data consumers, engineers, and stakeholders to translate requirements into solutions Contribute to
CI/CD , infrastructure-as-code, and documentation for reproducible deployments Required Skills
Strong experience with Python and Pyspark for large-scale data processing Proven hands-on experience with AWS services: Lambda, SNS, SQS, Glue, Redshift, Step Functions Solid SQL skills and familiarity with data modeling and query optimization Experience with ETL best practices, data quality checks, and monitoring/alerting Familiarity with version control (Git) and basic DevOps/CI-CD workflows Seniority level
Associate Employment type
Full-time Industries
Financial Services and Information Services Referrals increase your chances of interviewing at Visionary Innovative Technology Solutions LLC by 2x
#J-18808-Ljbffr
Build and maintain ETL pipelines using
Python
and
PySpark
on AWS Glue and other compute platforms Orchestrate workflows with AWS Step Functions and serverless components ( Lambda ) Implement messaging and event-driven patterns using AWS
SNS
and
SQS Design and optimize data storage and querying in Amazon
Redshift Write performant
SQL
for data transformations, validation, and reporting Ensure data quality, monitoring, error handling and operational support for pipelines Collaborate with data consumers, engineers, and stakeholders to translate requirements into solutions Contribute to
CI/CD , infrastructure-as-code, and documentation for reproducible deployments Required Skills
Strong experience with Python and Pyspark for large-scale data processing Proven hands-on experience with AWS services: Lambda, SNS, SQS, Glue, Redshift, Step Functions Solid SQL skills and familiarity with data modeling and query optimization Experience with ETL best practices, data quality checks, and monitoring/alerting Familiarity with version control (Git) and basic DevOps/CI-CD workflows Seniority level
Associate Employment type
Full-time Industries
Financial Services and Information Services Referrals increase your chances of interviewing at Visionary Innovative Technology Solutions LLC by 2x
#J-18808-Ljbffr