Get new jobs for this search by email
Python + PySpark - Junior Developer
Compunnel - New York, New York, us, 10261 15 hours ago
The Python + PySpark + AWS Consultant will be responsible for designing, developing, and optimizing data engineering solutions using Python and PySpar...
More...
Big Data Developer With Pyspark Experience
WRA, Inc. - Baltimore 5 days ago
Big Data Developer With Pyspark Experience Big Data Developer With Pyspark Experience 1 week ago Be among the first 25 applicants Leading IT consul...
More...
Python Developer
NS2 Mission - Virginia, Minnesota, United States, 55792 15 hours ago
Join to apply for the Python Developer role at NS2 Mission 8 hours ago Be among the first 25 applicants Join to apply for the Python Developer role at...
More...
Business Intelligence Developer
4A Consulting, LLC - Ellicott City, Maryland, United States, 21042 15 hours ago
Direct message the job poster from 4A Consulting, LLC
We are seeking a highly skilled Azure BI Developer to join our team. The ideal candidate will br...
More...
GIS Developer
Axiom Software Solutions Limited - United States 7 days ago
GIS Developer Python basic knowledge require / Pyspark optional skill ArcGIS AGOL React JS GIS Developer ...
More...
Python Developer
NS2 Mission - Virginia, Minnesota, United States, 55792 14 hours ago
Join to apply for thePython Developerrole atNS2 Mission
8 hours ago Be among the first 25 applicants
Join to apply for t...
More...
Senior PySpark Developer
Accord Technologies Inc - Woodbridge, New Jersey, us, 07095 14 hours ago
5 days ago Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
Job Type: W2 contract.
We are seeking an ex...
More...
Lead Python Fullstack Developer
Ojasys LLC - Mc Lean, Virginia, us, 22107 5 days ago
Join to apply for theLead Python Fullstack Developerrole atOjasys LLC
2 days ago Be among the first 25 applicants
Join t...
More...
Business Intelligence Developer
4A Consulting, LLC - Ellicott City 5 days ago
Direct message the job poster from 4A Consulting, LLC We are seeking a highly skilled Azure BI Developer to join our team. The ideal candidate will...
More...
Senior Django Backend Developer
Compunnel - Jersey City, New Jersey, United States, 07390 15 hours ago
We are seeking a highly experienced Senior Django Backend Developer to lead the development of scalable, secure, and high-performance backend systems....
More...
Go to next pageCompunnel - New York, New York, us, 10261
The Python + PySpark + AWS Consultant will be responsible for designing, developing, and optimizing data engineering solutions using Python and PySpark. The role requires hands-on experience in building scalable ETL pipelines, working with cloud platforms such as AWS or Azure, and ensuring data integrity and performance optimization. The candidate should have strong SQL skills and a deep understanding of data engineering principles.
Key Responsibilities
Develop and maintain data processing workflows using Python and PySpark
Design and implement ETL pipelines for structured and unstructured data
Optimize Spark-based data processing for efficiency and scalability
Deploy and manage data solutions on AWS or Azure
Write and optimize SQL queries for data transformation and analysis
Troubleshoot and resolve performance issues in data pipelines
Work closely with cross-functional teams to ensure data reliability and integrity
Required Qualifications
5+ years of experience in data engineering
Strong proficiency in Python and object-oriented programming
Hands-on experience with PySpark for large-scale data processing
Proficiency in SQL for data manipulation and query performance tuning
Experience with AWS or Azure for cloud-based data solutions
Knowledge of ETL processes and data pipeline automation
Experience with Hadoop is acceptable
Preferred Qualifications
Experience in optimizing Spark jobs for performance and cost efficiency
Familiarity with DevOps practices for data engineering
Understanding of data governance, security, and compliance best practices
#J-18808-Ljbffr
See details and apply
Python + PySpark - Junior Developer
