Big Data Developer With Pyspark Experience

Big Data Developer With Pyspark Experience Big Data Developer With Pyspark Experience 1 week ago Be among the first 25 applicants Leading IT consulting firm in Baltimore MD seeking an experienced developer with hands-on experience in Big Data, Pyspark, Python, AWS, and SQL/NoSQL. This is a six-month consulting position with possibility of extension. Payrate $65/hour. Note: Visa sponsorship or C2C employment not available for this position. Position Responsibilities:: Lead the design, development, and deployment of PySpark-based big data solutions. Architect and optimize ETL pipelines for structured and unstructured data. Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions. Optimize Spark performance through partitioning, caching, and tuning. Work with cloud platforms like AWS. Ensure data security, governance, and compliance. Mentor junior developers and review code for best practices and efficiency. MUST HAVE: 7+ years of experience in Amazon Web Service(AWS) Cloud Computing. 10+ years of experience in big data and distributed computing. Experience with PySpark, Apache Spark, and Python. Experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.). Hands on experience with AWS cloud-based data platforms. Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus. Seniority level Seniority level Not Applicable Employment type Employment type Full-time Job function Job function Engineering and Information Technology Industries Information Services Referrals increase your chances of interviewing at WRA by 2x Get notified about new Big Data Developer jobs in Baltimore, MD . Baltimore, MD $112,597.33-$152,810.66 1 month ago Linthicum Heights, MD $57.87-$92.40 1 week ago Columbia, MD $100,000.00-$160,000.00 2 days ago Baltimore, MD $112,597.33-$152,810.66 1 month ago Software Engineer - 2 (Python Developer) Data Engineer - Multiple Levels (TS/SCI with Poly Required) Dayton, MD $95,000.00-$155,000.00 1 year ago Data Engineer (Mid-Senior Level) – Healthcare SaaS Platform Annapolis, MD $110,000.00-$130,000.00 2 days ago Baltimore, MD $144,768.00-$209,109.33 1 month ago Baltimore, MD $144,768.00-$209,109.33 1 month ago Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics Big Data Engineer (Remote, Top Secret Clearance Required) (Baltimore) Agile Developer - 5 (Java/Spring Boot/Python) Annapolis Junction, MD $228,000.00-$293,000.00 1 week ago Software Engineer I (Merchant Data Platform) Maryland, United States $90,000.00-$150,000.00 4 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr