PROLIM Corporation
PROLIM Global Corporation (www.prolim.com) is currently seeking a
Lead PySpark Developer
for our location in
Owings Mills, MD, United States . This is for one of our top clients. Responsibilities: Lead the design, development, and deployment of PySpark-based big data solutions. Architect and optimize ETL pipelines for structured and unstructured data. Collaborate with clients, data engineers, data scientists, and business teams to understand requirements and deliver scalable solutions. Optimize Spark performance through partitioning, caching, and tuning. Implement best practices in data engineering, including CI/CD, version control, and unit testing. Work with cloud platforms like AWS, ensuring data security, governance, and compliance. Mentor junior developers and review code for best practices and efficiency.
Qualifications:
10+ years of experience in big data and distributed computing. Hands-on experience with PySpark, Apache Spark, and Python. Strong experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.). Proficiency in data modeling and ETL workflows. Experience with workflow schedulers like Airflow. Experience with AWS cloud-based data platforms. Knowledge of DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus. Strong problem-solving skills and leadership abilities.
Additional Skills: Experience with DBT, AWS Astronomer.
Application Process:
Apply online for immediate consideration. Please send your updated resume and contact information via email to mohsin.kazi@prolim.com. About PROLIM Corporation
PROLIM is a leading provider of end-to-end IT, PLM, and Engineering Services and Solutions for Global 1000 companies. We understand both business and technology, helping our customers improve profitability and efficiency through high-value technology consulting, staffing, and project management outsourcing services. Our offerings include advisory, PLM software/services, program management, solution architecture, training/staffing, cloud solutions, servers/networking, infrastructure, ERP practices, and QA services. Engineering services encompass data translation, CAD/CAM/CAE, process & product engineering, prototyping, and testing/validation across various markets and industries. #J-18808-Ljbffr
Lead PySpark Developer
for our location in
Owings Mills, MD, United States . This is for one of our top clients. Responsibilities: Lead the design, development, and deployment of PySpark-based big data solutions. Architect and optimize ETL pipelines for structured and unstructured data. Collaborate with clients, data engineers, data scientists, and business teams to understand requirements and deliver scalable solutions. Optimize Spark performance through partitioning, caching, and tuning. Implement best practices in data engineering, including CI/CD, version control, and unit testing. Work with cloud platforms like AWS, ensuring data security, governance, and compliance. Mentor junior developers and review code for best practices and efficiency.
Qualifications:
10+ years of experience in big data and distributed computing. Hands-on experience with PySpark, Apache Spark, and Python. Strong experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.). Proficiency in data modeling and ETL workflows. Experience with workflow schedulers like Airflow. Experience with AWS cloud-based data platforms. Knowledge of DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus. Strong problem-solving skills and leadership abilities.
Additional Skills: Experience with DBT, AWS Astronomer.
Application Process:
Apply online for immediate consideration. Please send your updated resume and contact information via email to mohsin.kazi@prolim.com. About PROLIM Corporation
PROLIM is a leading provider of end-to-end IT, PLM, and Engineering Services and Solutions for Global 1000 companies. We understand both business and technology, helping our customers improve profitability and efficiency through high-value technology consulting, staffing, and project management outsourcing services. Our offerings include advisory, PLM software/services, program management, solution architecture, training/staffing, cloud solutions, servers/networking, infrastructure, ERP practices, and QA services. Engineering services encompass data translation, CAD/CAM/CAE, process & product engineering, prototyping, and testing/validation across various markets and industries. #J-18808-Ljbffr