Diverse Lynx
Role name:
AWS Databricks Engineer
Role Description:
Job Title: AWS Databricks Engineer , Experience Required: 5-6 YearsJob Summary:We are seeking an experienced AWS Databricks Developer with 5-6 years of strong data engineering experience to design, develop, and optimize large-scale data processing pipelines using AWS and Databricks technologies. The ideal candidate should have a strong background in big data processing, cloud services, and distributed computing.Key Responsibilities: Develop and maintain scalable data pipelines using Apache Spark on Databricks. Build end-to-end ETL/ELT pipelines on AWS using services like S3, Glue, Lambda, EMR, and Step Functions. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions. Design and implement data models, schemas, and lakehouse architecture in Databricks. Optimize and tune Spark jobs for performance and cost-efficiency. Integrate data from multiple structured and unstructured data sources. Monitor and manage data workflows, ensuring data quality, consistency, and security. Follow best practices in CI/CD, code versioning (Git), and DevOps practices for data applications. Write clean, reusable, well-documented code using Python / PySpark / Scala.Required Skills & Experience: 5-6 years of total experience in data engineering or big data development. 2-3 years hands-on experience with Databricks and Apache Spark. Proficient in AWS cloud services (S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM). Strong programming skills in PySpark, Python, and optionally Scala. Solid understanding of data lakes, lakehouses, and Delta Lake concepts. Experience in SQL development and performance tuning. Familiarity with Airflow, dbt, or similar orchestration tools is a plus. Experience in CI/CD tools like Jenkins, GitHub Actions, or CodePipeline. Knowledge of data security, governance, and compliance frameworks.Preferred Qualifications: Databricks Certification (e.g., Databricks Certified Data Engineer Associate/Professional). AWS Certification (e.g., AWS Certified Data Analytics, Developer - Associate). Experience with data visualization tools like Power BI or Tableau. Exposure to MLflow, Feature Store, or MLOps on Databricks is a bonus
Competencies:
Digital : Amazon Web Service(AWS) Cloud Computing, Digital : Databricks
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
AWS Databricks Engineer
Role Description:
Job Title: AWS Databricks Engineer , Experience Required: 5-6 YearsJob Summary:We are seeking an experienced AWS Databricks Developer with 5-6 years of strong data engineering experience to design, develop, and optimize large-scale data processing pipelines using AWS and Databricks technologies. The ideal candidate should have a strong background in big data processing, cloud services, and distributed computing.Key Responsibilities: Develop and maintain scalable data pipelines using Apache Spark on Databricks. Build end-to-end ETL/ELT pipelines on AWS using services like S3, Glue, Lambda, EMR, and Step Functions. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions. Design and implement data models, schemas, and lakehouse architecture in Databricks. Optimize and tune Spark jobs for performance and cost-efficiency. Integrate data from multiple structured and unstructured data sources. Monitor and manage data workflows, ensuring data quality, consistency, and security. Follow best practices in CI/CD, code versioning (Git), and DevOps practices for data applications. Write clean, reusable, well-documented code using Python / PySpark / Scala.Required Skills & Experience: 5-6 years of total experience in data engineering or big data development. 2-3 years hands-on experience with Databricks and Apache Spark. Proficient in AWS cloud services (S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM). Strong programming skills in PySpark, Python, and optionally Scala. Solid understanding of data lakes, lakehouses, and Delta Lake concepts. Experience in SQL development and performance tuning. Familiarity with Airflow, dbt, or similar orchestration tools is a plus. Experience in CI/CD tools like Jenkins, GitHub Actions, or CodePipeline. Knowledge of data security, governance, and compliance frameworks.Preferred Qualifications: Databricks Certification (e.g., Databricks Certified Data Engineer Associate/Professional). AWS Certification (e.g., AWS Certified Data Analytics, Developer - Associate). Experience with data visualization tools like Power BI or Tableau. Exposure to MLflow, Feature Store, or MLOps on Databricks is a bonus
Competencies:
Digital : Amazon Web Service(AWS) Cloud Computing, Digital : Databricks
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.