Diverse Lynx
Azure data Engineer/Architect
Toronto, ON (Hybrid Mode)
Job Summary:
We are seeking an experienced Architect with 7 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in
PySpark and Azure Databricks,
and will be responsible for designing and implementing data solutions. This role requires a proactive individual who can drive innovation and efficiency in data processing and analytics.
Required Skills:
Technical Skills:
PySpark, Azure
Responsibilities: - Design and develop scalable data architectures using PySpark and Azure Databricks to meet business requirements. - Collaborate with cross-functional teams to understand data needs and translate them into technical solutions. Implement data processing pipelines that ensure data quality, integrity, and security. Optimize data workflows for performance and cost-effectiveness in a cloud environment. - Provide technical guidance and mentorship to junior team members to foster growth and development. Conduct regular reviews of data architecture and recommend improvements for efficiency. Stay updated with the latest industry trends and technologies to ensure the company remains competitive. Troubleshoot and resolve complex data-related issues to maintain system reliability. Document data architecture designs and processes for future reference and compliance. Engage with stakeholders to gather feedback and refine data solutions to better meet business objectives. Ensure adherence to best practices and standards in data architecture and engineering. - Contribute to the strategic planning of data initiatives to align with company goals. - Drive innovation by exploring new tools and techniques to enhance data processing capabilities.
Qualifications: -
Possess a strong understanding of PySpark and its application in data processing. - Demonstrate expertise in Azure Databricks and cloud-based data solutions. - Have a proven track record of designing scalable data architectures. - Show proficiency in optimizing data workflows for performance and cost. - Exhibit excellent problem-solving skills and attention to detail. - Display strong communication skills to effectively collaborate with teams. - Hold a degree in Computer Science, Information Technology, or a related field.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Job Summary:
We are seeking an experienced Architect with 7 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in
PySpark and Azure Databricks,
and will be responsible for designing and implementing data solutions. This role requires a proactive individual who can drive innovation and efficiency in data processing and analytics.
Required Skills:
Technical Skills:
PySpark, Azure
Responsibilities: - Design and develop scalable data architectures using PySpark and Azure Databricks to meet business requirements. - Collaborate with cross-functional teams to understand data needs and translate them into technical solutions. Implement data processing pipelines that ensure data quality, integrity, and security. Optimize data workflows for performance and cost-effectiveness in a cloud environment. - Provide technical guidance and mentorship to junior team members to foster growth and development. Conduct regular reviews of data architecture and recommend improvements for efficiency. Stay updated with the latest industry trends and technologies to ensure the company remains competitive. Troubleshoot and resolve complex data-related issues to maintain system reliability. Document data architecture designs and processes for future reference and compliance. Engage with stakeholders to gather feedback and refine data solutions to better meet business objectives. Ensure adherence to best practices and standards in data architecture and engineering. - Contribute to the strategic planning of data initiatives to align with company goals. - Drive innovation by exploring new tools and techniques to enhance data processing capabilities.
Qualifications: -
Possess a strong understanding of PySpark and its application in data processing. - Demonstrate expertise in Azure Databricks and cloud-based data solutions. - Have a proven track record of designing scalable data architectures. - Show proficiency in optimizing data workflows for performance and cost. - Exhibit excellent problem-solving skills and attention to detail. - Display strong communication skills to effectively collaborate with teams. - Hold a degree in Computer Science, Information Technology, or a related field.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.