Oregon Staffing
Databricks Data Engineer - Senior - Consulting - Location Open
Oregon Staffing, Portland, Oregon, United States, 97204
Senior Data Engineer
At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that technical requirements align with business needs. Your responsibilities will include creating scalable data architecture and modeling solutions that support the entire data asset lifecycle. As a senior data engineer, you will play a pivotal role in transforming data into actionable insights. Your time will be spent on various responsibilities, including designing, building, and operating scalable on-premises or cloud data architecture. You will analyze business requirements and translate them into technical specifications. You will optimize data flows for target data platform designs and design, develop, and implement data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). You will collaborate with clients to understand their data needs and provide tailored solutions that meet their business objectives. You will lead end-to-end data pipeline development, including data ingestion, transformation, and storage. You will ensure data quality, integrity, and security throughout the data lifecycle. You will provide technical guidance and mentorship to junior data engineers and team members. You will communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts. You will manage client relationships and expectations, ensuring high levels of satisfaction and engagement. You will stay updated with the latest trends and technologies in data engineering and cloud computing. This role offers the opportunity to work with cutting-edge technologies and stay ahead of industry trends, ensuring you gain a competitive advantage in the market. The position may require regular travel to meet with external clients. To thrive in this role, you will need a blend of technical and interpersonal skills. Your ability to communicate effectively and build relationships will be crucial. You should have strong analytical and decision-making skills. You should have proficiency in cloud computing and data architecture design. You should have experience in data integration and security. You should be able to manage complex problem-solving scenarios. To qualify for the role, you must have a bachelor's degree in computer science, engineering, or a related field required (4-year degree). A master's degree is preferred. Typically, no less than 2-4 years relevant experience in data engineering, with a focus on cloud data solutions. You should have 5+ years of experience in data engineering, with a focus on cloud data solutions. You should have expertise in Databricks and experience with Spark for big data processing. You should have proven experience in at least two end-to-end data engineering implementations, including implementation of a data lake solution using Databricks, integrating various data sources, and enabling analytics for business intelligence. You should have development of a real-time data processing pipeline using Databricks and cloud services, delivering insights for operational decision-making. You should have strong programming skills in languages such as Python, Scala, or SQL. You should have experience with data modeling, ETL processes, and data warehousing concepts. You should have excellent problem-solving skills and the ability to work independently and as part of a team. You should have strong communication and interpersonal skills, with a focus on client management. We seek individuals who are not only technically proficient but also possess the qualities of top performers. You should be adaptable, collaborative, and driven by a desire to achieve excellence in every project you undertake. At EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year. Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at ssc.customersupport@ey.com.
At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that technical requirements align with business needs. Your responsibilities will include creating scalable data architecture and modeling solutions that support the entire data asset lifecycle. As a senior data engineer, you will play a pivotal role in transforming data into actionable insights. Your time will be spent on various responsibilities, including designing, building, and operating scalable on-premises or cloud data architecture. You will analyze business requirements and translate them into technical specifications. You will optimize data flows for target data platform designs and design, develop, and implement data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). You will collaborate with clients to understand their data needs and provide tailored solutions that meet their business objectives. You will lead end-to-end data pipeline development, including data ingestion, transformation, and storage. You will ensure data quality, integrity, and security throughout the data lifecycle. You will provide technical guidance and mentorship to junior data engineers and team members. You will communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts. You will manage client relationships and expectations, ensuring high levels of satisfaction and engagement. You will stay updated with the latest trends and technologies in data engineering and cloud computing. This role offers the opportunity to work with cutting-edge technologies and stay ahead of industry trends, ensuring you gain a competitive advantage in the market. The position may require regular travel to meet with external clients. To thrive in this role, you will need a blend of technical and interpersonal skills. Your ability to communicate effectively and build relationships will be crucial. You should have strong analytical and decision-making skills. You should have proficiency in cloud computing and data architecture design. You should have experience in data integration and security. You should be able to manage complex problem-solving scenarios. To qualify for the role, you must have a bachelor's degree in computer science, engineering, or a related field required (4-year degree). A master's degree is preferred. Typically, no less than 2-4 years relevant experience in data engineering, with a focus on cloud data solutions. You should have 5+ years of experience in data engineering, with a focus on cloud data solutions. You should have expertise in Databricks and experience with Spark for big data processing. You should have proven experience in at least two end-to-end data engineering implementations, including implementation of a data lake solution using Databricks, integrating various data sources, and enabling analytics for business intelligence. You should have development of a real-time data processing pipeline using Databricks and cloud services, delivering insights for operational decision-making. You should have strong programming skills in languages such as Python, Scala, or SQL. You should have experience with data modeling, ETL processes, and data warehousing concepts. You should have excellent problem-solving skills and the ability to work independently and as part of a team. You should have strong communication and interpersonal skills, with a focus on client management. We seek individuals who are not only technically proficient but also possess the qualities of top performers. You should be adaptable, collaborative, and driven by a desire to achieve excellence in every project you undertake. At EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year. Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at ssc.customersupport@ey.com.