Business Needs Inc.
This range is provided by Business Needs Inc. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Base pay range
$55.00/hr - $60.00/hr Title : Senior ETL Design GCP Consultant Location : Plano TX (But Remote with CST working hours is also okay) Job Description
We are seeking a highly experienced ETL designer to join our team. The ideal candidate will have over 12-15 years of experience in designing and implementing data solutions, with a strong focus on cloud data warehousing and real-time data processing. This role requires advanced knowledge in various data technologies and the ability to translate business requirements into scalable and efficient data architectures. Key Responsibilities
Design, develop, and maintain robust ETL pipelines on GCP using tools like Dataflow, BigQuery, Cloud Composer (Apache Airflow), and Pub/Sub Optimize data ingestion, transformation, and loading processes for high-volume, real-time, and batch data processing Ensure data integrity, quality, and security throughout the ETL lifecycle Collaborate with data engineers, analysts, and business teams to understand data needs and translate them into efficient ETL solutions Implement best practices for performance tuning, error handling, and monitoring of ETL jobs Work with structured and unstructured data sources, integrating API-based, event-driven, and batch processing workflows Automate and document ETL processes to enhance maintainability and scalability Utilize Git for version control and deployment of ETL workflows, ensuring smooth CI/CD integration Key Skills
12+ years of experience in ETL design and development Proficiency in SQL, Python, and Apache Beam for data processing using dataflow, dataproc appliances. Strong experience in advance DML operations, query optimization Experience with data modelling, warehousing concepts, and data lakes Hands-on experience with orchestration tools like Apache Airflow or Cloud Composer on DAG design, Error handling and monitoring Knowledge of performance tuning, data partitioning, and optimization techniques Experience in real-time streaming ETL and event-driven architectures is a plus Familiarity with Git for version control and deployment of ETL pipelines Strong problem-solving skills and ability to work in an agile environment Qualifications
Bachelor’s or master’s degree in computer science, Information Technology, or a related field. Proven experience in ETL design and implementation in DWH systems. Strong problem-solving skills and the ability to work in a fast-paced environment. Excellent communication and collaboration skills.
#J-18808-Ljbffr
$55.00/hr - $60.00/hr Title : Senior ETL Design GCP Consultant Location : Plano TX (But Remote with CST working hours is also okay) Job Description
We are seeking a highly experienced ETL designer to join our team. The ideal candidate will have over 12-15 years of experience in designing and implementing data solutions, with a strong focus on cloud data warehousing and real-time data processing. This role requires advanced knowledge in various data technologies and the ability to translate business requirements into scalable and efficient data architectures. Key Responsibilities
Design, develop, and maintain robust ETL pipelines on GCP using tools like Dataflow, BigQuery, Cloud Composer (Apache Airflow), and Pub/Sub Optimize data ingestion, transformation, and loading processes for high-volume, real-time, and batch data processing Ensure data integrity, quality, and security throughout the ETL lifecycle Collaborate with data engineers, analysts, and business teams to understand data needs and translate them into efficient ETL solutions Implement best practices for performance tuning, error handling, and monitoring of ETL jobs Work with structured and unstructured data sources, integrating API-based, event-driven, and batch processing workflows Automate and document ETL processes to enhance maintainability and scalability Utilize Git for version control and deployment of ETL workflows, ensuring smooth CI/CD integration Key Skills
12+ years of experience in ETL design and development Proficiency in SQL, Python, and Apache Beam for data processing using dataflow, dataproc appliances. Strong experience in advance DML operations, query optimization Experience with data modelling, warehousing concepts, and data lakes Hands-on experience with orchestration tools like Apache Airflow or Cloud Composer on DAG design, Error handling and monitoring Knowledge of performance tuning, data partitioning, and optimization techniques Experience in real-time streaming ETL and event-driven architectures is a plus Familiarity with Git for version control and deployment of ETL pipelines Strong problem-solving skills and ability to work in an agile environment Qualifications
Bachelor’s or master’s degree in computer science, Information Technology, or a related field. Proven experience in ETL design and implementation in DWH systems. Strong problem-solving skills and the ability to work in a fast-paced environment. Excellent communication and collaboration skills.
#J-18808-Ljbffr