ComTEK Solutions, LLC
The Big Data Engineer will be responsible for building critical data infrastructure that surfaces data and insights and serves as the face to the data user community. You will analyze and test changes to our data architectures and processes and determine the possible downstream effects and potential impacts to our data consumers.
SUMMARY OF ESSENTIAL JOB FUNCTIONS
Design and develop analytical models and be the face to the data consumers. Perform data curation to meet business requirements. Build batch and streaming data pipelines. Develop processes for automating, testing, and deploying your work. Identify risks and opportunities of potential logic and data issues within the data environment. Collaborate effectively with the global team and ensure day-to-day deliverables are met. MINIMUM REQUIREMENTS
Bachelor’s degree and 8-12+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets. 3+ years of experience as a Data Engineer or in a similar role. Proven experience with AWS, EMR, Hadoop, Spark, Snowflake, Vertica, Talend, Tableau, and other modern technology platforms is required. Must have Spark, AWS, and EMR experience Knowledge of data management fundamentals and data storage principles. Knowledge of systems as it pertains to data storage and computing. Strong source to target mapping experience and ETL principles/knowledge. Excellent verbal and written communication skills. Strong quantitative and analytical skills with accuracy and attention to detail. Ability to work well independently with minimal supervision and manage multiple priorities. Location:
Remote
#J-18808-Ljbffr
Design and develop analytical models and be the face to the data consumers. Perform data curation to meet business requirements. Build batch and streaming data pipelines. Develop processes for automating, testing, and deploying your work. Identify risks and opportunities of potential logic and data issues within the data environment. Collaborate effectively with the global team and ensure day-to-day deliverables are met. MINIMUM REQUIREMENTS
Bachelor’s degree and 8-12+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets. 3+ years of experience as a Data Engineer or in a similar role. Proven experience with AWS, EMR, Hadoop, Spark, Snowflake, Vertica, Talend, Tableau, and other modern technology platforms is required. Must have Spark, AWS, and EMR experience Knowledge of data management fundamentals and data storage principles. Knowledge of systems as it pertains to data storage and computing. Strong source to target mapping experience and ETL principles/knowledge. Excellent verbal and written communication skills. Strong quantitative and analytical skills with accuracy and attention to detail. Ability to work well independently with minimal supervision and manage multiple priorities. Location:
Remote
#J-18808-Ljbffr