Business Consulting- Data Engineer Business Consulting- Data Engineer

Job duties: Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and development tests; Monitor results and take corrective actions; Translate data access, transformation, and movement requirements into functional requirements and mapping designs. Use SQL to design database schemas, optimize data retrieval, and implement ETL processes. Investigate, analyze, and resolve complex technical problems related to system functions, environment, and procedures; and Manage service levels, standards, and configurations; Participate in Agile teams to meet goals; Development and support of Kafka integrations, including topics, producers, consumers and streaming applications; Design, develop and maintain Enterprise micro services - security, logging, common APIs and enforcing coding standards.

Job requirements: • Bachelor's degree in Computer Science, Computer Engineering, Electrical/Electronics Engineering, or related technical field and 5 years of software development experience. • Design, build and maintain batch or real-time data pipelines. • Automate data workflows such as data ingestion, aggregation, and ETL processing. • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. • Monitor data systems performance and implement optimization strategies. • Must have experience with analyzing, tuning and optimizing queries in the RDBMS. • Strong computer skills, including proficiency in at least one programming language (C/C++, Java, Python) • hands-on experience in designing, developing and maintaining software solutions on ETL process utilizing IBM Infosphere DataStage/Quality Stage. • Experience with large datasets, including structured and unstructured data. • Knowledge of Kafka and messaging is a plus. • Must be able to produce thorough technical design documents, test plans and documented results. • Experience with Agile methodologies and fast pace environment preferred. • Experience developing API Integrations with cloud and other applications. • Experience building applications using Java and Java based frameworks like Spring Boot is strongly preferred. • Strong Skills on SQL, PL/SQL Programming, Query Optimization. • Knowledge of Data Management Strategies (ETL Frameworks, Data Modeling concepts) • Willingness to learn new technologies. • Excellent verbal and written communication skill to clearly and simply communicate complex information. • 5+ years experience working in a Data Warehouse environment (or equivalent). • 5+ years experience with the design, development, automation, and support of applications to extract, transform, and load data; • 5+ years experience with databases, including Oracle, DB2, Teradata, SQL Server, and Access; • 5+ years experience with IBM InfoSphere DataStage; • 5+ years experience with Data warehouse; • 5+ years experience with Unix Shell Scripting; • 5+ years experience with Spring boot is prefered. • Knowledge of Kafka and streaming solutions is a plus

Must be onsite in midtown Atlanta 3-4 days/wk