Diligente Technologies
Technical Architect – Big Data Analytics (Principal Engineer)
Employment Type: Full time
State: Texas
Remote work is fine
Overview
The Technical Architect – Big Data Analytics (Principal Engineer) will report to a Director– Data and Analytics Technology. Using Big Data technology, you will be responsible for designing, developing, implementing, and supporting data analytics solutions utilizing cloud architecture. Responsibilities
Primary Responsibilities: Lead, develop, build and deliver solutions with high impact and cross-portfolio scope, complexity and collaboration with cross-functional teams, both business and technology Identify technical implementation options and issues Play a key role in setting the vision and defining the future Technology architecture. Develop roadmaps of the systems, platforms and/or processes for the company across our Big Data Analytics portfolio. Provide technical leadership and coaching to other engineers and architects across the organization Act as expert and point of contact in cross-portfolio business/technology/domain/architecture area Partner and communicate cross-functionally across the enterprise Provide the highest level of expertise for the specification, design, development, implementation, and support of Analytical solutions (e.g. Datameer, Hive, Spark, Python, Redshift, Tableau, Snowflake, Microstrategy) Explain technical solutions and issues to senior leaders in the company in non-technical, understandable terms Interact with business teams to gather, interpret, and understand their business needs and create design specifications Foster the continuous evolution of best practices within the development team to ensure data quality, standardization, optimization, and consistency Continuously seek Data Lake platform and data ingestion improvement opportunities that ensure optimal use of the environment and improve stability. Lead efforts to implement the solutions. Qualifications
10+ years of professional experience 6+ years of experience with Big Data technology and analytics Proficient in query languages such as SQL, Hive Proficient in using Big Data tools (e.g., Apache (Spark, NiFi, Sqoop, HBase, HDFS, Spark-SQL, Atlas), NoSQL and relational DBs, Kafka, Datameer) Proficient in API development and consumption, data modeling, preparation, manipulation, loading and optimization, warehousing techniques and technologies Proficient in data preparation and manipulation using Datameer tool Proficient in one or more languages (e.g., PySpark, Python, Scala, Java) Proficient in Hadoop/Hive, Sqoop and Spark Experience with SOA, IaaS, and Cloud Computing technologies, particularly in the AWS environment Experience with ETL and ELT data modeling Experience with DataHub, DBT, Great Expectation Experience with data visualization tools like Tableau Experience with continuous software integration, test and deployment Experience with agile software development paradigm (e.g., Scrum, Kanban) Ability to work within a dynamic environment with evolving requirements and capability goals Self-motivated. Capable of working with little or no supervision. Maintains up-to-date knowledge in the appropriate technical areas Diligente Technologies is an equal opportunity employer and welcomes applications from diverse candidates.
#J-18808-Ljbffr
The Technical Architect – Big Data Analytics (Principal Engineer) will report to a Director– Data and Analytics Technology. Using Big Data technology, you will be responsible for designing, developing, implementing, and supporting data analytics solutions utilizing cloud architecture. Responsibilities
Primary Responsibilities: Lead, develop, build and deliver solutions with high impact and cross-portfolio scope, complexity and collaboration with cross-functional teams, both business and technology Identify technical implementation options and issues Play a key role in setting the vision and defining the future Technology architecture. Develop roadmaps of the systems, platforms and/or processes for the company across our Big Data Analytics portfolio. Provide technical leadership and coaching to other engineers and architects across the organization Act as expert and point of contact in cross-portfolio business/technology/domain/architecture area Partner and communicate cross-functionally across the enterprise Provide the highest level of expertise for the specification, design, development, implementation, and support of Analytical solutions (e.g. Datameer, Hive, Spark, Python, Redshift, Tableau, Snowflake, Microstrategy) Explain technical solutions and issues to senior leaders in the company in non-technical, understandable terms Interact with business teams to gather, interpret, and understand their business needs and create design specifications Foster the continuous evolution of best practices within the development team to ensure data quality, standardization, optimization, and consistency Continuously seek Data Lake platform and data ingestion improvement opportunities that ensure optimal use of the environment and improve stability. Lead efforts to implement the solutions. Qualifications
10+ years of professional experience 6+ years of experience with Big Data technology and analytics Proficient in query languages such as SQL, Hive Proficient in using Big Data tools (e.g., Apache (Spark, NiFi, Sqoop, HBase, HDFS, Spark-SQL, Atlas), NoSQL and relational DBs, Kafka, Datameer) Proficient in API development and consumption, data modeling, preparation, manipulation, loading and optimization, warehousing techniques and technologies Proficient in data preparation and manipulation using Datameer tool Proficient in one or more languages (e.g., PySpark, Python, Scala, Java) Proficient in Hadoop/Hive, Sqoop and Spark Experience with SOA, IaaS, and Cloud Computing technologies, particularly in the AWS environment Experience with ETL and ELT data modeling Experience with DataHub, DBT, Great Expectation Experience with data visualization tools like Tableau Experience with continuous software integration, test and deployment Experience with agile software development paradigm (e.g., Scrum, Kanban) Ability to work within a dynamic environment with evolving requirements and capability goals Self-motivated. Capable of working with little or no supervision. Maintains up-to-date knowledge in the appropriate technical areas Diligente Technologies is an equal opportunity employer and welcomes applications from diverse candidates.
#J-18808-Ljbffr