TalentBurst
Software Engineer
REMOTE
Duration: 12 months plus extensions
We are looking for an experienced software engineer (contract) to join our team. The software engineer will support our ongoing initiatives within infrastructure automation projects. The engineer with work closely with three SWEs, a data scientist, capacity planners and others to deliver applications mainly in big data and infrastructure domains. You will pull data from various data sources, transform and apply algorithms to produce results which will have a high business impact.
To succeed in this SWE position, you should have strong analytical skills and the ability to combine data from different sources with SQL/Python.
Responsibilities: - Build data systems and pipelines - Combine raw information from different sources - Explore ways to enhance data quality and reliability - Develop analytical tools and programs, and build dashboards - Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes - Building ETL jobs for optimal extraction, transformation and loading of data from various data sources using AWS, Airflow, Databricks and SQL technologies. - Building analytical tools to utilize the data pipeline, providing actionable insights into key infrastructure metrics and performance
Requirements
- Previous experience as a SWE engineer or in a similar role - Technical expertise with data models, data mining, and segmentation techniques - Fluent in python - Hands-on experience with SQL database design and experienced to work with hive/databricks or other data warehouses - Have experiences to build dashboards on Tableau/Grafana/Databricks - Experiences on building data pipelines on Airflow is a plus - Great numerical and analytical skills - Degree in Computer Science, IT, or similar field
We are looking for an experienced software engineer (contract) to join our team. The software engineer will support our ongoing initiatives within infrastructure automation projects. The engineer with work closely with three SWEs, a data scientist, capacity planners and others to deliver applications mainly in big data and infrastructure domains. You will pull data from various data sources, transform and apply algorithms to produce results which will have a high business impact.
To succeed in this SWE position, you should have strong analytical skills and the ability to combine data from different sources with SQL/Python.
Responsibilities: - Build data systems and pipelines - Combine raw information from different sources - Explore ways to enhance data quality and reliability - Develop analytical tools and programs, and build dashboards - Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes - Building ETL jobs for optimal extraction, transformation and loading of data from various data sources using AWS, Airflow, Databricks and SQL technologies. - Building analytical tools to utilize the data pipeline, providing actionable insights into key infrastructure metrics and performance
Requirements
- Previous experience as a SWE engineer or in a similar role - Technical expertise with data models, data mining, and segmentation techniques - Fluent in python - Hands-on experience with SQL database design and experienced to work with hive/databricks or other data warehouses - Have experiences to build dashboards on Tableau/Grafana/Databricks - Experiences on building data pipelines on Airflow is a plus - Great numerical and analytical skills - Degree in Computer Science, IT, or similar field