Get new jobs for this search by email

About Vortexa:

Vortexa was established to bridge the significant information gap in the energy sector. Leveraging vast satellite data and cutting-edge artificial intelligence, Vortexa delivers real-time insights into global seaborne energy flows, fostering transparency and efficiency across energy markets and benefiting society at large. The Challenge:

As we ingest data from a variety of external sources—processing hundreds of data points per second and moving terabytes of information—we face the complexity of running intricate AI models for predictions and forecasts. Coupled with a hybrid human-machine data refinement process, we must ensure that results are delivered through a seamless low-latency SaaS solution used globally. This requires a robust, reliable, and fault-tolerant infrastructure to support diverse users, including data analysts, data scientists, industry experts, and end users. To accommodate fast product iteration cycles, our platform must empower engineers to deploy frequently and independently, minimizing the need for intricate infrastructure knowledge. The Data Services Team is responsible for enhancing the developer platform and managing our extensive Amazon AWS environment, focusing on: Infrastructure availability, security, and cost management Optimizing developer experience We utilize a broad range of technologies, including Kubernetes, Kubevela, Golang, Kafka, Opensearch, Airflow, and Athena. As a crucial member of our small, globally distributed team, you will: Evaluate current technologies to deliver an exceptional engineering experience with rapid development iterations. Help standardize and refine our technology stack. Implement the infrastructure roadmap to ensure 100% uptime and fault-tolerance. Optimize AWS costs and provide a smooth developer experience to data analysts, scientists, and engineers, enhancing their productivity. Automate operational knowledge to allow R&D to focus on creating customer value. You Are: Committed to building infrastructure that enhances developer experience. Skilled at troubleshooting unfamiliar code. A Kubernetes expert with a strong proficiency in AWS. Experienced with Apache Kafka and Kafka Streams, including deployment and monitoring. Fluent in Terraform and Go, with familiarity in cloud-native application design. Ready to tackle challenges in infrastructure troubleshooting. A proactive team player who takes initiative. Awesome If You: Have knowledge of Airflow or similar workflow orchestration tools. Understand data lakes like Parquet, Orc, and Athena. Benefits: Stock options in a rapidly growing, high-potential company A vibrant and diverse workplace A collaborative and supportive culture that values creative thinking and results The chance to work with AI-driven technology in a scale-up environment alongside commodity trading experts 401k with up to 2% matching by Vortexa Private Health Insurance via Blue Cross Shield Dental and Vision coverage through Guardian Global Volunteering Policy to support your initiatives in giving back