Compunnel
Job Summary
We are seeking a highly skilled Data Engineer to join the Marketplace Engineering team.
The ideal candidate will have strong expertise in Java, Python, and Scala, with hands-on experience in building scalable data platforms, cloud application development, and microservices.
This role involves collaborating with cross-functional teams to design, develop, and deploy high-performance data solutions.
Key Responsibilities Collaborate with business, product, and engineering teams to understand requirements and deliver scalable data solutions. Design, develop, test, and deploy services and systems for data processing and analytics. Perform code reviews and contribute to operational excellence. Create and enhance medium-sized applications or components within larger systems. Contribute across the technology stack, including front-end, back-end, and data layers. Ensure high availability, scalability, and performance of data systems. Required Qualifications
5+ years of experience in building resilient and scalable systems. Proficiency in Java, Python, and Scala. Experience with REST APIs, GraphQL, and Node.js. Hands-on experience with Hadoop, Hive, Spark (Scala), Vertex AI, Presto/Trino, Kubernetes, Airflow, and Data Lake concepts. Strong understanding of software design, distributed systems, data structures, and algorithms. Skilled in data modeling and data migration protocols. Familiarity with public cloud platforms such as Azure or Google Cloud Platform. Experience with Kafka Connect, Druid, BigQuery, and Looker is a plus. Excellent debugging and production support skills. Proven track record in designing and delivering large-scale software products. Preferred Qualifications
Experience in architect roles for data-backed services and applications. Ability to balance priorities in a fast-paced, complex environment. Strong communication and collaboration skills.
Education:
Bachelors Degree
We are seeking a highly skilled Data Engineer to join the Marketplace Engineering team.
The ideal candidate will have strong expertise in Java, Python, and Scala, with hands-on experience in building scalable data platforms, cloud application development, and microservices.
This role involves collaborating with cross-functional teams to design, develop, and deploy high-performance data solutions.
Key Responsibilities Collaborate with business, product, and engineering teams to understand requirements and deliver scalable data solutions. Design, develop, test, and deploy services and systems for data processing and analytics. Perform code reviews and contribute to operational excellence. Create and enhance medium-sized applications or components within larger systems. Contribute across the technology stack, including front-end, back-end, and data layers. Ensure high availability, scalability, and performance of data systems. Required Qualifications
5+ years of experience in building resilient and scalable systems. Proficiency in Java, Python, and Scala. Experience with REST APIs, GraphQL, and Node.js. Hands-on experience with Hadoop, Hive, Spark (Scala), Vertex AI, Presto/Trino, Kubernetes, Airflow, and Data Lake concepts. Strong understanding of software design, distributed systems, data structures, and algorithms. Skilled in data modeling and data migration protocols. Familiarity with public cloud platforms such as Azure or Google Cloud Platform. Experience with Kafka Connect, Druid, BigQuery, and Looker is a plus. Excellent debugging and production support skills. Proven track record in designing and delivering large-scale software products. Preferred Qualifications
Experience in architect roles for data-backed services and applications. Ability to balance priorities in a fast-paced, complex environment. Strong communication and collaboration skills.
Education:
Bachelors Degree