- Role and Responsibilities
Achieve 100% coverage of Redpen (the internal labeling platform that allows internal users to
manage and perform data labeling tasks) and LabelBox (a vendor solution for providing labeling
workforce) integration (including on-call rotations, migrations and customer support), with less
than 10% supervision from one client FTE.
Example projects/tasks are:
• Refactor Redpen backend by consolidating uploader classes into a single, efficient class.
• Update API endpoints to be resource-based, ensuring efficient and scalable data
• handling.
• Manage and optimize LabelBox integration, switching to LabelBox's new approach to
• custom UIs.
• Client, track, and communicate with LabelBox about bugs and issues, providing
• detailed reports and follow-up.
• Communicate with internal Airbnb clients/stakeholders to gather feedback on LabelBox
• pain points and missing features.
• Maintain Redpen service SLAs, ensuring high availability and performance.
• Monitor, update, and extend internal Datadog dashboards and alerts to account for any
• new issues or changes.
• Extend existing Airflow DAG to export labeling data in various formats, ensuring
• compatibility and data integrity.
• Write, and maintain unit/integration tests, maintain system stability.
Required Skills
Languages:
Python: Advanced proficiency, with experience in writing clean, maintainable, and
efficient code.
SQL/Presto: Strong knowledge of database querying and optimization.
Bash: Proficient in writing scripts for automation and system management.
Tech Stack:
• Flask or equivalent: Experience in developing and maintaining web applications using
Flask.
• Airflow or equivalent: Proficiency in creating and managing workflows using Apache
Airflow.
• Datadog/Pagerduty or equivalent: Experience in setting up and managing monitoring
and alerting systems.
Soft Skills:
• Proactive Attitude: Must not wait for assignments; take initiative and drive projects
forward.
• Clear Communication: Ability to communicate complex technical concepts clearly and
effectively.
• Accountability: Take full responsibility for project outcomes with good time
management and project management skills.
Nice-to-have Skills
• Java/Javascript/Typescript/ React: Solid understanding of frontend and backend
development, with experience in building and maintaining web applications.
• Labeling: Familiarity with any labeling vendor's API and tools for managing data
labeling tasks.
• Kubernetes (K8s): Experience in container orchestration and management using
Kubernetes.
• REST: Proficiency in designing and consuming RESTful APIs.
• Aurora (Database): Strong understanding of Amazon Aurora for managing relational
databases.
• Flask-Migrate: Experience in handling database migrations using Flask-Migrate and
SQLAlchemy ORM.
• Refactoring: Ability to refactor and improve existing codebases for better performance
and maintainability.
• Backend Maintenance: Experience in maintaining backward compatibility while
introducing new features.
• Unit/Integration Test Setup: Proficiency in setting up and maintaining unit and
integration tests.
• API Design: Experience in designing scalable and efficient APIs.
• Observability and Alert Management: Skills in fine-tuning observability and alerting
mechanisms for better system monitoring.
• Data Engineering: Experience in data pipeline design and management.
Emonics LLC