Kasmo Global
Software Engineer
Location: Plano, TX
Hybrid: 1+ day onsite
Job Description
Seeking SW Engineer to join our AI product development team. On this team, you will solve complex problems and work alongside talented Engineers to design and implement Toyota's Responsible AI Evaluation framework, creating automated evaluation systems for multimodal AI agents across cloud and edgeAI automotive environments. We love people who think big and like to get their hands dirty to help us build exciting initiatives.
Responsibilities:
Location: Plano, TX
Hybrid: 1+ day onsite
Job Description
Seeking SW Engineer to join our AI product development team. On this team, you will solve complex problems and work alongside talented Engineers to design and implement Toyota's Responsible AI Evaluation framework, creating automated evaluation systems for multimodal AI agents across cloud and edgeAI automotive environments. We love people who think big and like to get their hands dirty to help us build exciting initiatives.
Responsibilities:
- Develop and maintain agentic frameworks to provide tools to help customers and business stakeholders run, evaluate, and monitor LLM-based applications
- Design and develop software to create cutting edge solutions by writing maintainable, extensible, tested code, while complying with coding standards
- Design and implement Core ResponsibleAI evaluation framework, scalable APIs, robust logging and audit trail systems
- Implement frameworks for interfacing with diverse AI agents, adapters for different input channels
- Implement comprehensive audit reporting systems, visualization dashboards tools and automate report generation
- Implement error handling and failure recovery mechanisms
- Implement monitoring and observability features, automated testing suites for the framework
- Design for system scalability and performance optimization
- Produce specifications and determine operational feasibility
- Continuously integrate and deliver software components into a fully functional software system
- Be hands-on and lead from the front in following best practices in development and CI/CD methodologies
- Facilitate end to end user testing with customers
- Troubleshoot, debug, and upgrade existing systems
- Work closely with product owners to shape and deliver features to customers
- Write clean, maintainable code while complying to coding standards, share adopted architecture patterns or new technologies
- 3+ years of hands-on software engineering experience
- Experience writing clean, concise, tested, maintainable code in languages such as Python, Java or similar languages
- Experience with cloud platforms (AWS, Azure, GCP) and containerization
- Strong knowledge of RESTful APIs, microservices architecture
- Experience with databases (SQL/NoSQL) and data pipeline development
- Experience with testing frameworks and automation tools, messaging queuing systems and event-driven architectures
- Experience with foundation LLMs, as well as techniques to modify those models for specific applications using tuning, RAGs, or agentic frameworks, transformers and multi-modal AI architecture
- Experience implementing and working with cloud services such as AWS Bedrock, OpenSearch, Strands, MongoDB VoyageAI, etc.
- Experience with monitoring and observability tools such as Datadog
- Familiarity with ML/AI system integration, MLOps practices, responsible AI practices
- Familiarity with prompt engineering and synthetic data generation
- Strong decision-making skills with the ability to analyze data, assess risks, and implement effective solutions in a fast-paced environment
- Problem-solving skills with the ability to identify challenges, develop and quantitatively test creative solutions, and implement effective strategies
- Organized and detail-oriented
- Ability to work independently and take ownership of tasks/assignments
- Ability to apply systems thinking to understand interdependencies and design solutions that achieve results
- Ability to develop healthy working relationships and collaborate with peers and leaders
- Exhibits integrity and high standards in work quality
- Excellent verbal and written communication skills
- Experience effectively communicating complex technical information to stakeholders at all levels in a clear, concise, and meaningful manner to ensure effective collaboration and alignment throughout the project lifecycle