Senior Data and AI Analyst

About Us Auditoria is an AI-driven SaaS automation provider for corporate finance that automates back-office business processes involving tasks, analytics, and responses in Vendor Management, Accounts Payable, Accounts Receivable, and Planning. By leveraging natural language processing, artificial intelligence, and machine learning, Auditoria removes friction and repetition from mundane tasks while automating complex functions and providing real-time visibility into cash performance. Corporate finance and accounting teams use Auditoria to accelerate business value while minimizing heavy IT involvement, improving business resilience, lowering attrition, and accelerating business insights. Founded in 2019 and backed by Venrock, Workday Ventures, Neotribe Ventures, Engineering Capital, and Firebolt Ventures, we build intelligent automation by combining fine-grained analytical orchestration of a company's typical financial and audit workflows with conversational AI, delivering rapid value to the finance/audit back office. Since then, Auditoria was again named to the Constellation Shortlist for a record four consecutive years ( 20, 21, 22, 23). In 2022, Gartner named Auditoria a Cool Vendor in Finance , a curated list of solutions that challenge the traditional finance software market. In 2023, CRN once again recognized Auditoria as a Finalist for the CRN Tech Innovators Award . The SaaS Awards named Auditoria as a 2023 SaaS Awards Finalist for Best SaaS for Improved Productivity (USA). Most recently Auditoria was named a finalist for the 2023 SSON Impact Awards for Technology of the Year. The Opportunity for You We're seeking a Senior Data and AI Analyst to drive insights across both our AI platform performance and business operations. You'll work at the intersection of AI, financial operations, and advanced analytics, helping to optimize our AI models, evaluate automation effectiveness, and deliver data-driven value to enterprise clients. This role combines traditional business analysis with the exciting challenge of measuring and improving AI system performance. Key Responsibilities Business Process Analysis Design and maintain comprehensive analytics frameworks for business processes and financial workflows Develop dashboards and reports that provide real-time insights into key business metrics Analyze user interaction patterns with AI features to improve adoption and effectiveness Create and maintain ETL pipelines (if necessary) to ensure data quality and accessibility Generate actionable insights from complex financial datasets to guide product strategy AI Platform Analysis Develop and implement frameworks to evaluate the performance of LLM-based systems and AI agent.s Analyze AI model outputs, response quality, and automation effectiveness Track and report on key AI performance metrics such as accuracy, latency, and automation rates Collaborate with ML engineers to identify areas for model improvements based on data insights Create dashboards for monitoring AI system performance and reliability Conduct A/B testing of different AI configurations and prompt strategies Strategic Impact Provide data-driven recommendations for improving both AI capabilities and business processes Partner with product teams to define and track success metrics for AI features Collaborate with customer success teams to analyze user feedback and AI system effectiveness Build and maintain documentation for AI performance metrics and analytics processes Qualifications Required Qualifications 5+ years of experience in data analysis, with recent exposure to AI/ML systems Strong proficiency in SQL and Python for data manipulation and analysis Experience analyzing AI/ML system performance and metrics Expert-level experience with business intelligence tools (e.g., Tableau, Power BI, Looker) Experience working with large-scale financial datasets and ETL processes Strong statistical analysis skills and experience with A/B testing Experience with cloud-based data warehouses (preferably Snowflake) Bachelor's degree in Statistics, Mathematics, Computer Science, or related field Preferred Qualifications Experience analyzing LLM-based systems and generative AI applications Knowledge of NLP metrics and evaluation frameworks Experience with financial systems and processes (AP, AR, Vendor Management) Familiarity with prompt engineering and LLM performance optimization Experience with real-time analytics and streaming data Knowledge of data privacy and compliance requirements in finance Master's degree in related field Technical Skills Data Analysis & Visualization Python (Pandas, NumPy, Matplotlib, Seaborn, Plotly, Dash) SQL (expert-level analytics) Tableau/Power BI/QuickSight Excel (advanced) AI/ML Analytics LLM evaluation metrics AI monitoring frameworks Prompt effectiveness analysis Data Infrastructure Snowflake or similar data warehouses Experience with ETL tools and frameworks Data modeling Statistics & Testing Statistical analysis A/B testing Hypothesis testing Business & Domain SaaS metrics Process optimization Data governance What We Offer Competitive startup compensation package Early-stage equity options Unlimited PTO Flexible work environment Opportunity to shape the future of AI in enterprise finance Auditoria.AI is an equal-opportunity employer committed to building a diverse and inclusive team. We welcome candidates of all backgrounds passionate about combining cutting-edge AI with practical business solutions. The Auditoria logo, Auditoria SmartFlow Skills, Auditoria AR Collections, Auditoria SmartPay, Auditoria SmartBots, Auditoria SmartInsights, and Auditoria SmartVendor are trademarks or registered trademarks of Auditoria.AI Inc. All rights reserved. #J-18808-Ljbffr