Overview
A leading AI research organization is seeking experienced accountants to participate in a project evaluating the performance of AI systems on real-world accounting tasks. This role focuses on defining standards of excellence by designing grading criteria and scoring completed work samples with detailed, well-reasoned justifications.
Responsibilities
- Develop precise, task-specific grading criteria for accounting deliverables such as reconciliations, close packages, financial statements and disclosures, workpapers, and technical accounting memos.
- Score AI-generated and human work samples against these criteria, providing detailed written explanations for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate on your evaluations accordingly.
Requirements
- Minimum of 5 years of professional accounting experience.
- Background in audit, assurance, or advisory at leading global accounting firms, or senior accounting roles at large public companies.
- CPA or equivalent professional certification is strongly preferred.
- Deep expertise in US GAAP application, month-end close processes, account reconciliations, financial statement preparation and disclosures, and audit-ready workpapers.
- Exceptional written communication skills with the ability to clearly explain why work meets or does not meet professional standards.
- Detail-oriented and consistent, comfortable with having your judgment reviewed and calibrated against peers.
Preferred Qualifications
- Prior experience with AI training, evaluation, or human-data projects is a strong plus.
Application Process
- Submit your resume or relevant professional background to begin the application.
- Qualified candidates may be asked to complete a brief technical assessment or provide additional information.