Overview
This role supports the evaluation and improvement of advanced AI models for accounting and tax-related scenarios. You will review AI-generated responses, assess their correctness and completeness, and provide concise, structured feedback.
Responsibilities
- Evaluate and improve accounting reasoning in advanced AI model outputs.
- Review AI-generated responses to accounting and tax scenarios.
- Assess outputs for:
- Factual accuracy
- Accounting correctness
- Completeness
- Professional quality
- Identify issues including:
- Accounting errors and calculation mistakes
- Incorrect tax treatment
- Hallucinations
- Unsupported conclusions
- Gaps in reasoning
- Develop scoring criteria defining what makes an accounting response accurate, complete, and ready for professional review.
- Provide concise, structured written feedback based on your evaluations.
- Participate in project-based assignments, including:
- Annotation
- Rubric development
- Task creation
- Workflow evaluation
- Quality review
- Evaluate real-world accounting workflows and how professionals navigate common accounting and tax software.
Requirements
- 2–6+ years of hands-on professional accounting experience.
- Current or recent experience performing real-world accounting or tax workflows.
- Strong understanding of accounting principles and professional accounting practices.
- Hands-on experience with industry-standard accounting or tax software.
- Strong ability to determine whether accounting work is accurate, complete, and appropriately supported.
- Ability to identify material accounting errors, incorrect assumptions, and inconsistencies.
- Excellent written communication, analytical judgment, and attention to detail.
- Comfort learning new tools and working within structured project guidelines.
- Experience reviewing other accountants’ work or performing accounting quality control is strongly preferred.
Preferred Qualifications
- Experience reviewing other accountants’ work.
- Experience performing accounting quality control.
Compensation & Engagement
- Fully remote, independent contract work.
- Flexible scheduling with no fixed weekly-hour requirement unless stated for a specific project.
- Payments processed weekly based on services rendered.
- Project availability and duration may vary based on client needs and performance.
- High-performing contributors may receive access to additional task-development and review work.
- Participation will not require access to confidential or proprietary information belonging to any employer, client, or institution.
Location
Fully remote.