Overview
This is a Contract Finance & Accounting Specialist role focused on rubric design and evaluation. Work will be performed remotely within the US.
Compensation: Up to $100/hr
Responsibilities
- Create professional finance tasks, including challenging problems across areas such as financial analysis, accounting, valuation, investment analysis, audit, and related analytical work.
- Design scoring rubrics by defining expected calculations, assumptions, reasoning, and professional considerations for strong responses.
- Evaluate financial outputs by reviewing AI-generated analyses for accuracy, methodology, logic, and completeness.
- Assess professional judgment by determining whether assumptions and conclusions are reasonable and sufficiently supported.
- Identify material errors, including incorrect calculations, accounting treatment, valuation logic, financial interpretation, or risk analysis.
- Critique peer rubrics for ambiguity, missing components, duplication, excessive subjectivity, and technical errors.
- Develop reference content, including high-quality analyses, solutions, critiques, and explanations.
- Support AI training by generating tasks, rubrics, evaluations, preferences, and reference-answer pairs suitable for RL and SFT.
- Maintain professional standards by ensuring outputs reflect appropriate finance and accounting conventions and terminology.
Requirements
- Bachelor’s degree or higher in Finance, Accounting, Economics, Business, Applied Mathematics, or a related discipline.
- Strong professional proficiency in English (minimum C1).
- 3+ years of professional experience in finance, accounting, investment analysis, corporate finance, financial reporting, audit, consulting, risk, or a related field.
- Strong knowledge of professional methodologies, calculations, assumptions, and analytical standards relevant to your specialty.
- Ability to create realistic professional finance or accounting tasks that require judgment rather than simple factual recall.
- Strong ability to design detailed rubrics covering accuracy, methodology, assumptions, completeness, materiality, reasoning quality, and professional presentation.
- Ability to distinguish between calculation errors, methodological errors, unsupported assumptions, and reasonable professional differences.
- Comfortable critiquing rubrics created by other finance or accounting experts.
- High attention to detail when reviewing numerical accuracy, financial logic, terminology, assumptions, reconciliations, and conclusions.
Preferred Qualifications
- Relevant professional certifications such as CPA, CFA, ACCA, ACA, CMA, FRM, or equivalent (strongly preferred where applicable).
- Experience with training, examination writing, audit review, investment committee review, financial QA, research review, or professional assessment (strongly preferred).
- Prior experience with AI evaluation, model benchmarking, annotation, RLHF, or rubric-based scoring (preferred).
Compensation & Benefits
- Rate: Up to $100/hr
- Type: Contract
Location