Domain Expert, AI Evaluation Task Writer: Finance (Contract, Remote)

Overview

This role is for an independent contractor providing task authoring for AI evaluation and training data. Work is fully remote and asynchronous.

You will design finance- and controls-based tasks that qualified professionals could solve, while also identifying where today’s AI models fail. All tasks, documents, and solutions are human-authored.

Responsibilities

• Build realistic evidence files from provided scenarios, including items such as:
  • Bank statements and cash positions
  • Deal confirmations and settlement records
  • Trial balances and GL extracts
  • Audit workpapers and control evidence
  • Trade blotters and rebalance instructions
  • Position and cash reconciliations
  • Cap tables, grant records, and board consents
• Write clear task requests that specify deliverables and how uncertainty and justified assumptions should be handled.
• Solve each task end to end and document a reference solution with reasoning behind every step.
• Define explicit scoring criteria so two independent graders reach the same verdict, including acceptable alternative answers.
• Run tasks against current models, identify where/why they fail, and adjust difficulty accordingly.
• Review your own and peers’ tasks for ambiguity, errors, exposed answers in materials, and shortcuts that skip intended reasoning.
• Incorporate reviewer feedback within agreed turnaround times and flag guideline gaps or edge cases.

Areas of Focus (Hiring Across)

• Treasury operations: cash positioning and liquidity management; daily cash operations and bank reconciliation; analysis of accruals, exposures, and discrepancies; matching booked deals to counterparty confirmations and settlement records.
• Audit and assurance: external, internal, or government audit; technology assurance; SOX and ITGC controls testing (from evidence and walkthroughs through workpapers, exceptions, findings, and remediation).
• Trading and portfolio operations: pre-trade compliance and clearance; execution trading from rebalance instructions; tickets and blotters; reconciling positions, cash, and holdings against instructions and constraints.
• Equity administration: stock plan administration (grants, vesting, approvals, and plan availability); equity plan analysis (share reserves, outstanding awards, and fair-market-value inputs); corporate paralegal work on board consents and equity transaction documents.

Requirements

• 3+ years of hands-on experience in one or more of the following areas:
  • Treasury operations
  • Audit and assurance
  • Trading and portfolio operations
  • Equity administration
• Strong working knowledge of standards, controls, and rules relevant to your area (examples include US GAAP or IFRS; PCAOB/AICPA auditing standards and SOX; treasury policies and bank controls; trade compliance and restricted-list rules; equity plan documents and fair-market-value requirements).
• Strong spreadsheet skills, with a habit of tying every figure back to its source.
• Clear, precise writing in professional English.
• Ability to work independently and asynchronously against deadlines.

Preferred Qualifications

• CPA, CA, ACCA, CISA, CTP, CFA, or CEP.
• Big Four, public company, bank, asset manager, or fund experience.
• Experience with systems used in your area, such as SAP Treasury or another treasury management system, Bloomberg, AIM or EMSX, or Carta or Shareworks.
• Prior experience writing or reviewing AI evaluation tasks, exam questions, case studies, or training material.
• Familiarity with how AI models fail (e.g., hallucinated figures, confident arithmetic errors, misread documents).

Compensation & Benefits

• Pay: $50–150/hr for task authoring.
  • Paid when the full task is submitted.
  • Potential bonus for each accepted task.
  • Strong performers may move up within that range or onto productivity-based pay.
  • The trial task is paid.

Commitment & Timing

• Commitment: 10+ hours per week.
• Start: Rolling, as soon as you pass the trial task.

Location

• Remote (fully remote).

Standards & Eligibility

• All tasks, documents, and solutions are human-authored. LLM-generated content is not permitted.
• Tasks and solutions must be original; nothing may be copied from published or easily searchable sources.
• Never use real client, employer, or personal data. All scenarios are fictional.
• Quality is judged on accuracy, rubric validity, difficulty, and reviewer agreement—not volume.

Hiring Process

• Short AI interview and resume review.
• One paid trial task, scored against a fixed quality checklist.
• Onboarding and assignment to your first project.
• Target decision timeline: within two weeks of application.

Equal Opportunity

This employer is an equal opportunity employer and provides consideration without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.