Financial Analyst - AI Evaluation

Overview

This role involves evaluating how well AI models can answer questions derived from real financial documents. You will read filings and audited statements, determine the multi-step questions an analyst would need to answer, and assess whether model responses are accurate and well-supported.

Responsibilities

• Read 10-Ks, proxy statements, earnings releases, and audited financial statements; develop the multi-step questions an analyst would face (e.g., reconciling segment results with management’s discussion).
• Write challenging questions that require combining information from several parts of a document, including:
  • the correct answer
  • a checklist for grading responses
• Review answers produced by AI models and other experts; flag items that are wrong, missing, or unsupported by the document, and provide clear feedback on how responses should change.
• Ensure task judgments reflect real-world usage of these documents in financial analysis, maintaining consistent standards across reviews.

Requirements

• Bachelor’s degree in finance, accounting, economics, or a related field.
• At least 3 years of experience as a financial analyst, equity research analyst, credit analyst, FP&A analyst, or auditor.

Required Skills

• Experience reading SEC filings and financial statements closely, including notes, footnotes, and non-GAAP reconciliations.
• Exceptional attention to detail and the ability to apply the same standard across reviews.
• Strong English communication skills, with a focus on written proficiency.

Preferred Qualifications

• CFA or CPA, or experience in bank or credit analysis (preferred, not required).

Compensation & Benefits

Not specified.

Location

Not specified.