Skip to content

Compare question sets

q-v0.2 → q-v0.3

Why it changed

q-v0.3 adds seven questions for an interrupted course, prompted by GOLD-TMP-17: q-v0.2 has one start and one end date, so it read that held-and-restarted course as one 133-day course and both Jev and Claude auto-approved it. q-v0.3 was developed on gen-v0.3-dev and evaluated once on gen-v0.3-holdout; gold is not a blind test for it on GOLD-TMP-17 and GOLD-TMP-18.

docs/RESULTS.md
12 → 19 questions7 added · 7 changed · 0 removed · 5 unchangedkey: added words removed words

  1. 05mtx_start_month

    choice · Choice

    CHANGED

    In which month did the patient (not a relative or other person) start taking methotrexate (the first time, if it was restarted)? Answer 'none' if the documents do not state the month.

    Options: January … December, none

    none
    The documents do not state this, or the patient never took the medication.

  2. 06mtx_start_day

    choice · Choice

    CHANGED

    On which day of the month (1-31) did the patient (not a relative or other person) start taking methotrexate (the first time, if it was restarted)? Answer 'none' if the day is not stated, for example when only a month is given.

    Options: 1 … 31, none

    none
    The documents do not state this, or the patient never took the medication.

  3. 07mtx_start_year

    choice · Choice

    CHANGED

    In which year did the patient (not a relative or other person) start taking methotrexate (the first time, if it was restarted)? Answer 'none' if no year is stated for this event.

    Options: years found in the case, none

    none
    The documents do not state this, or the patient never took the medication.

  4. 08mtx_end_status

    choice · Choice

    CHANGED

    What is the status of the patient's own methotrexate treatment (not a relative's) (the last time, if it was restarted)?

    Options: ended, ongoing, not_stated

    ended
    The documents say the patient stopped taking methotrexate.
    ongoing
    The documents say the patient is still taking methotrexate.
    not_stated
    The documents do not say, or the patient never took methotrexate.

  5. 09mtx_end_month

    choice · Choice

    CHANGED

    In which month did the patient (not a relative or other person) stop taking methotrexate (the last time, if it was restarted)? Answer 'none' if the documents do not state the month.

    Options: January … December, none

    none
    The documents do not state this, or the patient never took the medication.

  6. 10mtx_end_day

    choice · Choice

    CHANGED

    On which day of the month (1-31) did the patient (not a relative or other person) stop taking methotrexate (the last time, if it was restarted)? Answer 'none' if the day is not stated, for example when only a month is given.

    Options: 1 … 31, none

    none
    The documents do not state this, or the patient never took the medication.

  7. 11mtx_end_year

    choice · Choice

    CHANGED

    In which year did the patient (not a relative or other person) stop taking methotrexate (the last time, if it was restarted)? Answer 'none' if no year is stated for this event.

    Options: years found in the case, none

    none
    The documents do not state this, or the patient never took the medication.

  8. 13mtx_interrupted

    yes/no · Noul

    ADDED

    Do the documents describe the patient's own methotrexate being held, paused or stopped and later restarted?

    yes (true)
    A clinical record states that the patient's own methotrexate was held, paused or stopped, and that the patient later resumed or restarted it.
    no (false)
    The patient took one continuous course, never took methotrexate, or the hold and restart describe a relative or another person.

  9. 14mtx_pause_month

    choice · Choice

    ADDED

    In which month did the patient (not a relative or other person) first stop taking methotrexate before restarting it (a hold or pause counts as a stop)? Answer 'none' if the documents do not state the month, or if the course was never stopped and restarted.

    Options: January … December, none

    none
    The documents do not state this, or the patient's course was never held, paused or stopped and then restarted.

  10. 15mtx_pause_day

    choice · Choice

    ADDED

    On which day of the month (1-31) did the patient (not a relative or other person) first stop taking methotrexate before restarting it (a hold or pause counts as a stop)? Answer 'none' if the day is not stated, for example when only a month is given, or if the course was never stopped and restarted.

    Options: 1 … 31, none

    none
    The documents do not state this, or the patient's course was never held, paused or stopped and then restarted.

  11. 16mtx_pause_year

    choice · Choice

    ADDED

    In which year did the patient (not a relative or other person) first stop taking methotrexate before restarting it (a hold or pause counts as a stop)? Answer 'none' if no year is stated for this event, or if the course was never stopped and restarted.

    Options: years found in the case, none

    none
    The documents do not state this, or the patient's course was never held, paused or stopped and then restarted.

  12. 17mtx_restart_month

    choice · Choice

    ADDED

    In which month did the patient (not a relative or other person) restart taking methotrexate after a hold, pause or stop? Answer 'none' if the documents do not state the month, or if the course was never stopped and restarted.

    Options: January … December, none

    none
    The documents do not state this, or the patient's course was never held, paused or stopped and then restarted.

  13. 18mtx_restart_day

    choice · Choice

    ADDED

    On which day of the month (1-31) did the patient (not a relative or other person) restart taking methotrexate after a hold, pause or stop? Answer 'none' if the day is not stated, for example when only a month is given, or if the course was never stopped and restarted.

    Options: 1 … 31, none

    none
    The documents do not state this, or the patient's course was never held, paused or stopped and then restarted.

  14. 19mtx_restart_year

    choice · Choice

    ADDED

    In which year did the patient (not a relative or other person) restart taking methotrexate after a hold, pause or stop? Answer 'none' if no year is stated for this event, or if the course was never stopped and restarted.

    Options: years found in the case, none

    none
    The documents do not state this, or the patient's course was never held, paused or stopped and then restarted.
5 unchanged questions: diagnosis_support, documentation_complete, material_contradiction, missing_evidence, mtx_inadequate_response

  1. 01diagnosis_support

    yes/no · Noul

    UNCHANGED

    Do the clinical documents establish a clinician-documented diagnosis of rheumatoid arthritis for this patient, as the policy requires?

    yes (true)
    A clinician states that the patient has rheumatoid arthritis as an established diagnosis.
    no (false)
    The diagnosis is absent, only suspected, pending workup, or describes someone other than the patient.

  2. 02documentation_complete

    yes/no · Noul

    UNCHANGED

    Does this request include every item the policy lists under submission documentation?

    yes (true)
    The insurance member ID, a clinician note supporting the diagnosis, and the patient's treatment history (including whether and when methotrexate was taken) are all present (a statement that the patient never took methotrexate counts as treatment history).
    no (false)
    At least one required item is missing, unavailable, or marked as not provided.

  3. 03material_contradiction

    yes/no · Noul

    UNCHANGED

    Do the case documents contain a material contradiction about the patient's diagnosis or treatment history that affects this authorization?

    yes (true)
    Two sources make incompatible claims about the same fact, for example one record shows a medication was taken while another says it was never tried.
    no (false)
    The sources agree, or differ only in wording, detail, or precision without conflicting.

  4. 04missing_evidence

    choice · Choice

    UNCHANGED

    What is the most important information missing from this request for the policy decision, if any?

    Options: DIAGNOSIS, TREATMENT_HISTORY, LAB_RESULT, DOSAGE, INSURANCE_INFORMATION, NONE

    DIAGNOSIS
    No established diagnosis of rheumatoid arthritis is documented.
    TREATMENT_HISTORY
    The records do not say whether or when the patient took methotrexate. A record stating that the patient never took methotrexate counts as documented treatment history.
    LAB_RESULT
    A lab result that the decision depends on is missing.
    DOSAGE
    The requested dose or regimen is missing.
    INSURANCE_INFORMATION
    The insurance member ID or plan information is missing.
    NONE
    Nothing that the policy requires is missing.

  5. 12mtx_inadequate_response

    yes/no · Noul

    UNCHANGED

    Is it documented that the patient's own methotrexate treatment was ineffective (inadequate response) or was stopped because of intolerance or a contraindication?

    yes (true)
    A clinician documents that methotrexate did not adequately control this patient's disease, or that it caused intolerance or is contraindicated for this patient.
    no (false)
    There is no such documentation for this patient; statements about relatives or other people do not count, and neither does a different medication.