[Bug]: HumanEvalFix - 'Series' object has no attribute 'task_id'

[Ethan0456]

Is there an existing issue for the same bug?

• I have checked the troubleshooting document at https://docs.all-hands.dev/modules/usage/troubleshooting
• I have checked the existing issues.

Describe the bug

I was trying to run the run_infer.sh script for the Humanevalfix benchmark. However, when executing the script, I encountered an error where the code was referencing a non-existent column task_id.

Expected behavior

The script should run successfully without errors.

Proposed Solution

It seems the task_id column was renamed to instance_id, but the change hasn't been applied consistently throughout the code. To fix this, all references to task_id should be updated to instance_id across the script to ensure consistent naming and avoid attribute errors.

Current OpenHands version

0.9.8

Installation and Configuration

• Development Workflow

Model and Agent

• Model: gpt-4-1106-preview

Operating System

• Mac OS

Reproduction Steps

• Execute humanevalfix bash script

./evaluation/humanevalfix/scripts/run_infer.sh [MODEL_CONFIG]

Logs, Errors, Screenshots, and Additional Context

10:51:27 - openhands:ERROR: shared.py:311 - ----------
Error in instance [Python/0]: 'Series' object has no attribute 'task_id'. Stacktrace:
Traceback (most recent call last):
  File "/Users/abhijeetsingh/project-repos/OpenHands/evaluation/utils/shared.py", line 281, in _process_instance_wrapper
    result = process_instance_func(instance, metadata, use_mp)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/abhijeetsingh/project-repos/OpenHands/evaluation/humanevalfix/run_infer.py", line 204, in process_instance
    sid = _get_instance_id(instance)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/abhijeetsingh/project-repos/OpenHands/evaluation/humanevalfix/run_infer.py", line 102, in _get_instance_id
    return instance.task_id.replace('/', '__')
           ^^^^^^^^^^^^^^^^
  File "/Users/abhijeetsingh/project-repos/OpenHands/.venv/lib/python3.12/site-packages/pandas/core/generic.py", line 6299, in __getattr__
    return object.__getattribute__(self, name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'Series' object has no attribute 'task_id'

----------[The above error occurred. Retrying... (attempt 1 of 5)]----------