Skip to content

Add metadata.json for vestigeverum5.2 submissions - #180

Open
888jjm-dotcom wants to merge 2 commits into
liamdugan:mainfrom
888jjm-dotcom:main
Open

Add metadata.json for vestigeverum5.2 submissions#180
888jjm-dotcom wants to merge 2 commits into
liamdugan:mainfrom
888jjm-dotcom:main

Conversation

@888jjm-dotcom

Copy link
Copy Markdown

hi there, submission made please may this be run.

@github-actions

Copy link
Copy Markdown

It looks like this eval run failed. Please check the workflow logs to see what went wrong, then push a new commit to your PR to rerun the eval.

@liamdugan

Copy link
Copy Markdown
Owner

Hey @888jjm-dotcom It looks like your submission errored. Here's the full traceback:

Traceback (most recent call last):
  File "/home/runner/work/raid/raid/leaderboard/hydrate.py", line 74, in hydrate_all
    result_fp = eval_submission(submission)
  File "/home/runner/work/raid/raid/leaderboard/hydrate.py", line 163, in eval_submission
    eval_results = run_evaluation(d, df, target_fpr=(0.05, 0.01))
  File "/home/runner/work/raid/raid/raid/evaluate.py", line 233, in run_evaluation
    df = load_detection_result(df, results)
  File "/home/runner/work/raid/raid/raid/evaluate.py", line 11, in load_detection_result
    scores_df = pd.DataFrame.from_records(results)
  File "/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/pandas/core/frame.py", line 2491, in from_records
    arrays, arr_columns = to_arrays(data, columns)
  File "/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/pandas/core/internals/construction.py", line 842, in to_arrays
    data = [tuple(x) for x in data]
  File "/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/pandas/core/internals/construction.py", line 842, in <listcomp>
    data = [tuple(x) for x in data]
TypeError: 'float' object is not iterable
Error: 'float' object is not iterable
Done. Wrote 0 results files.
Error: Process completed with exit code 1.

Can you make sure that you have a single floating point value in score for every id in the test set? Please consult the predictions.json file from other submissions for examples of the correct format

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants