{
  "id": 600908,
  "title": "Rescoring submissions after the dataset update? ",
  "url": "/competitions/rsna-intracranial-aneurysm-detection/discussion/600908",
  "author_name": "AC",
  "post_date": "2025-08-25T16:57:14.268000",
  "votes": 6,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Hey, there! <br>\nI've been away for a week, turns out there has been a dataset update, are the submissions not rescored with the new dataset?<br>\nI tried to submit a high-scoring notebook ( zero changes ), it's scoring 0.50 on the lb now. In the past, if there's been any such update, the submissions are usually rescored, I saw a couple of threads facing some issue in their (previously working). submission post update, I feel resubmission would help everybody and the competition. </p>",
  "messages": [
    {
      "id": 3274946,
      "postDate": "2025-08-25T16:57:14.270Z",
      "content": "<p>Hey, there! <br>\nI've been away for a week, turns out there has been a dataset update, are the submissions not rescored with the new dataset?<br>\nI tried to submit a high-scoring notebook ( zero changes ), it's scoring 0.50 on the lb now. In the past, if there's been any such update, the submissions are usually rescored, I saw a couple of threads facing some issue in their (previously working). submission post update, I feel resubmission would help everybody and the competition. </p>",
      "rawMarkdown": "Hey, there! \nI've been away for a week, turns out there has been a dataset update, are the submissions not rescored with the new dataset?\nI tried to submit a high-scoring notebook ( zero changes ), it's scoring 0.50 on the lb now. In the past, if there's been any such update, the submissions are usually rescored, I saw a couple of threads facing some issue in their (previously working). submission post update, I feel resubmission would help everybody and the competition. ",
      "votes": 6
    },
    {
      "id": 3279023,
      "postDate": "2025-08-31T03:50:28.297Z",
      "content": "<p>Submissions are fixed now, as per the latest update. I had the same issue (0.5 LB) , but the scores are correct for me now. There is rescoring that's going to happen as well.</p>",
      "rawMarkdown": "Submissions are fixed now, as per the latest update. I had the same issue (0.5 LB) , but the scores are correct for me now. There is rescoring that's going to happen as well.",
      "votes": 1,
      "replies": [
        {
          "id": 3279325,
          "postDate": "2025-08-31T16:18:25.120Z",
          "content": "<p>Thanks for confirming!! :)) </p>",
          "rawMarkdown": "Thanks for confirming!! :)) "
        }
      ]
    },
    {
      "id": 3280284,
      "postDate": "2025-09-02T12:33:27.823Z",
      "content": "<p>We have decided not to rescore given that only a very small number of cases were changed with the update (&lt;5%).</p>",
      "rawMarkdown": "We have decided not to rescore given that only a very small number of cases were changed with the update (<5%)."
    },
    {
      "id": 3278947,
      "postDate": "2025-08-30T19:15:17.220Z",
      "content": "<p>Is it working fine now? </p>",
      "rawMarkdown": "Is it working fine now? "
    }
  ],
  "comments": [
    {
      "id": 3279023,
      "author_name": "Satwik",
      "author_url": "",
      "post_date": "2025-08-31T03:50:28.297000",
      "content": "<p>Submissions are fixed now, as per the latest update. I had the same issue (0.5 LB) , but the scores are correct for me now. There is rescoring that's going to happen as well.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 3279325,
          "author_name": "AC",
          "author_url": "",
          "post_date": "2025-08-31T16:18:25.120000",
          "content": "<p>Thanks for confirming!! :)) </p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 3280284,
      "author_name": "Evan Calabrese",
      "author_url": "",
      "post_date": "2025-09-02T12:33:27.823000",
      "content": "<p>We have decided not to rescore given that only a very small number of cases were changed with the update (&lt;5%).</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3278947,
      "author_name": "AC",
      "author_url": "",
      "post_date": "2025-08-30T19:15:17.220000",
      "content": "<p>Is it working fine now? </p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3274946": "Hey, there! \nI've been away for a week, turns out there has been a dataset update, are the submissions not rescored with the new dataset?\nI tried to submit a high-scoring notebook ( zero changes ), it's scoring 0.50 on the lb now. In the past, if there's been any such update, the submissions are usually rescored, I saw a couple of threads facing some issue in their (previously working). submission post update, I feel resubmission would help everybody and the competition. ",
    "3279023": "Submissions are fixed now, as per the latest update. I had the same issue (0.5 LB) , but the scores are correct for me now. There is rescoring that's going to happen as well.",
    "3280284": "We have decided not to rescore given that only a very small number of cases were changed with the update (<5%).",
    "3278947": "Is it working fine now? "
  }
}