{
  "id": 445500,
  "title": "would be shake up?",
  "url": "/competitions/rsna-2023-abdominal-trauma-detection/discussion/445500",
  "author_name": "Michalina Hulak",
  "post_date": "2023-10-07T10:36:40.054000",
  "votes": 2,
  "comment_count": 7,
  "views": 0,
  "content": "<p>I am wondering if there will be a shake-up after the competition closes? Is the public score currently being calculated based on the public test set (3 photos)?</p>",
  "messages": [
    {
      "id": 2472466,
      "postDate": "2023-10-07T10:55:47.313Z",
      "content": "<p>CV/LB scores are consistent. I'm not expecting any shake up.</p>",
      "rawMarkdown": "CV/LB scores are consistent. I'm not expecting any shake up.",
      "votes": 3,
      "replies": [
        {
          "id": 2472570,
          "postDate": "2023-10-07T12:21:06.530Z",
          "content": "<p>ok, I also just saw:<br>\n'This leaderboard is calculated with approximately 36% of the test data. The final results will be based on the other 64%, so the final standings may be different.'</p>",
          "rawMarkdown": "ok, I also just saw:\n'This leaderboard is calculated with approximately 36% of the test data. The final results will be based on the other 64%, so the final standings may be different.'\n",
          "votes": 1
        }
      ]
    },
    {
      "id": 2480948,
      "postDate": "2023-10-13T16:47:07.940Z",
      "content": "<p>It's been quite stable for us. I expect shakeup of around +- 0.03 scores in private leaderboard.</p>",
      "rawMarkdown": "It's been quite stable for us. I expect shakeup of around +- 0.03 scores in private leaderboard.",
      "votes": 2
    },
    {
      "id": 2472446,
      "postDate": "2023-10-07T10:36:40.053Z",
      "content": "<p>I am wondering if there will be a shake-up after the competition closes? Is the public score currently being calculated based on the public test set (3 photos)?</p>",
      "rawMarkdown": "I am wondering if there will be a shake-up after the competition closes? Is the public score currently being calculated based on the public test set (3 photos)?",
      "votes": 2
    },
    {
      "id": 2480650,
      "postDate": "2023-10-13T13:06:38.450Z",
      "content": "<p>maybe shake is coming</p>",
      "rawMarkdown": "maybe shake is coming"
    },
    {
      "id": 2472805,
      "postDate": "2023-10-07T16:01:16.903Z",
      "content": "<p>Generally, what is the trend? Like is there a huge change in the dataset composition in the hidden test cases or is it just an extrapolation of the dataset.. Also, I feel the original test cases (the hidden one) might be differnt.. What are yr opinions on this</p>",
      "rawMarkdown": "Generally, what is the trend? Like is there a huge change in the dataset composition in the hidden test cases or is it just an extrapolation of the dataset.. Also, I feel the original test cases (the hidden one) might be differnt.. What are yr opinions on this",
      "replies": [
        {
          "id": 2479025,
          "postDate": "2023-10-12T10:54:15.303Z",
          "content": "<p>I have seen hidden test datasets different from the public… They are quite common. Still the other case is more common I think. Also if CV and LB score is consistent as <a href=\"https://www.kaggle.com/Gunes\" target=\"_blank\">@Gunes</a> Evitan suggest, I would not expect a big shakeup either…</p>",
          "rawMarkdown": "I have seen hidden test datasets different from the public... They are quite common. Still the other case is more common I think. Also if CV and LB score is consistent as @Gunes Evitan suggest, I would not expect a big shakeup either...",
          "replies": [
            {
              "id": 2479263,
              "postDate": "2023-10-12T14:12:13.213Z",
              "content": "<p>and what do you think about popular notebooks with score 0.66?</p>",
              "rawMarkdown": "and what do you think about popular notebooks with score 0.66?"
            }
          ]
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 2472466,
      "author_name": "Gunes Evitan",
      "author_url": "",
      "post_date": "2023-10-07T10:55:47.313000",
      "content": "<p>CV/LB scores are consistent. I'm not expecting any shake up.</p>",
      "votes": 3,
      "replies": [
        {
          "id": 2472570,
          "author_name": "Michalina Hulak",
          "author_url": "",
          "post_date": "2023-10-07T12:21:06.530000",
          "content": "<p>ok, I also just saw:<br>\n'This leaderboard is calculated with approximately 36% of the test data. The final results will be based on the other 64%, so the final standings may be different.'</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 2480948,
      "author_name": "Nischay Dhankhar",
      "author_url": "",
      "post_date": "2023-10-13T16:47:07.940000",
      "content": "<p>It's been quite stable for us. I expect shakeup of around +- 0.03 scores in private leaderboard.</p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 2480650,
      "author_name": "DL",
      "author_url": "",
      "post_date": "2023-10-13T13:06:38.450000",
      "content": "<p>maybe shake is coming</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 2472805,
      "author_name": "Himanshu lal",
      "author_url": "",
      "post_date": "2023-10-07T16:01:16.903000",
      "content": "<p>Generally, what is the trend? Like is there a huge change in the dataset composition in the hidden test cases or is it just an extrapolation of the dataset.. Also, I feel the original test cases (the hidden one) might be differnt.. What are yr opinions on this</p>",
      "votes": 0,
      "replies": [
        {
          "id": 2479025,
          "author_name": "Gyula Maloveczky4",
          "author_url": "",
          "post_date": "2023-10-12T10:54:15.303000",
          "content": "<p>I have seen hidden test datasets different from the public… They are quite common. Still the other case is more common I think. Also if CV and LB score is consistent as <a href=\"https://www.kaggle.com/Gunes\" target=\"_blank\">@Gunes</a> Evitan suggest, I would not expect a big shakeup either…</p>",
          "votes": 0,
          "replies": [
            {
              "id": 2479263,
              "author_name": "Michalina Hulak",
              "author_url": "",
              "post_date": "2023-10-12T14:12:13.213000",
              "content": "<p>and what do you think about popular notebooks with score 0.66?</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2472466": "CV/LB scores are consistent. I'm not expecting any shake up.",
    "2480948": "It's been quite stable for us. I expect shakeup of around +- 0.03 scores in private leaderboard.",
    "2472446": "I am wondering if there will be a shake-up after the competition closes? Is the public score currently being calculated based on the public test set (3 photos)?",
    "2480650": "maybe shake is coming",
    "2472805": "Generally, what is the trend? Like is there a huge change in the dataset composition in the hidden test cases or is it just an extrapolation of the dataset.. Also, I feel the original test cases (the hidden one) might be differnt.. What are yr opinions on this"
  }
}