{
  "id": 192868,
  "title": "Shakeup like last year?",
  "url": "/competitions/rsna-str-pulmonary-embolism-detection/discussion/192868",
  "author_name": "Kamal Das",
  "post_date": "2020-10-23T19:18:05.979000",
  "votes": 3,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Just looked at last year's RSNA competition, and it had a massive shakeup with many of the top 10 moving up by over 300 places</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2781854%2Fe31dada0fe359b27b43dfd889867d7fc%2Fimage_2020-10-24_004553.png?generation=1603480561425175&amp;alt=media\" alt=\"\"></p>\n<p>what do you think will happen this year?</p>\n<p>All the best for the last few days! May the best modelers win!</p>",
  "messages": [
    {
      "id": 1058500,
      "postDate": "2020-10-23T19:32:00.250Z",
      "content": "<p>I think this was already addressed in a previous thread.</p>\n<p>The previous 2 RSNA competitions (intracranial hemorrhage &amp; pneumonia) were 2-stage competitions. During stage 2, the stage 1 leaderboard was completely wiped out. Competitors had to use the same models they had trained during stage 1 to perform inference on stage 2 test data. The stage 2 public leaderboard was only 1% of the overall dataset, just to make sure people didn't run into any submission errors. </p>\n<p>If you were to compare the final <strong>stage 1</strong> public leaderboard and the final <strong>stage 2</strong> private leaderboard, there was actually very little shakeup. Unfortunately you can't see the stage 1 public LB on Kaggle anymore for those competitions. </p>",
      "rawMarkdown": "I think this was already addressed in a previous thread.\n\nThe previous 2 RSNA competitions (intracranial hemorrhage & pneumonia) were 2-stage competitions. During stage 2, the stage 1 leaderboard was completely wiped out. Competitors had to use the same models they had trained during stage 1 to perform inference on stage 2 test data. The stage 2 public leaderboard was only 1% of the overall dataset, just to make sure people didn't run into any submission errors. \n\nIf you were to compare the final **stage 1** public leaderboard and the final **stage 2** private leaderboard, there was actually very little shakeup. Unfortunately you can't see the stage 1 public LB on Kaggle anymore for those competitions. ",
      "votes": 4,
      "replies": [
        {
          "id": 1058502,
          "postDate": "2020-10-23T19:37:15.437Z",
          "content": "<p>Thanks <a href=\"https://www.kaggle.com/vaillant\" target=\"_blank\">@vaillant</a> <br>\nSorry! I missed your earlier post… Thanks for the jpegs.. they were very helpful!</p>",
          "rawMarkdown": "Thanks @vaillant \nSorry! I missed your earlier post... Thanks for the jpegs.. they were very helpful!",
          "votes": 1
        }
      ]
    },
    {
      "id": 1058492,
      "postDate": "2020-10-23T19:18:05.980Z",
      "content": "<p>Just looked at last year's RSNA competition, and it had a massive shakeup with many of the top 10 moving up by over 300 places</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2781854%2Fe31dada0fe359b27b43dfd889867d7fc%2Fimage_2020-10-24_004553.png?generation=1603480561425175&amp;alt=media\" alt=\"\"></p>\n<p>what do you think will happen this year?</p>\n<p>All the best for the last few days! May the best modelers win!</p>",
      "rawMarkdown": "Just looked at last year's RSNA competition, and it had a massive shakeup with many of the top 10 moving up by over 300 places\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2781854%2Fe31dada0fe359b27b43dfd889867d7fc%2Fimage_2020-10-24_004553.png?generation=1603480561425175&alt=media)\n\nwhat do you think will happen this year?\n\nAll the best for the last few days! May the best modelers win!",
      "votes": 3
    }
  ],
  "comments": [
    {
      "id": 1058500,
      "author_name": "Ian Pan",
      "author_url": "",
      "post_date": "2020-10-23T19:32:00.250000",
      "content": "<p>I think this was already addressed in a previous thread.</p>\n<p>The previous 2 RSNA competitions (intracranial hemorrhage &amp; pneumonia) were 2-stage competitions. During stage 2, the stage 1 leaderboard was completely wiped out. Competitors had to use the same models they had trained during stage 1 to perform inference on stage 2 test data. The stage 2 public leaderboard was only 1% of the overall dataset, just to make sure people didn't run into any submission errors. </p>\n<p>If you were to compare the final <strong>stage 1</strong> public leaderboard and the final <strong>stage 2</strong> private leaderboard, there was actually very little shakeup. Unfortunately you can't see the stage 1 public LB on Kaggle anymore for those competitions. </p>",
      "votes": 4,
      "replies": [
        {
          "id": 1058502,
          "author_name": "Kamal Das",
          "author_url": "",
          "post_date": "2020-10-23T19:37:15.437000",
          "content": "<p>Thanks <a href=\"https://www.kaggle.com/vaillant\" target=\"_blank\">@vaillant</a> <br>\nSorry! I missed your earlier post… Thanks for the jpegs.. they were very helpful!</p>",
          "votes": 1,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1058500": "I think this was already addressed in a previous thread.\n\nThe previous 2 RSNA competitions (intracranial hemorrhage & pneumonia) were 2-stage competitions. During stage 2, the stage 1 leaderboard was completely wiped out. Competitors had to use the same models they had trained during stage 1 to perform inference on stage 2 test data. The stage 2 public leaderboard was only 1% of the overall dataset, just to make sure people didn't run into any submission errors. \n\nIf you were to compare the final **stage 1** public leaderboard and the final **stage 2** private leaderboard, there was actually very little shakeup. Unfortunately you can't see the stage 1 public LB on Kaggle anymore for those competitions. ",
    "1058492": "Just looked at last year's RSNA competition, and it had a massive shakeup with many of the top 10 moving up by over 300 places\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2781854%2Fe31dada0fe359b27b43dfd889867d7fc%2Fimage_2020-10-24_004553.png?generation=1603480561425175&alt=media)\n\nwhat do you think will happen this year?\n\nAll the best for the last few days! May the best modelers win!"
  }
}