{ "id": 186578, "title": "Shakeup for this competition?", "url": "/competitions/rsna-str-pulmonary-embolism-detection/discussion/186578", "author_name": "Gold Retriever", "post_date": "2020-09-25T03:24:07.669000", "votes": 3, "comment_count": 5, "views": 0, "content": "

What do you think of shakeup for this competition?

\n

The past RSNA competitions had giant shakes (though private test sets were usually 99% different from this one). Other medical CV competitons also had significant shakes.

", "messages": [ { "id": 1026182, "postDate": "2020-09-25T06:06:49.713Z", "content": "

The last RSNA competition had no shakeup at all!!! The current public/ private leaderboard of that competition is misleading.
\nIt was a two step competition, and the public leaderboard at the end of the first stage is very close to the final private leaderboard.
\nThe public LB of the 2nd stage was not indicative at all (It was on 1%> of the data.

\n

About this comptition:

\n
    \n
  1. We first need to have a real leaderboard with enough real models (currently we don't have a lot of them).
    2. \n
  2. I have a good correlation between my CV and LB and they seem to be stable as there is a lot of data. Hance I don't expect a big shakeup.
    3. \n
", "rawMarkdown": "The last RSNA competition had no shakeup at all!!! The current public/ private leaderboard of that competition is misleading.\nIt was a two step competition, and the public leaderboard at the end of the first stage is very close to the final private leaderboard. \nThe public LB of the 2nd stage was not indicative at all (It was on 1%> of the data.\n\nAbout this comptition:\n1. We first need to have a real leaderboard with enough real models (currently we don't have a lot of them).\n2. I have a good correlation between my CV and LB and they seem to be stable as there is a lot of data. Hance I don't expect a big shakeup. ", "votes": 9, "replies": [ { "id": 1027844, "postDate": "2020-09-26T12:25:24.587Z", "content": "

Same for the first RSNA competition, a 2 stages competition 2 years ago.

", "rawMarkdown": "Same for the first RSNA competition, a 2 stages competition 2 years ago." } ] }, { "id": 1026050, "postDate": "2020-09-25T03:24:07.670Z", "content": "

What do you think of shakeup for this competition?

\n

The past RSNA competitions had giant shakes (though private test sets were usually 99% different from this one). Other medical CV competitons also had significant shakes.

", "rawMarkdown": "What do you think of shakeup for this competition?\n\nThe past RSNA competitions had giant shakes (though private test sets were usually 99% different from this one). Other medical CV competitons also had significant shakes.", "votes": 3 }, { "id": 1056591, "postDate": "2020-10-21T21:36:59.507Z", "content": "

Reviving this post 5 days before the contest ends…

", "rawMarkdown": "Reviving this post 5 days before the contest ends...", "votes": 1, "replies": [ { "id": 1056606, "postDate": "2020-10-21T22:16:48.080Z", "rawMarkdown": "", "isDeleted": true } ] }, { "id": 1027678, "postDate": "2020-09-26T09:45:13.477Z", "content": "

good job ! go ahead

", "rawMarkdown": "good job ! go ahead\n", "votes": -4 } ], "comments": [ { "id": 1026182, "author_name": "yuval reina", "author_url": "", "post_date": "2020-09-25T06:06:49.713000", "content": "

The last RSNA competition had no shakeup at all!!! The current public/ private leaderboard of that competition is misleading.
\nIt was a two step competition, and the public leaderboard at the end of the first stage is very close to the final private leaderboard.
\nThe public LB of the 2nd stage was not indicative at all (It was on 1%> of the data.

\n

About this comptition:

\n
    \n
  1. We first need to have a real leaderboard with enough real models (currently we don't have a lot of them).
    2. \n
  2. I have a good correlation between my CV and LB and they seem to be stable as there is a lot of data. Hance I don't expect a big shakeup.
    3. \n
", "votes": 9, "replies": [ { "id": 1027844, "author_name": "Serigne ", "author_url": "", "post_date": "2020-09-26T12:25:24.587000", "content": "

Same for the first RSNA competition, a 2 stages competition 2 years ago.

", "votes": 0, "replies": [] } ] }, { "id": 1056591, "author_name": "Gold Retriever", "author_url": "", "post_date": "2020-10-21T21:36:59.507000", "content": "

Reviving this post 5 days before the contest ends…

", "votes": 1, "replies": [ { "id": 1056606, "author_name": "", "author_url": "", "post_date": "2020-10-21T22:16:48.080000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 1027678, "author_name": "Naim Mhedhbi", "author_url": "", "post_date": "2020-09-26T09:45:13.477000", "content": "

good job ! go ahead

", "votes": -4, "replies": [] } ], "raw_markdown_by_id": { "1026182": "The last RSNA competition had no shakeup at all!!! The current public/ private leaderboard of that competition is misleading.\nIt was a two step competition, and the public leaderboard at the end of the first stage is very close to the final private leaderboard. \nThe public LB of the 2nd stage was not indicative at all (It was on 1%> of the data.\n\nAbout this comptition:\n1. We first need to have a real leaderboard with enough real models (currently we don't have a lot of them).\n2. I have a good correlation between my CV and LB and they seem to be stable as there is a lot of data. Hance I don't expect a big shakeup. ", "1026050": "What do you think of shakeup for this competition?\n\nThe past RSNA competitions had giant shakes (though private test sets were usually 99% different from this one). Other medical CV competitons also had significant shakes.", "1056591": "Reviving this post 5 days before the contest ends...", "1027678": "good job ! go ahead\n" } }