{
  "id": 335778,
  "title": "Be careful when submitting...",
  "url": "/competitions/mayo-clinic-strip-ai/discussion/335778",
  "author_name": "Chris X",
  "post_date": "2022-07-07T20:43:26.541000",
  "votes": 5,
  "comment_count": 7,
  "views": 0,
  "content": "<p>We have only one submission per day here and, unfortunately, if an error occurs (which is not so unlikely given an unknown test set will be \"injected\") this will nevertheless count as such a submission! So let's wait until tomorrow… ;-)</p>",
  "messages": [
    {
      "id": 1847344,
      "postDate": "2022-07-07T20:43:26.540Z",
      "content": "<p>We have only one submission per day here and, unfortunately, if an error occurs (which is not so unlikely given an unknown test set will be \"injected\") this will nevertheless count as such a submission! So let's wait until tomorrow… ;-)</p>",
      "rawMarkdown": "We have only one submission per day here and, unfortunately, if an error occurs (which is not so unlikely given an unknown test set will be \"injected\") this will nevertheless count as such a submission! So let's wait until tomorrow... ;-)",
      "votes": 5
    },
    {
      "id": 1862585,
      "postDate": "2022-07-19T20:08:33.050Z",
      "content": "<p>the reason is that there are a few test images and the metric is binary classification.<br>\none can probe the results easily</p>\n<hr>\n<p>i would suggestion a new way of submitting for future competition like this :</p>\n<ul>\n<li>5 submission per day (for development debugging) for the first few (e.g. 3) days you submitted</li>\n<li>revert to 1 day per submission afterwards</li>\n</ul>\n<p>or make another set of development/debug set for development (e.g. dummy image with same image size of real test set)</p>\n<p>where don't use train set for debugging?</p>\n<ul>\n<li>sometimes my notebook is ok using train set. but results in unknown error in submission. </li>\n</ul>",
      "rawMarkdown": "the reason is that there are a few test images and the metric is binary classification.\none can probe the results easily\n\n---\n\ni would suggestion a new way of submitting for future competition like this :\n- 5 submission per day (for development debugging) for the first few (e.g. 3) days you submitted\n- revert to 1 day per submission afterwards\n\nor make another set of development/debug set for development (e.g. dummy image with same image size of real test set)\n\nwhere don't use train set for debugging?\n- sometimes my notebook is ok using train set. but results in unknown error in submission. ",
      "votes": 3
    },
    {
      "id": 1847829,
      "postDate": "2022-07-08T07:21:39.163Z",
      "content": "<p>Hmm, second day, second fail. Was anybody successful yet to submit something non-trivial?<br>\nMy try is here, but does not work… (submission scoring error):<br>\n<a href=\"https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data\" target=\"_blank\">https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data</a><br>\nMore than happy, about any hints :-)</p>",
      "rawMarkdown": "Hmm, second day, second fail. Was anybody successful yet to submit something non-trivial?\nMy try is here, but does not work... (submission scoring error):\nhttps://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data\nMore than happy, about any hints :-)",
      "replies": [
        {
          "id": 1850616,
          "postDate": "2022-07-10T14:36:26.723Z",
          "content": "<p>Finally found the problem: You need to <strong>remove duplicate entries</strong> in the submission stemming from the fact that patients can have more than one image =&gt; will occur multiple times in submission…</p>",
          "rawMarkdown": "Finally found the problem: You need to **remove duplicate entries** in the submission stemming from the fact that patients can have more than one image => will occur multiple times in submission...",
          "votes": 1
        },
        {
          "id": 1850953,
          "postDate": "2022-07-11T00:21:28.447Z",
          "content": "<p>Failed 3x so far… <a href=\"https://www.kaggle.com/docxian\" target=\"_blank\">@docxian</a> you just dropped duplicates in test dataframe, or submission file?</p>",
          "rawMarkdown": "Failed 3x so far... @docxian you just dropped duplicates in test dataframe, or submission file?"
        },
        {
          "id": 1851787,
          "postDate": "2022-07-11T14:39:44.903Z",
          "content": "<p>I use the test set to build up a submission file. In the end I remove the duplicates.<br>\nSee here: <a href=\"https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data\" target=\"_blank\">https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data</a></p>",
          "rawMarkdown": "I use the test set to build up a submission file. In the end I remove the duplicates.\nSee here: https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data"
        }
      ]
    },
    {
      "id": 1847775,
      "postDate": "2022-07-08T06:28:36.540Z",
      "content": "<p>This is a very important point to note, one submission per day could be a huge challenge, especially at the end of the competition where each improved submission could determine the final standings.</p>",
      "rawMarkdown": "This is a very important point to note, one submission per day could be a huge challenge, especially at the end of the competition where each improved submission could determine the final standings."
    },
    {
      "id": 1847510,
      "postDate": "2022-07-08T01:09:59.157Z",
      "content": "<p>Thank you for saying this.. I nearly wasted it for nothing 😆</p>",
      "rawMarkdown": "Thank you for saying this.. I nearly wasted it for nothing 😆\n"
    }
  ],
  "comments": [
    {
      "id": 1862585,
      "author_name": "hengck23",
      "author_url": "",
      "post_date": "2022-07-19T20:08:33.050000",
      "content": "<p>the reason is that there are a few test images and the metric is binary classification.<br>\none can probe the results easily</p>\n<hr>\n<p>i would suggestion a new way of submitting for future competition like this :</p>\n<ul>\n<li>5 submission per day (for development debugging) for the first few (e.g. 3) days you submitted</li>\n<li>revert to 1 day per submission afterwards</li>\n</ul>\n<p>or make another set of development/debug set for development (e.g. dummy image with same image size of real test set)</p>\n<p>where don't use train set for debugging?</p>\n<ul>\n<li>sometimes my notebook is ok using train set. but results in unknown error in submission. </li>\n</ul>",
      "votes": 3,
      "replies": []
    },
    {
      "id": 1847829,
      "author_name": "Chris X",
      "author_url": "",
      "post_date": "2022-07-08T07:21:39.163000",
      "content": "<p>Hmm, second day, second fail. Was anybody successful yet to submit something non-trivial?<br>\nMy try is here, but does not work… (submission scoring error):<br>\n<a href=\"https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data\" target=\"_blank\">https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data</a><br>\nMore than happy, about any hints :-)</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1850616,
          "author_name": "Chris X",
          "author_url": "",
          "post_date": "2022-07-10T14:36:26.723000",
          "content": "<p>Finally found the problem: You need to <strong>remove duplicate entries</strong> in the submission stemming from the fact that patients can have more than one image =&gt; will occur multiple times in submission…</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1850953,
          "author_name": "Tim Yee",
          "author_url": "",
          "post_date": "2022-07-11T00:21:28.447000",
          "content": "<p>Failed 3x so far… <a href=\"https://www.kaggle.com/docxian\" target=\"_blank\">@docxian</a> you just dropped duplicates in test dataframe, or submission file?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1851787,
          "author_name": "Chris X",
          "author_url": "",
          "post_date": "2022-07-11T14:39:44.903000",
          "content": "<p>I use the test set to build up a submission file. In the end I remove the duplicates.<br>\nSee here: <a href=\"https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data\" target=\"_blank\">https://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data</a></p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1847775,
      "author_name": "Ravi Ramakrishnan",
      "author_url": "",
      "post_date": "2022-07-08T06:28:36.540000",
      "content": "<p>This is a very important point to note, one submission per day could be a huge challenge, especially at the end of the competition where each improved submission could determine the final standings.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1847510,
      "author_name": "The Devastator",
      "author_url": "",
      "post_date": "2022-07-08T01:09:59.157000",
      "content": "<p>Thank you for saying this.. I nearly wasted it for nothing 😆</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1847344": "We have only one submission per day here and, unfortunately, if an error occurs (which is not so unlikely given an unknown test set will be \"injected\") this will nevertheless count as such a submission! So let's wait until tomorrow... ;-)",
    "1862585": "the reason is that there are a few test images and the metric is binary classification.\none can probe the results easily\n\n---\n\ni would suggestion a new way of submitting for future competition like this :\n- 5 submission per day (for development debugging) for the first few (e.g. 3) days you submitted\n- revert to 1 day per submission afterwards\n\nor make another set of development/debug set for development (e.g. dummy image with same image size of real test set)\n\nwhere don't use train set for debugging?\n- sometimes my notebook is ok using train set. but results in unknown error in submission. ",
    "1847829": "Hmm, second day, second fail. Was anybody successful yet to submit something non-trivial?\nMy try is here, but does not work... (submission scoring error):\nhttps://www.kaggle.com/code/docxian/strip-ai-eda-of-structured-data\nMore than happy, about any hints :-)",
    "1847775": "This is a very important point to note, one submission per day could be a huge challenge, especially at the end of the competition where each improved submission could determine the final standings.",
    "1847510": "Thank you for saying this.. I nearly wasted it for nothing 😆\n"
  }
}