{
  "id": 526883,
  "title": "How do you submit for scoring?",
  "url": "/competitions/ariel-data-challenge-2024/discussion/526883",
  "author_name": "SpaceMeerkat",
  "post_date": "2024-08-08T18:45:24.112000",
  "votes": 2,
  "comment_count": 12,
  "views": 0,
  "content": "<p>I'm really stuck on submitting a file for scoring and can't seem to find any tutorial by the creators, can someone please give some advice? (I'm completely new to Kaggle so please forgive my naivety)</p>\n<p>I have a submission.csv file ready in my input space: 'kaggle/input/submission-dataset-intigers/'<br>\nFull path: '/kaggle/input/submission-dataset-intigers/submission.csv'</p>\n<p>and when I look at the submission it looks right:</p>\n<pre><code>   planet_id      wl_1      wl_2      wl_3      wl_4      wl_5     wl_6  \\\n                \n...\n\n   sigma_277  sigma_278  sigma_279  sigma_280  sigma_281  sigma_282  sigma_283  \n                      \n</code></pre>\n<p>(note: I changed the numbers just to hide my results)</p>\n<p>I use a kaggle notebook in offline mode for the submission with the code:</p>\n<pre><code>\n\n\n\n numpy  np \n pandas  pd \n\n\n\n\n os\n dirname, _, filenames  os.walk():\n     filename  filenames:\n        file_to_load = os.path.join(dirname, filename)\n\ndf = pd.read_csv(file_to_load)\n\n(df) \n\ndf.to_csv(, index= )\n\n\n\n</code></pre>\n<p>But I keep getting failed submissions and I'm now out of attempts for the day (which is a silly penalisation lol). </p>\n<p>Can anyone see glaringly obvious error in submitting like this? </p>\n<p>Many thanks in advance!</p>",
  "messages": [
    {
      "id": 2953561,
      "postDate": "2024-08-08T18:45:24.113Z",
      "content": "<p>I'm really stuck on submitting a file for scoring and can't seem to find any tutorial by the creators, can someone please give some advice? (I'm completely new to Kaggle so please forgive my naivety)</p>\n<p>I have a submission.csv file ready in my input space: 'kaggle/input/submission-dataset-intigers/'<br>\nFull path: '/kaggle/input/submission-dataset-intigers/submission.csv'</p>\n<p>and when I look at the submission it looks right:</p>\n<pre><code>   planet_id      wl_1      wl_2      wl_3      wl_4      wl_5     wl_6  \\\n                \n...\n\n   sigma_277  sigma_278  sigma_279  sigma_280  sigma_281  sigma_282  sigma_283  \n                      \n</code></pre>\n<p>(note: I changed the numbers just to hide my results)</p>\n<p>I use a kaggle notebook in offline mode for the submission with the code:</p>\n<pre><code>\n\n\n\n numpy  np \n pandas  pd \n\n\n\n\n os\n dirname, _, filenames  os.walk():\n     filename  filenames:\n        file_to_load = os.path.join(dirname, filename)\n\ndf = pd.read_csv(file_to_load)\n\n(df) \n\ndf.to_csv(, index= )\n\n\n\n</code></pre>\n<p>But I keep getting failed submissions and I'm now out of attempts for the day (which is a silly penalisation lol). </p>\n<p>Can anyone see glaringly obvious error in submitting like this? </p>\n<p>Many thanks in advance!</p>",
      "rawMarkdown": "I'm really stuck on submitting a file for scoring and can't seem to find any tutorial by the creators, can someone please give some advice? (I'm completely new to Kaggle so please forgive my naivety)\n\nI have a submission.csv file ready in my input space: 'kaggle/input/submission-dataset-intigers/'\nFull path: '/kaggle/input/submission-dataset-intigers/submission.csv'\n\nand when I look at the submission it looks right:\n\n```python\n   planet_id      wl_1      wl_2      wl_3      wl_4      wl_5     wl_6  \\\n0  499191466  0.00123  0.00123  0.00123  0.00123  0.00123  0.00123  \n...\n\n   sigma_277  sigma_278  sigma_279  sigma_280  sigma_281  sigma_282  sigma_283  \n0   0.00123   0.00123   0.00123   0.00123   0.00123   0.00123   0.00123 \n```\n\n(note: I changed the numbers just to hide my results)\n\nI use a kaggle notebook in offline mode for the submission with the code:\n\n```python\n# This Python 3 environment comes with many helpful analytics libraries installed\n# It is defined by the kaggle/python Docker image: https://github.com/kaggle/docker-python\n# For example, here's several helpful packages to load\n\nimport numpy as np # linear algebra\nimport pandas as pd # data processing, CSV file I/O (e.g. pd.read_csv)\n\n# Input data files are available in the read-only \"../input/\" directory\n# For example, running this (by clicking run or pressing Shift+Enter) will list all files under the input directory\n\nimport os\nfor dirname, _, filenames in os.walk('/kaggle/input/submission-dataset-intigers'):\n    for filename in filenames:\n        file_to_load = os.path.join(dirname, filename)\n\ndf = pd.read_csv(file_to_load)\n\nprint(df) ### This gives the results shown in the discussion text above\n\ndf.to_csv('/kaggle/working/submission.csv', index= False)\n\n# You can write up to 20GB to the current directory (/kaggle/working/) that gets preserved as output when you create a version using \"Save & Run All\" \n# You can also write temporary files to /kaggle/temp/, but they won't be saved outside of the current session\n```\n\nBut I keep getting failed submissions and I'm now out of attempts for the day (which is a silly penalisation lol). \n\nCan anyone see glaringly obvious error in submitting like this? \n\nMany thanks in advance!",
      "votes": 2
    },
    {
      "id": 2953779,
      "postDate": "2024-08-09T04:12:55.267Z",
      "content": "<p><a href=\"https://www.kaggle.com/spacemeerkat\" target=\"_blank\">@spacemeerkat</a> =&gt; it's a Notebook competition, test set is replaced with hidden test set. So, you have to submit notebook, which run on hidden test set -&gt; <a href=\"https://www.kaggle.com/code/ambrosm/adc24-intro-inference\" target=\"_blank\">Notebook - ADC24 Intro inference</a> =&gt; go through once public notebook</p>",
      "rawMarkdown": "@spacemeerkat => it's a Notebook competition, test set is replaced with hidden test set. So, you have to submit notebook, which run on hidden test set -> [Notebook - ADC24 Intro inference](https://www.kaggle.com/code/ambrosm/adc24-intro-inference) => go through once public notebook",
      "votes": 1,
      "replies": [
        {
          "id": 2953872,
          "postDate": "2024-08-09T06:50:01.010Z",
          "rawMarkdown": "",
          "votes": 1,
          "isDeleted": true
        },
        {
          "id": 2953899,
          "postDate": "2024-08-09T07:27:05.373Z",
          "content": "<p>Actually, I'm a little confused still.. the notebook you linked to points to the sample_submission.csv which has the results for 1 planet in it. I don't actually see anything pointing to a hidden test set or how that is laid out in the hidden directory. I wonder if the style matches the way the training sets are laid out with a subdirectory per planet_id in /test/ ?</p>\n<p>Sorry for the dumb questions!</p>",
          "rawMarkdown": "Actually, I'm a little confused still.. the notebook you linked to points to the sample_submission.csv which has the results for 1 planet in it. I don't actually see anything pointing to a hidden test set or how that is laid out in the hidden directory. I wonder if the style matches the way the training sets are laid out with a subdirectory per planet_id in /test/ ?\n\nSorry for the dumb questions!",
          "replies": [
            {
              "id": 2953902,
              "postDate": "2024-08-09T07:31:31.280Z",
              "content": "<p><a href=\"https://www.kaggle.com/spacemeerkat\" target=\"_blank\">@spacemeerkat</a> =&gt; folder structure will be same -&gt; , its contents are replaced with hidden dataset. when we submit our notebooks</p>",
              "rawMarkdown": "@spacemeerkat => folder structure will be same -> , its contents are replaced with hidden dataset. when we submit our notebooks",
              "votes": 3
            },
            {
              "id": 2953906,
              "postDate": "2024-08-09T07:38:32.360Z",
              "content": "<p>Okay thanks! So just to be 100% clear, the \"/kaggle/input/ariel-data-challenge-2024/test/\" directory is filled with more planets when running the submission notebooks? 😅</p>",
              "rawMarkdown": "Okay thanks! So just to be 100% clear, the \"/kaggle/input/ariel-data-challenge-2024/test/\" directory is filled with more planets when running the submission notebooks? 😅"
            },
            {
              "id": 2953937,
              "postDate": "2024-08-09T08:13:16.180Z",
              "content": "<blockquote>\n  <p><a href=\"https://www.kaggle.com/spacemeerkat\" target=\"_blank\">@spacemeerkat</a> yes and also test_adc_info.csv and sample_submission.csv =&gt; finally need to output predictions in <strong>submission.csv</strong></p>\n</blockquote>",
              "rawMarkdown": "> @spacemeerkat yes and also test_adc_info.csv and sample_submission.csv => finally need to output predictions in **submission.csv**",
              "votes": 2
            },
            {
              "id": 2954005,
              "postDate": "2024-08-09T09:31:22.563Z",
              "content": "<p>Fantastic, thanks so much <a href=\"https://www.kaggle.com/seshurajup\" target=\"_blank\">@seshurajup</a> , you're a lifesaver! </p>",
              "rawMarkdown": "Fantastic, thanks so much @seshurajup , you're a lifesaver! "
            },
            {
              "id": 2969053,
              "postDate": "2024-08-24T15:05:32.740Z",
              "rawMarkdown": "",
              "isDeleted": true
            },
            {
              "id": 2969060,
              "postDate": "2024-08-24T15:12:40.570Z",
              "content": "<p><a href=\"https://www.kaggle.com/edotirapuka\" target=\"_blank\">@edotirapuka</a> check sample_submission.csv format =&gt; single file =&gt; <strong>submission.csv</strong></p>",
              "rawMarkdown": "@edotirapuka check sample_submission.csv format => single file => **submission.csv**"
            },
            {
              "id": 2969107,
              "postDate": "2024-08-24T16:08:02.820Z",
              "rawMarkdown": "",
              "votes": 1,
              "isDeleted": true
            }
          ]
        }
      ]
    },
    {
      "id": 3005108,
      "postDate": "2024-10-02T15:04:52.383Z",
      "content": "<p>Have you solved the commit issue? I'm having this problem too, could you tell me which directories I can keep and which I need to modify?</p>",
      "rawMarkdown": "Have you solved the commit issue? I'm having this problem too, could you tell me which directories I can keep and which I need to modify?",
      "replies": [
        {
          "id": 3006801,
          "postDate": "2024-10-04T15:04:54.290Z",
          "content": "<p>Hi there,</p>\n<p>The following discussion tells that your /kaggle/working/ directory should only have a submission.csv<br>\nfile. The end result of your output should look like this and no other files present:</p>\n<pre><code>!tree /kaggle/working/\n</code></pre>\n<pre><code>working/\n`-- submissions.csv\n\n directories,  \n</code></pre>\n<p>Source: <a href=\"https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/527295\" target=\"_blank\">discussion/527295</a></p>",
          "rawMarkdown": "Hi there,\n\nThe following discussion tells that your /kaggle/working/ directory should only have a submission.csv\nfile. The end result of your output should look like this and no other files present:\n\n```python\n!tree /kaggle/working/\n```\n\n```\n/kaggle/working/\n`-- submissions.csv\n\n0 directories, 1 file\n```\n\nSource: [discussion/527295](https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/527295)",
          "votes": 1
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 2953779,
      "author_name": "SeshuRaju 🧘‍♂️",
      "author_url": "",
      "post_date": "2024-08-09T04:12:55.267000",
      "content": "<p><a href=\"https://www.kaggle.com/spacemeerkat\" target=\"_blank\">@spacemeerkat</a> =&gt; it's a Notebook competition, test set is replaced with hidden test set. So, you have to submit notebook, which run on hidden test set -&gt; <a href=\"https://www.kaggle.com/code/ambrosm/adc24-intro-inference\" target=\"_blank\">Notebook - ADC24 Intro inference</a> =&gt; go through once public notebook</p>",
      "votes": 1,
      "replies": [
        {
          "id": 2953872,
          "author_name": "",
          "author_url": "",
          "post_date": "2024-08-09T06:50:01.010000",
          "content": "",
          "votes": 1,
          "replies": []
        },
        {
          "id": 2953899,
          "author_name": "SpaceMeerkat",
          "author_url": "",
          "post_date": "2024-08-09T07:27:05.373000",
          "content": "<p>Actually, I'm a little confused still.. the notebook you linked to points to the sample_submission.csv which has the results for 1 planet in it. I don't actually see anything pointing to a hidden test set or how that is laid out in the hidden directory. I wonder if the style matches the way the training sets are laid out with a subdirectory per planet_id in /test/ ?</p>\n<p>Sorry for the dumb questions!</p>",
          "votes": 0,
          "replies": [
            {
              "id": 2953902,
              "author_name": "SeshuRaju 🧘‍♂️",
              "author_url": "",
              "post_date": "2024-08-09T07:31:31.280000",
              "content": "<p><a href=\"https://www.kaggle.com/spacemeerkat\" target=\"_blank\">@spacemeerkat</a> =&gt; folder structure will be same -&gt; , its contents are replaced with hidden dataset. when we submit our notebooks</p>",
              "votes": 3,
              "replies": []
            },
            {
              "id": 2953906,
              "author_name": "SpaceMeerkat",
              "author_url": "",
              "post_date": "2024-08-09T07:38:32.360000",
              "content": "<p>Okay thanks! So just to be 100% clear, the \"/kaggle/input/ariel-data-challenge-2024/test/\" directory is filled with more planets when running the submission notebooks? 😅</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2953937,
              "author_name": "SeshuRaju 🧘‍♂️",
              "author_url": "",
              "post_date": "2024-08-09T08:13:16.180000",
              "content": "<blockquote>\n  <p><a href=\"https://www.kaggle.com/spacemeerkat\" target=\"_blank\">@spacemeerkat</a> yes and also test_adc_info.csv and sample_submission.csv =&gt; finally need to output predictions in <strong>submission.csv</strong></p>\n</blockquote>",
              "votes": 2,
              "replies": []
            },
            {
              "id": 2954005,
              "author_name": "SpaceMeerkat",
              "author_url": "",
              "post_date": "2024-08-09T09:31:22.563000",
              "content": "<p>Fantastic, thanks so much <a href=\"https://www.kaggle.com/seshurajup\" target=\"_blank\">@seshurajup</a> , you're a lifesaver! </p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2969053,
              "author_name": "",
              "author_url": "",
              "post_date": "2024-08-24T15:05:32.740000",
              "content": "",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2969060,
              "author_name": "SeshuRaju 🧘‍♂️",
              "author_url": "",
              "post_date": "2024-08-24T15:12:40.570000",
              "content": "<p><a href=\"https://www.kaggle.com/edotirapuka\" target=\"_blank\">@edotirapuka</a> check sample_submission.csv format =&gt; single file =&gt; <strong>submission.csv</strong></p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2969107,
              "author_name": "",
              "author_url": "",
              "post_date": "2024-08-24T16:08:02.820000",
              "content": "",
              "votes": 1,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3005108,
      "author_name": "KK Weiss",
      "author_url": "",
      "post_date": "2024-10-02T15:04:52.383000",
      "content": "<p>Have you solved the commit issue? I'm having this problem too, could you tell me which directories I can keep and which I need to modify?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3006801,
          "author_name": "sasa",
          "author_url": "",
          "post_date": "2024-10-04T15:04:54.290000",
          "content": "<p>Hi there,</p>\n<p>The following discussion tells that your /kaggle/working/ directory should only have a submission.csv<br>\nfile. The end result of your output should look like this and no other files present:</p>\n<pre><code>!tree /kaggle/working/\n</code></pre>\n<pre><code>working/\n`-- submissions.csv\n\n directories,  \n</code></pre>\n<p>Source: <a href=\"https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/527295\" target=\"_blank\">discussion/527295</a></p>",
          "votes": 1,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2953561": "I'm really stuck on submitting a file for scoring and can't seem to find any tutorial by the creators, can someone please give some advice? (I'm completely new to Kaggle so please forgive my naivety)\n\nI have a submission.csv file ready in my input space: 'kaggle/input/submission-dataset-intigers/'\nFull path: '/kaggle/input/submission-dataset-intigers/submission.csv'\n\nand when I look at the submission it looks right:\n\n```python\n   planet_id      wl_1      wl_2      wl_3      wl_4      wl_5     wl_6  \\\n0  499191466  0.00123  0.00123  0.00123  0.00123  0.00123  0.00123  \n...\n\n   sigma_277  sigma_278  sigma_279  sigma_280  sigma_281  sigma_282  sigma_283  \n0   0.00123   0.00123   0.00123   0.00123   0.00123   0.00123   0.00123 \n```\n\n(note: I changed the numbers just to hide my results)\n\nI use a kaggle notebook in offline mode for the submission with the code:\n\n```python\n# This Python 3 environment comes with many helpful analytics libraries installed\n# It is defined by the kaggle/python Docker image: https://github.com/kaggle/docker-python\n# For example, here's several helpful packages to load\n\nimport numpy as np # linear algebra\nimport pandas as pd # data processing, CSV file I/O (e.g. pd.read_csv)\n\n# Input data files are available in the read-only \"../input/\" directory\n# For example, running this (by clicking run or pressing Shift+Enter) will list all files under the input directory\n\nimport os\nfor dirname, _, filenames in os.walk('/kaggle/input/submission-dataset-intigers'):\n    for filename in filenames:\n        file_to_load = os.path.join(dirname, filename)\n\ndf = pd.read_csv(file_to_load)\n\nprint(df) ### This gives the results shown in the discussion text above\n\ndf.to_csv('/kaggle/working/submission.csv', index= False)\n\n# You can write up to 20GB to the current directory (/kaggle/working/) that gets preserved as output when you create a version using \"Save & Run All\" \n# You can also write temporary files to /kaggle/temp/, but they won't be saved outside of the current session\n```\n\nBut I keep getting failed submissions and I'm now out of attempts for the day (which is a silly penalisation lol). \n\nCan anyone see glaringly obvious error in submitting like this? \n\nMany thanks in advance!",
    "2953779": "@spacemeerkat => it's a Notebook competition, test set is replaced with hidden test set. So, you have to submit notebook, which run on hidden test set -> [Notebook - ADC24 Intro inference](https://www.kaggle.com/code/ambrosm/adc24-intro-inference) => go through once public notebook",
    "3005108": "Have you solved the commit issue? I'm having this problem too, could you tell me which directories I can keep and which I need to modify?"
  }
}