{
  "id": 544091,
  "title": "2nd place code available (upgraded to 0.7549 private LB)",
  "url": "/competitions/ariel-data-challenge-2024/discussion/544091",
  "author_name": "Jeroen Cottaar",
  "post_date": "2024-11-03T06:48:24.592000",
  "votes": 17,
  "comment_count": 8,
  "views": 0,
  "content": "<p>I've now made public two notebooks and the underlying library for my 2nd place result:</p>\n<ul>\n<li>If you want to reproduce my submissions (either the original 2nd place or with later improvements based on suggestions from <a href=\"https://www.kaggle.com/cnumber\" target=\"_blank\">@cnumber</a>), or make your own: <a href=\"https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-submission-notebook\" target=\"_blank\">https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-submission-notebook</a></li>\n<li>If you want to visualize the model (similar to the plots in my solution thread): <a href=\"https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-visualization-notebook\" target=\"_blank\">https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-visualization-notebook</a></li>\n</ul>\n<p>Please leave questions about my code here, rather than in the original solution thread (<a href=\"https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/543853)\" target=\"_blank\">https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/543853)</a>, which is quite busy already.</p>\n<p>I've done my best to structure and comment the code, but it will be quite challenging if you want to study it in detail. I recommend starting with ariel_gp.py-&gt;define_prior(), which implements the Bayesian prior as I described in my solution thread. It'll take some time to grasp, but you will see how we can really translate our description of the physics directly into code.</p>",
  "messages": [
    {
      "id": 3035224,
      "postDate": "2024-11-03T06:48:24.593Z",
      "content": "<p>I've now made public two notebooks and the underlying library for my 2nd place result:</p>\n<ul>\n<li>If you want to reproduce my submissions (either the original 2nd place or with later improvements based on suggestions from <a href=\"https://www.kaggle.com/cnumber\" target=\"_blank\">@cnumber</a>), or make your own: <a href=\"https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-submission-notebook\" target=\"_blank\">https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-submission-notebook</a></li>\n<li>If you want to visualize the model (similar to the plots in my solution thread): <a href=\"https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-visualization-notebook\" target=\"_blank\">https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-visualization-notebook</a></li>\n</ul>\n<p>Please leave questions about my code here, rather than in the original solution thread (<a href=\"https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/543853)\" target=\"_blank\">https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/543853)</a>, which is quite busy already.</p>\n<p>I've done my best to structure and comment the code, but it will be quite challenging if you want to study it in detail. I recommend starting with ariel_gp.py-&gt;define_prior(), which implements the Bayesian prior as I described in my solution thread. It'll take some time to grasp, but you will see how we can really translate our description of the physics directly into code.</p>",
      "rawMarkdown": "I've now made public two notebooks and the underlying library for my 2nd place result:\n- If you want to reproduce my submissions (either the original 2nd place or with later improvements based on suggestions from @cnumber), or make your own: https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-submission-notebook\n- If you want to visualize the model (similar to the plots in my solution thread): https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-visualization-notebook\n\nPlease leave questions about my code here, rather than in the original solution thread (https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/543853), which is quite busy already.\n\nI've done my best to structure and comment the code, but it will be quite challenging if you want to study it in detail. I recommend starting with ariel_gp.py->define_prior(), which implements the Bayesian prior as I described in my solution thread. It'll take some time to grasp, but you will see how we can really translate our description of the physics directly into code.\n",
      "votes": 16
    },
    {
      "id": 3035332,
      "postDate": "2024-11-03T09:35:23.470Z",
      "content": "<p>TY. I'll try to learn that in depth.  <br>\nI want to point out that I'm not sure CC-BY-SA is acceptable. Originally it should be CC-BY-4.0 by the winner license rules:</p>\n<blockquote>\n  <blockquote>\n    <ol>\n    <li>WINNER LICENSE.<br>\n    Under Section 11 (Winners Obligations) of the General Rules below, you hereby grant and will grant Competition Sponsor the following license(s) with respect to your Submission if you are a Competition winner:<br>\n    Open Source: You hereby license and will license your winning Submission and the source code used to generate the Submission under the Open Source Initiative-approved license CC BY 4.0 (see <a href=\"http://www.opensource.org\" target=\"_blank\">www.opensource.org</a>)  </li>\n    </ol>\n  </blockquote>\n</blockquote>\n<p>And copyleft is more limiting. However, the host would probably not care since he will not do anything commercial with it anyway. But I ask myself if this code would be useable in other Kaggle comps' since we usually need to use either \"generally commercially available software\" and/or open source code that we can deliver under CC BY 4.0 in order for our solutions not to limit any commercial application. Since copyleft is less permissible and has problems with commercial applications, it may raise problems with reusing it on Kaggle, which is sad IMO. </p>",
      "rawMarkdown": "TY. I'll try to learn that in depth.  \nI want to point out that I'm not sure CC-BY-SA is acceptable. Originally it should be CC-BY-4.0 by the winner license rules:\n\n>>1. WINNER LICENSE.\nUnder Section 11 (Winners Obligations) of the General Rules below, you hereby grant and will grant Competition Sponsor the following license(s) with respect to your Submission if you are a Competition winner:\nOpen Source: You hereby license and will license your winning Submission and the source code used to generate the Submission under the Open Source Initiative-approved license CC BY 4.0 (see www.opensource.org)  \n\nAnd copyleft is more limiting. However, the host would probably not care since he will not do anything commercial with it anyway. But I ask myself if this code would be useable in other Kaggle comps' since we usually need to use either \"generally commercially available software\" and/or open source code that we can deliver under CC BY 4.0 in order for our solutions not to limit any commercial application. Since copyleft is less permissible and has problems with commercial applications, it may raise problems with reusing it on Kaggle, which is sad IMO. ",
      "votes": 1,
      "replies": [
        {
          "id": 3035334,
          "postDate": "2024-11-03T09:41:46.413Z",
          "content": "<p>I'll see what the organizers requests. I picked CC BY-SA 4.0 to make it consistent with the dataset license (CC BY 4.0 is not an option there).</p>",
          "rawMarkdown": "I'll see what the organizers requests. I picked CC BY-SA 4.0 to make it consistent with the dataset license (CC BY 4.0 is not an option there).",
          "replies": [
            {
              "id": 3035336,
              "postDate": "2024-11-03T09:48:35.640Z",
              "content": "<p>Well, the dataset is CC-BY-NC.  <br>\nBut I won't want to use the dataset in future competitions, so I don't care.<br>\nYour code, on the other hand…who knows 🤣  <br>\nWell, as I said, the host would probably not care anyway. But it's still relevant to the Kaggle community.  </p>",
              "rawMarkdown": "Well, the dataset is CC-BY-NC.  \nBut I won't want to use the dataset in future competitions, so I don't care.\nYour code, on the other hand...who knows 🤣  \nWell, as I said, the host would probably not care anyway. But it's still relevant to the Kaggle community.  "
            },
            {
              "id": 3035347,
              "postDate": "2024-11-03T10:03:31.680Z",
              "content": "<p>Ah, I meant this dataset containing my code for the CC BY-SA 4.0 license: <a href=\"https://www.kaggle.com/datasets/jeroencottaar/my-ariel-library\" target=\"_blank\">https://www.kaggle.com/datasets/jeroencottaar/my-ariel-library</a></p>\n<p>I can't select CC BY 4.0 there.</p>",
              "rawMarkdown": "Ah, I meant this dataset containing my code for the CC BY-SA 4.0 license: https://www.kaggle.com/datasets/jeroencottaar/my-ariel-library\n\nI can't select CC BY 4.0 there."
            },
            {
              "id": 3035349,
              "postDate": "2024-11-03T10:10:17.743Z",
              "content": "<p>Ah, I can just select 'other' as license. All code is now CC BY 4.0.</p>",
              "rawMarkdown": "Ah, I can just select 'other' as license. All code is now CC BY 4.0.",
              "votes": 1
            },
            {
              "id": 3035368,
              "postDate": "2024-11-03T10:33:25.917Z",
              "content": "<p>Thank you. Do you mean that CC-BY-4.0 does not appear or that you can't select it? In any case, it's strange. It's the fifth option in the dropdown list.   <br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6832115%2F90ab2a60504a08b8a96bc05e046c814f%2FScreenshot%202024-11-03%20123236.png?generation=1730629980905747&amp;alt=media\" alt=\"\"></p>",
              "rawMarkdown": "Thank you. Do you mean that CC-BY-4.0 does not appear or that you can't select it? In any case, it's strange. It's the fifth option in the dropdown list.   \n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6832115%2F90ab2a60504a08b8a96bc05e046c814f%2FScreenshot%202024-11-03%20123236.png?generation=1730629980905747&alt=media)"
            },
            {
              "id": 3035384,
              "postDate": "2024-11-03T11:12:39.553Z",
              "content": "<p>Whoops, was thrown off by the different formatting…</p>",
              "rawMarkdown": "Whoops, was thrown off by the different formatting..."
            },
            {
              "id": 3035394,
              "postDate": "2024-11-03T11:48:56.117Z",
              "content": "<p>I'll admit, I got confused by the same thing the first time I tried to find CC BY 4.0 haha</p>",
              "rawMarkdown": "I'll admit, I got confused by the same thing the first time I tried to find CC BY 4.0 haha"
            }
          ]
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 3035332,
      "author_name": "greySnow",
      "author_url": "",
      "post_date": "2024-11-03T09:35:23.470000",
      "content": "<p>TY. I'll try to learn that in depth.  <br>\nI want to point out that I'm not sure CC-BY-SA is acceptable. Originally it should be CC-BY-4.0 by the winner license rules:</p>\n<blockquote>\n  <blockquote>\n    <ol>\n    <li>WINNER LICENSE.<br>\n    Under Section 11 (Winners Obligations) of the General Rules below, you hereby grant and will grant Competition Sponsor the following license(s) with respect to your Submission if you are a Competition winner:<br>\n    Open Source: You hereby license and will license your winning Submission and the source code used to generate the Submission under the Open Source Initiative-approved license CC BY 4.0 (see <a href=\"http://www.opensource.org\" target=\"_blank\">www.opensource.org</a>)  </li>\n    </ol>\n  </blockquote>\n</blockquote>\n<p>And copyleft is more limiting. However, the host would probably not care since he will not do anything commercial with it anyway. But I ask myself if this code would be useable in other Kaggle comps' since we usually need to use either \"generally commercially available software\" and/or open source code that we can deliver under CC BY 4.0 in order for our solutions not to limit any commercial application. Since copyleft is less permissible and has problems with commercial applications, it may raise problems with reusing it on Kaggle, which is sad IMO. </p>",
      "votes": 1,
      "replies": [
        {
          "id": 3035334,
          "author_name": "Jeroen Cottaar",
          "author_url": "",
          "post_date": "2024-11-03T09:41:46.413000",
          "content": "<p>I'll see what the organizers requests. I picked CC BY-SA 4.0 to make it consistent with the dataset license (CC BY 4.0 is not an option there).</p>",
          "votes": 0,
          "replies": [
            {
              "id": 3035336,
              "author_name": "greySnow",
              "author_url": "",
              "post_date": "2024-11-03T09:48:35.640000",
              "content": "<p>Well, the dataset is CC-BY-NC.  <br>\nBut I won't want to use the dataset in future competitions, so I don't care.<br>\nYour code, on the other hand…who knows 🤣  <br>\nWell, as I said, the host would probably not care anyway. But it's still relevant to the Kaggle community.  </p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3035347,
              "author_name": "Jeroen Cottaar",
              "author_url": "",
              "post_date": "2024-11-03T10:03:31.680000",
              "content": "<p>Ah, I meant this dataset containing my code for the CC BY-SA 4.0 license: <a href=\"https://www.kaggle.com/datasets/jeroencottaar/my-ariel-library\" target=\"_blank\">https://www.kaggle.com/datasets/jeroencottaar/my-ariel-library</a></p>\n<p>I can't select CC BY 4.0 there.</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3035349,
              "author_name": "Jeroen Cottaar",
              "author_url": "",
              "post_date": "2024-11-03T10:10:17.743000",
              "content": "<p>Ah, I can just select 'other' as license. All code is now CC BY 4.0.</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 3035368,
              "author_name": "greySnow",
              "author_url": "",
              "post_date": "2024-11-03T10:33:25.917000",
              "content": "<p>Thank you. Do you mean that CC-BY-4.0 does not appear or that you can't select it? In any case, it's strange. It's the fifth option in the dropdown list.   <br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6832115%2F90ab2a60504a08b8a96bc05e046c814f%2FScreenshot%202024-11-03%20123236.png?generation=1730629980905747&amp;alt=media\" alt=\"\"></p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3035384,
              "author_name": "Jeroen Cottaar",
              "author_url": "",
              "post_date": "2024-11-03T11:12:39.553000",
              "content": "<p>Whoops, was thrown off by the different formatting…</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3035394,
              "author_name": "greySnow",
              "author_url": "",
              "post_date": "2024-11-03T11:48:56.117000",
              "content": "<p>I'll admit, I got confused by the same thing the first time I tried to find CC BY 4.0 haha</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3035224": "I've now made public two notebooks and the underlying library for my 2nd place result:\n- If you want to reproduce my submissions (either the original 2nd place or with later improvements based on suggestions from @cnumber), or make your own: https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-submission-notebook\n- If you want to visualize the model (similar to the plots in my solution thread): https://www.kaggle.com/code/jeroencottaar/ariel-2nd-place-visualization-notebook\n\nPlease leave questions about my code here, rather than in the original solution thread (https://www.kaggle.com/competitions/ariel-data-challenge-2024/discussion/543853), which is quite busy already.\n\nI've done my best to structure and comment the code, but it will be quite challenging if you want to study it in detail. I recommend starting with ariel_gp.py->define_prior(), which implements the Bayesian prior as I described in my solution thread. It'll take some time to grasp, but you will see how we can really translate our description of the physics directly into code.\n",
    "3035332": "TY. I'll try to learn that in depth.  \nI want to point out that I'm not sure CC-BY-SA is acceptable. Originally it should be CC-BY-4.0 by the winner license rules:\n\n>>1. WINNER LICENSE.\nUnder Section 11 (Winners Obligations) of the General Rules below, you hereby grant and will grant Competition Sponsor the following license(s) with respect to your Submission if you are a Competition winner:\nOpen Source: You hereby license and will license your winning Submission and the source code used to generate the Submission under the Open Source Initiative-approved license CC BY 4.0 (see www.opensource.org)  \n\nAnd copyleft is more limiting. However, the host would probably not care since he will not do anything commercial with it anyway. But I ask myself if this code would be useable in other Kaggle comps' since we usually need to use either \"generally commercially available software\" and/or open source code that we can deliver under CC BY 4.0 in order for our solutions not to limit any commercial application. Since copyleft is less permissible and has problems with commercial applications, it may raise problems with reusing it on Kaggle, which is sad IMO. "
  }
}