{
  "id": 438020,
  "title": "RSNA Trauma Metric - is overall any_injury best",
  "url": "/competitions/rsna-2023-abdominal-trauma-detection/discussion/438020",
  "author_name": "something4kag",
  "post_date": "2023-09-09T06:23:32.459000",
  "votes": 2,
  "comment_count": 3,
  "views": 0,
  "content": "<p>There have been a few recent posts on extravasation_injury and weighting - </p>\n<p><a href=\"https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/436501#2428891\" target=\"_blank\">if extravasation_injury is scaled up, then this will help contribute to the any_injury predictions</a></p>\n<p><a href=\"https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/437510\" target=\"_blank\">setting the prediction value for a specific label 'extravasation_injury' to a constant 0.99 yielded outstanding results </a></p>\n<p><a href=\"https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/437303\" target=\"_blank\">overfitting,suspect that the test concentration in lb contains more of the extravasation_injury' class,</a></p>\n<p>Just wondered if the metric using an overall any_injury is best or should there be any_injury per label group? or should any_injury be predicted and included in the submissions?  </p>\n<p>Perhaps the effect of extravasation_injury in predictions is just an artifact of the public test set and LB.  But if there is some bias/issue in any_injury might be good to know sooner rather than later.  </p>",
  "messages": [
    {
      "id": 2430203,
      "postDate": "2023-09-09T06:23:32.460Z",
      "content": "<p>There have been a few recent posts on extravasation_injury and weighting - </p>\n<p><a href=\"https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/436501#2428891\" target=\"_blank\">if extravasation_injury is scaled up, then this will help contribute to the any_injury predictions</a></p>\n<p><a href=\"https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/437510\" target=\"_blank\">setting the prediction value for a specific label 'extravasation_injury' to a constant 0.99 yielded outstanding results </a></p>\n<p><a href=\"https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/437303\" target=\"_blank\">overfitting,suspect that the test concentration in lb contains more of the extravasation_injury' class,</a></p>\n<p>Just wondered if the metric using an overall any_injury is best or should there be any_injury per label group? or should any_injury be predicted and included in the submissions?  </p>\n<p>Perhaps the effect of extravasation_injury in predictions is just an artifact of the public test set and LB.  But if there is some bias/issue in any_injury might be good to know sooner rather than later.  </p>",
      "rawMarkdown": "There have been a few recent posts on extravasation_injury and weighting - \n\n[if extravasation_injury is scaled up, then this will help contribute to the any_injury predictions](https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/436501#2428891)\n\n[setting the prediction value for a specific label 'extravasation_injury' to a constant 0.99 yielded outstanding results ](https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/437510)\n\n[overfitting,suspect that the test concentration in lb contains more of the extravasation_injury' class,](https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/437303)\n\nJust wondered if the metric using an overall any_injury is best or should there be any_injury per label group? or should any_injury be predicted and included in the submissions?  \n\nPerhaps the effect of extravasation_injury in predictions is just an artifact of the public test set and LB.  But if there is some bias/issue in any_injury might be good to know sooner rather than later.  ",
      "votes": 2
    },
    {
      "id": 2430266,
      "postDate": "2023-09-09T07:15:50.817Z",
      "content": "<p>any_injury may not be included into predictions. It's calculated automatically<code>max(1 - p(healthy|organ))</code></p>",
      "rawMarkdown": "any_injury may not be included into predictions. It's calculated automatically` max(1 - p(healthy|organ)) `",
      "replies": [
        {
          "id": 2430289,
          "postDate": "2023-09-09T07:25:03.200Z",
          "content": "<p>but the loss function should include this</p>",
          "rawMarkdown": "but the loss function should include this"
        },
        {
          "id": 2430310,
          "postDate": "2023-09-09T07:40:53.380Z",
          "content": "<p>This post is not about including it in predictions/submissions.  It is about whether deriving it overall is best for how the metric calculates considering posts about how to get better scores by increasing the extravasation_injury predictions. </p>",
          "rawMarkdown": "This post is not about including it in predictions/submissions.  It is about whether deriving it overall is best for how the metric calculates considering posts about how to get better scores by increasing the extravasation_injury predictions. "
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 2430266,
      "author_name": "JanGlinko2",
      "author_url": "",
      "post_date": "2023-09-09T07:15:50.817000",
      "content": "<p>any_injury may not be included into predictions. It's calculated automatically<code>max(1 - p(healthy|organ))</code></p>",
      "votes": 0,
      "replies": [
        {
          "id": 2430289,
          "author_name": "hengck23",
          "author_url": "",
          "post_date": "2023-09-09T07:25:03.200000",
          "content": "<p>but the loss function should include this</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 2430310,
          "author_name": "something4kag",
          "author_url": "",
          "post_date": "2023-09-09T07:40:53.380000",
          "content": "<p>This post is not about including it in predictions/submissions.  It is about whether deriving it overall is best for how the metric calculates considering posts about how to get better scores by increasing the extravasation_injury predictions. </p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2430203": "There have been a few recent posts on extravasation_injury and weighting - \n\n[if extravasation_injury is scaled up, then this will help contribute to the any_injury predictions](https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/436501#2428891)\n\n[setting the prediction value for a specific label 'extravasation_injury' to a constant 0.99 yielded outstanding results ](https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/437510)\n\n[overfitting,suspect that the test concentration in lb contains more of the extravasation_injury' class,](https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/437303)\n\nJust wondered if the metric using an overall any_injury is best or should there be any_injury per label group? or should any_injury be predicted and included in the submissions?  \n\nPerhaps the effect of extravasation_injury in predictions is just an artifact of the public test set and LB.  But if there is some bias/issue in any_injury might be good to know sooner rather than later.  ",
    "2430266": "any_injury may not be included into predictions. It's calculated automatically` max(1 - p(healthy|organ)) `"
  }
}