{
  "id": 209298,
  "title": "Different annotations for same bboxes by the same Radiologist",
  "url": "/competitions/vinbigdata-chest-xray-abnormalities-detection/discussion/209298",
  "author_name": "Amir Sher",
  "post_date": "2021-01-07T00:33:23.423000",
  "votes": 7,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Hi,<br>\nI encountered at least one occasion of a Radiologist annotating the exact same bounding box with two different classes (abnormalities).<br>\nI don't have medical background so I don't know if it's medically possible (different abnormalities in the same lung area).</p>\n<p>How do we handle this? <br>\nCan the detection model learn different classes from the same bboxes?</p>\n<p>Look at image_id: b065d3b4da92b8015b47224341661fd8<br>\nRadiologist R8 marked box (1687.0, 367.0, 2398.0, 1779.0) with both 'Infiltration' and 'ILD'<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6203332%2F71db88c052e346039ac9c95194616a5e%2FScreen%20Shot%202021-01-07%20at%201.57.37.png?generation=1609979179861245&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": 1141975,
      "postDate": "2021-01-07T03:37:51.880Z",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/amirsher\" target=\"_blank\">@amirsher</a><br>\nSome dense lesion area contains many labels, our radiologists created a box then assign many labels to that box.</p>",
      "rawMarkdown": "Hi @amirsher\nSome dense lesion area contains many labels, our radiologists created a box then assign many labels to that box.",
      "votes": 7
    },
    {
      "id": 1141863,
      "postDate": "2021-01-07T00:33:23.423Z",
      "content": "<p>Hi,<br>\nI encountered at least one occasion of a Radiologist annotating the exact same bounding box with two different classes (abnormalities).<br>\nI don't have medical background so I don't know if it's medically possible (different abnormalities in the same lung area).</p>\n<p>How do we handle this? <br>\nCan the detection model learn different classes from the same bboxes?</p>\n<p>Look at image_id: b065d3b4da92b8015b47224341661fd8<br>\nRadiologist R8 marked box (1687.0, 367.0, 2398.0, 1779.0) with both 'Infiltration' and 'ILD'<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6203332%2F71db88c052e346039ac9c95194616a5e%2FScreen%20Shot%202021-01-07%20at%201.57.37.png?generation=1609979179861245&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Hi,\nI encountered at least one occasion of a Radiologist annotating the exact same bounding box with two different classes (abnormalities).\nI don't have medical background so I don't know if it's medically possible (different abnormalities in the same lung area).\n\nHow do we handle this? \nCan the detection model learn different classes from the same bboxes?\n\nLook at image_id: b065d3b4da92b8015b47224341661fd8\nRadiologist R8 marked box (1687.0, 367.0, 2398.0, 1779.0) with both 'Infiltration' and 'ILD'\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6203332%2F71db88c052e346039ac9c95194616a5e%2FScreen%20Shot%202021-01-07%20at%201.57.37.png?generation=1609979179861245&alt=media)",
      "votes": 7
    },
    {
      "id": 1148678,
      "postDate": "2021-01-11T09:47:03.967Z",
      "content": "<p>Ideally if you consider a multi-label classification task togheter with localization of bboxes you could overcome this problem. Anyway in my experiments I'm not having very good results..</p>",
      "rawMarkdown": "Ideally if you consider a multi-label classification task togheter with localization of bboxes you could overcome this problem. Anyway in my experiments I'm not having very good results.."
    },
    {
      "id": 1146291,
      "postDate": "2021-01-09T16:53:41.440Z",
      "content": "<p><a href=\"url\" target=\"_blank\">https://www.mayoclinic.org/diseases-conditions/interstitial-lung-disease/symptoms-causes/syc-20353108</a><br>\nILD -&gt; Interstitial (in-tur-STISH-ul) lung disease describes <strong>a large group of disorders</strong>, most of which cause progressive scarring of lung tissue. The scarring associated with interstitial lung disease eventually affects your ability to breathe and get enough oxygen into your bloodstream.</p>\n<p>Seems like ILD is a blanket term for a group of disorders. Maybe the radiologist classified it as ILD and later realised that \"Infiltration\" better describes the finding. This is just my guess.</p>",
      "rawMarkdown": "[https://www.mayoclinic.org/diseases-conditions/interstitial-lung-disease/symptoms-causes/syc-20353108](url)\nILD -> Interstitial (in-tur-STISH-ul) lung disease describes **a large group of disorders**, most of which cause progressive scarring of lung tissue. The scarring associated with interstitial lung disease eventually affects your ability to breathe and get enough oxygen into your bloodstream.\n\nSeems like ILD is a blanket term for a group of disorders. Maybe the radiologist classified it as ILD and later realised that \"Infiltration\" better describes the finding. This is just my guess.",
      "replies": [
        {
          "id": 1146461,
          "postDate": "2021-01-09T19:38:07.097Z",
          "content": "<p>So, is it a good practice for such cases of duplicate labels, to remove the ILD label from the training?</p>",
          "rawMarkdown": "So, is it a good practice for such cases of duplicate labels, to remove the ILD label from the training?"
        },
        {
          "id": 1150201,
          "postDate": "2021-01-12T13:01:07.300Z",
          "content": "<p>Might be a good idea since ILD is a more generic classification.</p>",
          "rawMarkdown": "Might be a good idea since ILD is a more generic classification."
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 1141975,
      "author_name": "DungNB",
      "author_url": "",
      "post_date": "2021-01-07T03:37:51.880000",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/amirsher\" target=\"_blank\">@amirsher</a><br>\nSome dense lesion area contains many labels, our radiologists created a box then assign many labels to that box.</p>",
      "votes": 7,
      "replies": []
    },
    {
      "id": 1148678,
      "author_name": "LAZCoder",
      "author_url": "",
      "post_date": "2021-01-11T09:47:03.967000",
      "content": "<p>Ideally if you consider a multi-label classification task togheter with localization of bboxes you could overcome this problem. Anyway in my experiments I'm not having very good results..</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1146291,
      "author_name": "Abhimanyu Dikshit",
      "author_url": "",
      "post_date": "2021-01-09T16:53:41.440000",
      "content": "<p><a href=\"url\" target=\"_blank\">https://www.mayoclinic.org/diseases-conditions/interstitial-lung-disease/symptoms-causes/syc-20353108</a><br>\nILD -&gt; Interstitial (in-tur-STISH-ul) lung disease describes <strong>a large group of disorders</strong>, most of which cause progressive scarring of lung tissue. The scarring associated with interstitial lung disease eventually affects your ability to breathe and get enough oxygen into your bloodstream.</p>\n<p>Seems like ILD is a blanket term for a group of disorders. Maybe the radiologist classified it as ILD and later realised that \"Infiltration\" better describes the finding. This is just my guess.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1146461,
          "author_name": "Amir Sher",
          "author_url": "",
          "post_date": "2021-01-09T19:38:07.097000",
          "content": "<p>So, is it a good practice for such cases of duplicate labels, to remove the ILD label from the training?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1150201,
          "author_name": "Abhimanyu Dikshit",
          "author_url": "",
          "post_date": "2021-01-12T13:01:07.300000",
          "content": "<p>Might be a good idea since ILD is a more generic classification.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1141975": "Hi @amirsher\nSome dense lesion area contains many labels, our radiologists created a box then assign many labels to that box.",
    "1141863": "Hi,\nI encountered at least one occasion of a Radiologist annotating the exact same bounding box with two different classes (abnormalities).\nI don't have medical background so I don't know if it's medically possible (different abnormalities in the same lung area).\n\nHow do we handle this? \nCan the detection model learn different classes from the same bboxes?\n\nLook at image_id: b065d3b4da92b8015b47224341661fd8\nRadiologist R8 marked box (1687.0, 367.0, 2398.0, 1779.0) with both 'Infiltration' and 'ILD'\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6203332%2F71db88c052e346039ac9c95194616a5e%2FScreen%20Shot%202021-01-07%20at%201.57.37.png?generation=1609979179861245&alt=media)",
    "1148678": "Ideally if you consider a multi-label classification task togheter with localization of bboxes you could overcome this problem. Anyway in my experiments I'm not having very good results..",
    "1146291": "[https://www.mayoclinic.org/diseases-conditions/interstitial-lung-disease/symptoms-causes/syc-20353108](url)\nILD -> Interstitial (in-tur-STISH-ul) lung disease describes **a large group of disorders**, most of which cause progressive scarring of lung tissue. The scarring associated with interstitial lung disease eventually affects your ability to breathe and get enough oxygen into your bloodstream.\n\nSeems like ILD is a blanket term for a group of disorders. Maybe the radiologist classified it as ILD and later realised that \"Infiltration\" better describes the finding. This is just my guess."
  }
}