{
  "id": 373961,
  "title": "Three extra public datasets you might find useful",
  "url": "/competitions/rsna-breast-cancer-detection/discussion/373961",
  "author_name": "Chenjie",
  "post_date": "2022-12-24T12:36:19.881000",
  "votes": 13,
  "comment_count": 5,
  "views": 0,
  "content": "<ol>\n<li><p>The Digital Database for Screening Mammography（DDSM）<br>\nHeath M, Bowyer K, Kopans D, et al. The Digital Database for Screening Mammography[C]// Proceedings of the Fifth International Workshop on Digital Mammography.Medical Physics Publishing. 2001: 212–218.<br>\n<a href=\"http://www.eng.usf.edu/cvprg/Mammography/Database.html\" target=\"_blank\">http://www.eng.usf.edu/cvprg/Mammography/Database.html</a><br>\n<a href=\"https://www.kaggle.com/datasets/cheddad/miniddsm2\" target=\"_blank\">https://www.kaggle.com/datasets/cheddad/miniddsm2</a></p></li>\n<li><p>The mammographic image analysis society digital mammogram database（MIAS）<br>\nSUCKLING J P. The  mammographic image analysis society digital mammogram database[J]. Digital Mammo, 1994: 375–386.<br>\n<a href=\"https://www.repository.cam.ac.uk/handle/1810/250394\" target=\"_blank\">https://www.repository.cam.ac.uk/handle/1810/250394</a><br>\n<a href=\"http://peipa.essex.ac.uk/info/mias.html\" target=\"_blank\">http://peipa.essex.ac.uk/info/mias.html</a><br>\n<a href=\"https://www.kaggle.com/datasets/kmader/mias-mammography\" target=\"_blank\">https://www.kaggle.com/datasets/kmader/mias-mammography</a></p></li>\n<li><p>INbreast<br>\nMoreira I C, Amaral I, Domingues I, et al. Inbreast: toward a full­field digital mammographic database[J]. Academic radiology, 2012, 19(2): 236–248.<br>\n<a href=\"https://pubmed.ncbi.nlm.nih.gov/22078258/\" target=\"_blank\">https://pubmed.ncbi.nlm.nih.gov/22078258/</a><br>\n<a href=\"https://www.kaggle.com/datasets/martholi/inbreast\" target=\"_blank\">https://www.kaggle.com/datasets/martholi/inbreast</a></p></li>\n</ol>\n<p>————————2023-1-2<br>\n<a href=\"https://www.kaggle.com/datasets/tommyngx/cmmd2022\" target=\"_blank\">https://www.kaggle.com/datasets/tommyngx/cmmd2022</a></p>",
  "messages": [
    {
      "id": 2074638,
      "postDate": "2022-12-24T12:36:19.880Z",
      "content": "<ol>\n<li><p>The Digital Database for Screening Mammography（DDSM）<br>\nHeath M, Bowyer K, Kopans D, et al. The Digital Database for Screening Mammography[C]// Proceedings of the Fifth International Workshop on Digital Mammography.Medical Physics Publishing. 2001: 212–218.<br>\n<a href=\"http://www.eng.usf.edu/cvprg/Mammography/Database.html\" target=\"_blank\">http://www.eng.usf.edu/cvprg/Mammography/Database.html</a><br>\n<a href=\"https://www.kaggle.com/datasets/cheddad/miniddsm2\" target=\"_blank\">https://www.kaggle.com/datasets/cheddad/miniddsm2</a></p></li>\n<li><p>The mammographic image analysis society digital mammogram database（MIAS）<br>\nSUCKLING J P. The  mammographic image analysis society digital mammogram database[J]. Digital Mammo, 1994: 375–386.<br>\n<a href=\"https://www.repository.cam.ac.uk/handle/1810/250394\" target=\"_blank\">https://www.repository.cam.ac.uk/handle/1810/250394</a><br>\n<a href=\"http://peipa.essex.ac.uk/info/mias.html\" target=\"_blank\">http://peipa.essex.ac.uk/info/mias.html</a><br>\n<a href=\"https://www.kaggle.com/datasets/kmader/mias-mammography\" target=\"_blank\">https://www.kaggle.com/datasets/kmader/mias-mammography</a></p></li>\n<li><p>INbreast<br>\nMoreira I C, Amaral I, Domingues I, et al. Inbreast: toward a full­field digital mammographic database[J]. Academic radiology, 2012, 19(2): 236–248.<br>\n<a href=\"https://pubmed.ncbi.nlm.nih.gov/22078258/\" target=\"_blank\">https://pubmed.ncbi.nlm.nih.gov/22078258/</a><br>\n<a href=\"https://www.kaggle.com/datasets/martholi/inbreast\" target=\"_blank\">https://www.kaggle.com/datasets/martholi/inbreast</a></p></li>\n</ol>\n<p>————————2023-1-2<br>\n<a href=\"https://www.kaggle.com/datasets/tommyngx/cmmd2022\" target=\"_blank\">https://www.kaggle.com/datasets/tommyngx/cmmd2022</a></p>",
      "rawMarkdown": "1. The Digital Database for Screening Mammography（DDSM）\nHeath M, Bowyer K, Kopans D, et al. The Digital Database for Screening Mammography[C]// Proceedings of the Fifth International Workshop on Digital Mammography.Medical Physics Publishing. 2001: 212–218.\nhttp://www.eng.usf.edu/cvprg/Mammography/Database.html\nhttps://www.kaggle.com/datasets/cheddad/miniddsm2\n\n2. The mammographic image analysis society digital mammogram database（MIAS）\nSUCKLING J P. The  mammographic image analysis society digital mammogram database[J]. Digital Mammo, 1994: 375–386.\nhttps://www.repository.cam.ac.uk/handle/1810/250394\nhttp://peipa.essex.ac.uk/info/mias.html\nhttps://www.kaggle.com/datasets/kmader/mias-mammography\n\n3. INbreast\nMoreira I C, Amaral I, Domingues I, et al. Inbreast: toward a full­field digital mammographic database[J]. Academic radiology, 2012, 19(2): 236–248.\nhttps://pubmed.ncbi.nlm.nih.gov/22078258/\nhttps://www.kaggle.com/datasets/martholi/inbreast\n\n————————2023-1-2\nhttps://www.kaggle.com/datasets/tommyngx/cmmd2022",
      "votes": 13
    },
    {
      "id": 2076862,
      "postDate": "2022-12-27T00:05:56.460Z",
      "content": "<p>Great info! 🙂 As we are using models trained on Imagenet which contains images vastly different from the medical images in this competition, doing pretraining on other datasets (particularly ones that have rich labels) can go a long way! Thx for sharing!</p>",
      "rawMarkdown": "Great info! 🙂 As we are using models trained on Imagenet which contains images vastly different from the medical images in this competition, doing pretraining on other datasets (particularly ones that have rich labels) can go a long way! Thx for sharing!",
      "votes": 3,
      "replies": [
        {
          "id": 2076905,
          "postDate": "2022-12-27T01:40:50.947Z",
          "content": "<p>\"doing pretraining on other datasets (particularly ones that have rich labels) can go a long way!\"</p>\n<p><img src=\"https://i.ibb.co/K5XY3gK/Selection-311.png\" alt=\"https://i.ibb.co/K5XY3gK/Selection-311.png\"></p>\n<p>some dataset does closely resemble that of kaggle. in fact i suspect part of kaggle datset is part of NYU set or using the same scanner machine. check the paper details (e.g. biopsy label, BiRADS for 1,2,3 only) too!</p>\n<p>while NYU set is not public, their pretrain models (several of them) are.<br>\nyou can use them</p>\n<p>here is a paper that compares results with and without NYU pretrain model:</p>\n<p>[1] Evaluation of deep learning-based artificial intelligence techniques for breast cancer detection on mammograms: Results from a retrospective study using a BreastScreen Victoria dataset </p>",
          "rawMarkdown": "\"doing pretraining on other datasets (particularly ones that have rich labels) can go a long way!\"\n\n![https://i.ibb.co/K5XY3gK/Selection-311.png](https://i.ibb.co/K5XY3gK/Selection-311.png)\n\nsome dataset does closely resemble that of kaggle. in fact i suspect part of kaggle datset is part of NYU set or using the same scanner machine. check the paper details (e.g. biopsy label, BiRADS for 1,2,3 only) too!\n\nwhile NYU set is not public, their pretrain models (several of them) are.\nyou can use them\n\nhere is a paper that compares results with and without NYU pretrain model:\n\n[1] Evaluation of deep learning-based artificial intelligence techniques for breast cancer detection on mammograms: Results from a retrospective study using a BreastScreen Victoria dataset ",
          "votes": 7,
          "replies": [
            {
              "id": 2077901,
              "postDate": "2022-12-28T00:04:23.647Z",
              "content": "<p>very useful info <a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a>, thanks ofr sharing! 🙂 </p>\n<p>The only problem here is that if we would use models that were pretrained on parts of this dataset, we might not be able to fully trust our validation results (as the model might have seen the image we have in our validation set already in train)</p>\n<p>Still, that is a very useful piece of info! Thank you!</p>",
              "rawMarkdown": "very useful info @hengck23, thanks ofr sharing! 🙂 \n\nThe only problem here is that if we would use models that were pretrained on parts of this dataset, we might not be able to fully trust our validation results (as the model might have seen the image we have in our validation set already in train)\n\nStill, that is a very useful piece of info! Thank you!"
            },
            {
              "id": 2077922,
              "postDate": "2022-12-28T00:24:51.650Z",
              "content": "<p><a href=\"https://www.kaggle.com/maggiemd\" target=\"_blank\">@maggiemd</a> <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a><br>\nIs it true that NYU dataset is a part of the competition dataset (especially test dataset)?<br>\nIf so, using NYU pretrained model could cause a serious leakage, which is similar to the situation of <a href=\"https://www.kaggle.com/competitions/cassava-leaf-disease-classification/discussion/222035\" target=\"_blank\">cassava competition</a></p>",
              "rawMarkdown": "@maggiemd @sohier\nIs it true that NYU dataset is a part of the competition dataset (especially test dataset)?\nIf so, using NYU pretrained model could cause a serious leakage, which is similar to the situation of [cassava competition](https://www.kaggle.com/competitions/cassava-leaf-disease-classification/discussion/222035)",
              "votes": 2
            }
          ]
        }
      ]
    },
    {
      "id": 2101926,
      "postDate": "2023-01-16T09:56:05.220Z",
      "content": "<p>Hello CHENJIE,<br>\nDo you know it this datatsets have any licence issues related to their use? by that I mean, could we infringe the database copyright if we win the competition and collect the reward by training our model with this datatset? or are they open for any kind of use?</p>",
      "rawMarkdown": "Hello CHENJIE,\nDo you know it this datatsets have any licence issues related to their use? by that I mean, could we infringe the database copyright if we win the competition and collect the reward by training our model with this datatset? or are they open for any kind of use?"
    }
  ],
  "comments": [
    {
      "id": 2076862,
      "author_name": "Radek Osmulski",
      "author_url": "",
      "post_date": "2022-12-27T00:05:56.460000",
      "content": "<p>Great info! 🙂 As we are using models trained on Imagenet which contains images vastly different from the medical images in this competition, doing pretraining on other datasets (particularly ones that have rich labels) can go a long way! Thx for sharing!</p>",
      "votes": 3,
      "replies": [
        {
          "id": 2076905,
          "author_name": "hengck23",
          "author_url": "",
          "post_date": "2022-12-27T01:40:50.947000",
          "content": "<p>\"doing pretraining on other datasets (particularly ones that have rich labels) can go a long way!\"</p>\n<p><img src=\"https://i.ibb.co/K5XY3gK/Selection-311.png\" alt=\"https://i.ibb.co/K5XY3gK/Selection-311.png\"></p>\n<p>some dataset does closely resemble that of kaggle. in fact i suspect part of kaggle datset is part of NYU set or using the same scanner machine. check the paper details (e.g. biopsy label, BiRADS for 1,2,3 only) too!</p>\n<p>while NYU set is not public, their pretrain models (several of them) are.<br>\nyou can use them</p>\n<p>here is a paper that compares results with and without NYU pretrain model:</p>\n<p>[1] Evaluation of deep learning-based artificial intelligence techniques for breast cancer detection on mammograms: Results from a retrospective study using a BreastScreen Victoria dataset </p>",
          "votes": 7,
          "replies": [
            {
              "id": 2077901,
              "author_name": "Radek Osmulski",
              "author_url": "",
              "post_date": "2022-12-28T00:04:23.647000",
              "content": "<p>very useful info <a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a>, thanks ofr sharing! 🙂 </p>\n<p>The only problem here is that if we would use models that were pretrained on parts of this dataset, we might not be able to fully trust our validation results (as the model might have seen the image we have in our validation set already in train)</p>\n<p>Still, that is a very useful piece of info! Thank you!</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2077922,
              "author_name": "tomoo inubushi",
              "author_url": "",
              "post_date": "2022-12-28T00:24:51.650000",
              "content": "<p><a href=\"https://www.kaggle.com/maggiemd\" target=\"_blank\">@maggiemd</a> <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a><br>\nIs it true that NYU dataset is a part of the competition dataset (especially test dataset)?<br>\nIf so, using NYU pretrained model could cause a serious leakage, which is similar to the situation of <a href=\"https://www.kaggle.com/competitions/cassava-leaf-disease-classification/discussion/222035\" target=\"_blank\">cassava competition</a></p>",
              "votes": 2,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2101926,
      "author_name": "el científico",
      "author_url": "",
      "post_date": "2023-01-16T09:56:05.220000",
      "content": "<p>Hello CHENJIE,<br>\nDo you know it this datatsets have any licence issues related to their use? by that I mean, could we infringe the database copyright if we win the competition and collect the reward by training our model with this datatset? or are they open for any kind of use?</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2074638": "1. The Digital Database for Screening Mammography（DDSM）\nHeath M, Bowyer K, Kopans D, et al. The Digital Database for Screening Mammography[C]// Proceedings of the Fifth International Workshop on Digital Mammography.Medical Physics Publishing. 2001: 212–218.\nhttp://www.eng.usf.edu/cvprg/Mammography/Database.html\nhttps://www.kaggle.com/datasets/cheddad/miniddsm2\n\n2. The mammographic image analysis society digital mammogram database（MIAS）\nSUCKLING J P. The  mammographic image analysis society digital mammogram database[J]. Digital Mammo, 1994: 375–386.\nhttps://www.repository.cam.ac.uk/handle/1810/250394\nhttp://peipa.essex.ac.uk/info/mias.html\nhttps://www.kaggle.com/datasets/kmader/mias-mammography\n\n3. INbreast\nMoreira I C, Amaral I, Domingues I, et al. Inbreast: toward a full­field digital mammographic database[J]. Academic radiology, 2012, 19(2): 236–248.\nhttps://pubmed.ncbi.nlm.nih.gov/22078258/\nhttps://www.kaggle.com/datasets/martholi/inbreast\n\n————————2023-1-2\nhttps://www.kaggle.com/datasets/tommyngx/cmmd2022",
    "2076862": "Great info! 🙂 As we are using models trained on Imagenet which contains images vastly different from the medical images in this competition, doing pretraining on other datasets (particularly ones that have rich labels) can go a long way! Thx for sharing!",
    "2101926": "Hello CHENJIE,\nDo you know it this datatsets have any licence issues related to their use? by that I mean, could we infringe the database copyright if we win the competition and collect the reward by training our model with this datatset? or are they open for any kind of use?"
  }
}