{
  "id": 438508,
  "title": "Handling the data",
  "url": "/competitions/rsna-2023-abdominal-trauma-detection/discussion/438508",
  "author_name": "sagi or",
  "post_date": "2023-09-11T14:16:41.290000",
  "votes": 2,
  "comment_count": 1,
  "views": 0,
  "content": "<p>How do you guys handle this large amount of data?<br>\nDid you download it and compprest into binary? <br>\nOr are you just using part if the data<br>\nAlso, the time of loading the data is included in the 9 hours limit?<br>\nThanks for helping!</p>",
  "messages": [
    {
      "id": 2435531,
      "postDate": "2023-09-13T03:55:41.720Z",
      "content": "<p>So, I personally am currently testing using just a small part of the data, with only a few slices of roughly 200 patients. There are several datasets already created that compressed / processed the data into smaller chunks for loading into models (if you choose to go this path), you can find those under the discussions tab of this competition. Using all of the patients requires clever coding, I think there's a few examples / methods that people have shared under discussions as well. And yes, the notebook starts keeping time when you run the first cell, so if you are loading lots of data in your notebook, it will keep the timer going. Best of luck!</p>",
      "rawMarkdown": "So, I personally am currently testing using just a small part of the data, with only a few slices of roughly 200 patients. There are several datasets already created that compressed / processed the data into smaller chunks for loading into models (if you choose to go this path), you can find those under the discussions tab of this competition. Using all of the patients requires clever coding, I think there's a few examples / methods that people have shared under discussions as well. And yes, the notebook starts keeping time when you run the first cell, so if you are loading lots of data in your notebook, it will keep the timer going. Best of luck!",
      "votes": 1
    },
    {
      "id": 2433358,
      "postDate": "2023-09-11T14:16:41.290Z",
      "content": "<p>How do you guys handle this large amount of data?<br>\nDid you download it and compprest into binary? <br>\nOr are you just using part if the data<br>\nAlso, the time of loading the data is included in the 9 hours limit?<br>\nThanks for helping!</p>",
      "rawMarkdown": "How do you guys handle this large amount of data?\nDid you download it and compprest into binary? \nOr are you just using part if the data\nAlso, the time of loading the data is included in the 9 hours limit?\nThanks for helping!\n",
      "votes": 2
    }
  ],
  "comments": [
    {
      "id": 2435531,
      "author_name": "Art. Berz.",
      "author_url": "",
      "post_date": "2023-09-13T03:55:41.720000",
      "content": "<p>So, I personally am currently testing using just a small part of the data, with only a few slices of roughly 200 patients. There are several datasets already created that compressed / processed the data into smaller chunks for loading into models (if you choose to go this path), you can find those under the discussions tab of this competition. Using all of the patients requires clever coding, I think there's a few examples / methods that people have shared under discussions as well. And yes, the notebook starts keeping time when you run the first cell, so if you are loading lots of data in your notebook, it will keep the timer going. Best of luck!</p>",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2435531": "So, I personally am currently testing using just a small part of the data, with only a few slices of roughly 200 patients. There are several datasets already created that compressed / processed the data into smaller chunks for loading into models (if you choose to go this path), you can find those under the discussions tab of this competition. Using all of the patients requires clever coding, I think there's a few examples / methods that people have shared under discussions as well. And yes, the notebook starts keeping time when you run the first cell, so if you are loading lots of data in your notebook, it will keep the timer going. Best of luck!",
    "2433358": "How do you guys handle this large amount of data?\nDid you download it and compprest into binary? \nOr are you just using part if the data\nAlso, the time of loading the data is included in the 9 hours limit?\nThanks for helping!\n"
  }
}