{
  "id": 185125,
  "title": "HIgh RAM occupation",
  "url": "/competitions/rsna-str-pulmonary-embolism-detection/discussion/185125",
  "author_name": "qzw",
  "post_date": "2020-09-19T12:25:28.568000",
  "votes": 3,
  "comment_count": 4,
  "views": 0,
  "content": "<p>HI,</p>\n<p>My notebook has a high RAM occupation(12.9G/13G), which often results in error submission.</p>\n<p>Do you guys have some good ideas to avoid this problem?</p>",
  "messages": [
    {
      "id": 1018059,
      "postDate": "2020-09-19T12:25:28.567Z",
      "content": "<p>HI,</p>\n<p>My notebook has a high RAM occupation(12.9G/13G), which often results in error submission.</p>\n<p>Do you guys have some good ideas to avoid this problem?</p>",
      "rawMarkdown": "HI,\n\nMy notebook has a high RAM occupation(12.9G/13G), which often results in error submission.\n\nDo you guys have some good ideas to avoid this problem?\n\n",
      "votes": 3
    },
    {
      "id": 1018777,
      "postDate": "2020-09-20T01:00:45.227Z",
      "content": "<p>Try to do garbage collection. <code>import gc; gc.collect()</code> </p>\n<p>Also, remove dataframes or variables not being used. <code>del(var)</code></p>\n<p>You could also use a <a href=\"https://stackify.com/how-to-use-python-profilers-learn-the-basics/\" target=\"_blank\">memory profiler</a> - but this would be my last option.</p>",
      "rawMarkdown": "Try to do garbage collection. `import gc; gc.collect()` \n\nAlso, remove dataframes or variables not being used. `del(var)`\n\nYou could also use a [memory profiler](https://stackify.com/how-to-use-python-profilers-learn-the-basics/) - but this would be my last option.",
      "votes": 1
    },
    {
      "id": 1018327,
      "postDate": "2020-09-19T16:04:28.460Z",
      "content": "<p>Please try to visit a local dealer for professional assistance. Thank you.</p>",
      "rawMarkdown": "Please try to visit a local dealer for professional assistance. Thank you.",
      "votes": -6
    },
    {
      "id": 1027212,
      "postDate": "2020-09-25T23:47:53.950Z",
      "content": "<p><a href=\"https://www.kaggle.com/qiuzhongwei\" target=\"_blank\">@qiuzhongwei</a> did you get this issue resolve? My ram utilization keeps on increasing even without inferencing my model with every iteration of the test loader.</p>",
      "rawMarkdown": "@qiuzhongwei did you get this issue resolve? My ram utilization keeps on increasing even without inferencing my model with every iteration of the test loader."
    },
    {
      "id": 1018237,
      "postDate": "2020-09-19T14:47:06.593Z",
      "content": "<p>Often this is from appending dataframes that can use a lot of memory.</p>\n<p>Also, are you trying to cache a lot of images, which will quickly use up your memory.</p>",
      "rawMarkdown": "Often this is from appending dataframes that can use a lot of memory.\n\nAlso, are you trying to cache a lot of images, which will quickly use up your memory."
    }
  ],
  "comments": [
    {
      "id": 1018777,
      "author_name": "Aman Arora",
      "author_url": "",
      "post_date": "2020-09-20T01:00:45.227000",
      "content": "<p>Try to do garbage collection. <code>import gc; gc.collect()</code> </p>\n<p>Also, remove dataframes or variables not being used. <code>del(var)</code></p>\n<p>You could also use a <a href=\"https://stackify.com/how-to-use-python-profilers-learn-the-basics/\" target=\"_blank\">memory profiler</a> - but this would be my last option.</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1018327,
      "author_name": "makwan dusti",
      "author_url": "",
      "post_date": "2020-09-19T16:04:28.460000",
      "content": "<p>Please try to visit a local dealer for professional assistance. Thank you.</p>",
      "votes": -6,
      "replies": []
    },
    {
      "id": 1027212,
      "author_name": "SumanSudhir",
      "author_url": "",
      "post_date": "2020-09-25T23:47:53.950000",
      "content": "<p><a href=\"https://www.kaggle.com/qiuzhongwei\" target=\"_blank\">@qiuzhongwei</a> did you get this issue resolve? My ram utilization keeps on increasing even without inferencing my model with every iteration of the test loader.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1018237,
      "author_name": "quadcore/Richard Epstein",
      "author_url": "",
      "post_date": "2020-09-19T14:47:06.593000",
      "content": "<p>Often this is from appending dataframes that can use a lot of memory.</p>\n<p>Also, are you trying to cache a lot of images, which will quickly use up your memory.</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1018059": "HI,\n\nMy notebook has a high RAM occupation(12.9G/13G), which often results in error submission.\n\nDo you guys have some good ideas to avoid this problem?\n\n",
    "1018777": "Try to do garbage collection. `import gc; gc.collect()` \n\nAlso, remove dataframes or variables not being used. `del(var)`\n\nYou could also use a [memory profiler](https://stackify.com/how-to-use-python-profilers-learn-the-basics/) - but this would be my last option.",
    "1018327": "Please try to visit a local dealer for professional assistance. Thank you.",
    "1027212": "@qiuzhongwei did you get this issue resolve? My ram utilization keeps on increasing even without inferencing my model with every iteration of the test loader.",
    "1018237": "Often this is from appending dataframes that can use a lot of memory.\n\nAlso, are you trying to cache a lot of images, which will quickly use up your memory."
  }
}