{
  "id": 500046,
  "title": "How to TRAIN LARGE DATA on Kaggle and XGBoost",
  "url": "/competitions/leap-atmospheric-physics-ai-climsim/discussion/500046",
  "author_name": "JS",
  "post_date": "2024-05-04T05:56:42.467000",
  "votes": 2,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Hi all , When I trained the XGBoost model on 6,25000 train and validation data , it trains well, but as soon as I increase training data I get an error : </p>\n<blockquote>\n  <p>XGBoostError: [05:37:55] /workspace/src/c_api/../data/../common/device_helpers.cuh:431: Memory allocation error on worker 0: std::bad_alloc: cudaErrorMemoryAllocation: out of memory</p>\n  <ul>\n  <li>Free memory: 72417280</li>\n  <li>Requested memory: 1301562504</li>\n  </ul>\n</blockquote>\n<p>Can anyone please help me</p>\n<p>POV : I am training the model from leap-dataset-giga</p>",
  "messages": [
    {
      "id": 2792196,
      "postDate": "2024-05-04T05:56:42.467Z",
      "content": "<p>Hi all , When I trained the XGBoost model on 6,25000 train and validation data , it trains well, but as soon as I increase training data I get an error : </p>\n<blockquote>\n  <p>XGBoostError: [05:37:55] /workspace/src/c_api/../data/../common/device_helpers.cuh:431: Memory allocation error on worker 0: std::bad_alloc: cudaErrorMemoryAllocation: out of memory</p>\n  <ul>\n  <li>Free memory: 72417280</li>\n  <li>Requested memory: 1301562504</li>\n  </ul>\n</blockquote>\n<p>Can anyone please help me</p>\n<p>POV : I am training the model from leap-dataset-giga</p>",
      "rawMarkdown": "Hi all , When I trained the XGBoost model on 6,25000 train and validation data , it trains well, but as soon as I increase training data I get an error : \n\n> XGBoostError: [05:37:55] /workspace/src/c_api/../data/../common/device_helpers.cuh:431: Memory allocation error on worker 0: std::bad_alloc: cudaErrorMemoryAllocation: out of memory\n- Free memory: 72417280\n- Requested memory: 1301562504\n\n\n\nCan anyone please help me\n\nPOV : I am training the model from leap-dataset-giga",
      "votes": 2
    },
    {
      "id": 2864238,
      "postDate": "2024-06-10T04:08:53.003Z",
      "content": "<p>How about dask xgboost?</p>",
      "rawMarkdown": "How about dask xgboost?"
    },
    {
      "id": 2792391,
      "postDate": "2024-05-04T07:45:05.610Z",
      "rawMarkdown": "",
      "isDeleted": true,
      "replies": [
        {
          "id": 2794514,
          "postDate": "2024-05-05T10:42:23.360Z",
          "content": "<p>Thank You , trying this </p>",
          "rawMarkdown": "Thank You , trying this ",
          "replies": [
            {
              "id": 2859387,
              "postDate": "2024-06-07T02:37:37.080Z",
              "content": "<p>What was here? :)</p>",
              "rawMarkdown": "What was here? :)",
              "votes": 1
            }
          ]
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 2864238,
      "author_name": "ONODERA",
      "author_url": "",
      "post_date": "2024-06-10T04:08:53.003000",
      "content": "<p>How about dask xgboost?</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 2792391,
      "author_name": "",
      "author_url": "",
      "post_date": "2024-05-04T07:45:05.610000",
      "content": "",
      "votes": 0,
      "replies": [
        {
          "id": 2794514,
          "author_name": "JS",
          "author_url": "",
          "post_date": "2024-05-05T10:42:23.360000",
          "content": "<p>Thank You , trying this </p>",
          "votes": 0,
          "replies": [
            {
              "id": 2859387,
              "author_name": "yk4r2",
              "author_url": "",
              "post_date": "2024-06-07T02:37:37.080000",
              "content": "<p>What was here? :)</p>",
              "votes": 1,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2792196": "Hi all , When I trained the XGBoost model on 6,25000 train and validation data , it trains well, but as soon as I increase training data I get an error : \n\n> XGBoostError: [05:37:55] /workspace/src/c_api/../data/../common/device_helpers.cuh:431: Memory allocation error on worker 0: std::bad_alloc: cudaErrorMemoryAllocation: out of memory\n- Free memory: 72417280\n- Requested memory: 1301562504\n\n\n\nCan anyone please help me\n\nPOV : I am training the model from leap-dataset-giga",
    "2864238": "How about dask xgboost?",
    "2792391": ""
  }
}