{
  "id": 535421,
  "title": "which code provides a faster data calibration? notebook getting stuck in the preprocessing during submission ",
  "url": "/competitions/ariel-data-challenge-2024/discussion/535421",
  "author_name": "zahid_faiz",
  "post_date": "2024-09-22T03:44:41.885000",
  "votes": 0,
  "comment_count": 3,
  "views": 0,
  "content": "<p>I have been trying the host provided calibration, notebook gets timed out  </p>",
  "messages": [
    {
      "id": 2995615,
      "postDate": "2024-09-22T13:26:30.423Z",
      "content": "<p>There are a couple codes that were already shared with faster preprocessing. But one thing you can do that is not usually included is cut the images to the center pixels (10:22), like here: <a href=\"https://www.kaggle.com/code/pourchot/ariel-data-challenge-2024\" target=\"_blank\">https://www.kaggle.com/code/pourchot/ariel-data-challenge-2024</a>. That improves processing time by around 3x. It also slightly improved accuracy for me.</p>",
      "rawMarkdown": "There are a couple codes that were already shared with faster preprocessing. But one thing you can do that is not usually included is cut the images to the center pixels (10:22), like here: https://www.kaggle.com/code/pourchot/ariel-data-challenge-2024. That improves processing time by around 3x. It also slightly improved accuracy for me.",
      "votes": 4,
      "replies": [
        {
          "id": 2996070,
          "postDate": "2024-09-23T03:15:16.837Z",
          "content": "<p>thanks for the guidance, most of the notebooks doesn't take this into consideration </p>\n<p>update: just checked the time for pre processing, it is not improving 3x, might be some other way of processing</p>",
          "rawMarkdown": "thanks for the guidance, most of the notebooks doesn't take this into consideration \n\nupdate: just checked the time for pre processing, it is not improving 3x, might be some other way of processing"
        }
      ]
    },
    {
      "id": 2995261,
      "postDate": "2024-09-22T05:13:12.253Z",
      "content": "<p>You can check my profile for my library in C. It takes about an hour. I saw a notebook with ~30 minutes using cupy but that didn't improve the processing time for me.</p>",
      "rawMarkdown": "You can check my profile for my library in C. It takes about an hour. I saw a notebook with ~30 minutes using cupy but that didn't improve the processing time for me.",
      "votes": 2
    },
    {
      "id": 2995226,
      "postDate": "2024-09-22T03:44:41.887Z",
      "content": "<p>I have been trying the host provided calibration, notebook gets timed out  </p>",
      "rawMarkdown": "I have been trying the host provided calibration, notebook gets timed out  "
    }
  ],
  "comments": [
    {
      "id": 2995615,
      "author_name": "Natan Labarrère",
      "author_url": "",
      "post_date": "2024-09-22T13:26:30.423000",
      "content": "<p>There are a couple codes that were already shared with faster preprocessing. But one thing you can do that is not usually included is cut the images to the center pixels (10:22), like here: <a href=\"https://www.kaggle.com/code/pourchot/ariel-data-challenge-2024\" target=\"_blank\">https://www.kaggle.com/code/pourchot/ariel-data-challenge-2024</a>. That improves processing time by around 3x. It also slightly improved accuracy for me.</p>",
      "votes": 4,
      "replies": [
        {
          "id": 2996070,
          "author_name": "zahid_faiz",
          "author_url": "",
          "post_date": "2024-09-23T03:15:16.837000",
          "content": "<p>thanks for the guidance, most of the notebooks doesn't take this into consideration </p>\n<p>update: just checked the time for pre processing, it is not improving 3x, might be some other way of processing</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 2995261,
      "author_name": "ChingYinNg",
      "author_url": "",
      "post_date": "2024-09-22T05:13:12.253000",
      "content": "<p>You can check my profile for my library in C. It takes about an hour. I saw a notebook with ~30 minutes using cupy but that didn't improve the processing time for me.</p>",
      "votes": 2,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2995615": "There are a couple codes that were already shared with faster preprocessing. But one thing you can do that is not usually included is cut the images to the center pixels (10:22), like here: https://www.kaggle.com/code/pourchot/ariel-data-challenge-2024. That improves processing time by around 3x. It also slightly improved accuracy for me.",
    "2995261": "You can check my profile for my library in C. It takes about an hour. I saw a notebook with ~30 minutes using cupy but that didn't improve the processing time for me.",
    "2995226": "I have been trying the host provided calibration, notebook gets timed out  "
  }
}