![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5014620%2F2f912cd8a99e22076246349aacc2d7b2%2FScreenshot%202022-12-01%20at%2012.48.10.png?generation=1669888150288667&alt=media\")
\nMy submission code:
![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5014620%2F83c75e824d3067fd2397f3573a13a61f%2FScreenshot%202022-12-01%20at%2012.50.17.png?generation=1669888232611542&alt=media\")
I start the submission notebook and have this error:
\nMy submission code:
I took my notebook private while I was trying to figure it out but I see that you already started to use my code.
\nI believe I have figured this out and will share the fix with the next iteration of the notebook.
", "rawMarkdown": "I took my notebook private while I was trying to figure it out but I see that you already started to use my code.\n\nI believe I have figured this out and will share the fix with the next iteration of the notebook.", "votes": 1, "replies": [ { "id": 2051329, "postDate": "2022-12-01T10:46:11.413Z", "content": "Yes, I've tried to use your code for submission part. Thanks for help, I'll check your notebook later!
", "rawMarkdown": "Yes, I've tried to use your code for submission part. Thanks for help, I'll check your notebook later!\n" } ] }, { "id": 2052224, "postDate": "2022-12-02T02:52:26.203Z", "content": "I am facing this same issue of \"threw exception\". Any solution?
", "rawMarkdown": "I am facing this same issue of \"threw exception\". Any solution?", "replies": [ { "id": 2052226, "postDate": "2022-12-02T02:57:38.457Z", "content": "It will depend on your situation. Essentially, you need to think of scenarios where your code runs on the four images in the local test set but might explode when running on the true competition test set which is much larger.
\nIn my case (where the code above was copied from) there were images in the test set my code couldn't parse. I got lucky (or \"unlucky\") on the four images in the local test set as my code could parse them, but then in test an error was being thrown.
\nBut there can be many other reasons for this happening. Maybe you are infering with too big of a batch size and getting an out of memory error? The set of things that could be going wrong is really infinite and you have to analyze the situation in the context of your particular code.
", "rawMarkdown": "It will depend on your situation. Essentially, you need to think of scenarios where your code runs on the four images in the local test set but might explode when running on the true competition test set which is much larger.\n\nIn my case (where the code above was copied from) there were images in the test set my code couldn't parse. I got lucky (or \"unlucky\") on the four images in the local test set as my code could parse them, but then in test an error was being thrown.\n\nBut there can be many other reasons for this happening. Maybe you are infering with too big of a batch size and getting an out of memory error? The set of things that could be going wrong is really infinite and you have to analyze the situation in the context of your particular code.", "votes": 2 }, { "id": 2052229, "postDate": "2022-12-02T03:03:05.650Z", "content": "Okay, thank you. I will try to check for parsing errors or maybe add a limit on file size to read? Idk, why no one has opened a discussion over it (if they have faced & fixed the issue).
", "rawMarkdown": "Okay, thank you. I will try to check for parsing errors or maybe add a limit on file size to read? Idk, why no one has opened a discussion over it (if they have faced & fixed the issue). ", "votes": 1 }, { "id": 2052234, "postDate": "2022-12-02T03:08:05.267Z", "content": "Because it all depends on the code that you are using, the error is very generic. You might get the error for many reasons, depending on the code that you are using.
\nAre you getting this error with the code above? If so, I hope to have a working version available very soon, just testing it now whether it works.
", "rawMarkdown": "Because it all depends on the code that you are using, the error is very generic. You might get the error for many reasons, depending on the code that you are using.\n\nAre you getting this error with the code above? If so, I hope to have a working version available very soon, just testing it now whether it works.", "votes": 1 }, { "id": 2052253, "postDate": "2022-12-02T03:32:08.750Z", "content": "No, I have my own code.
\nI am doing like this
\ntest_csv = pd.read_csv()\nog_sub = pd.read_csv().head()\ntestfiles = glob.glob()\n\n fpath tqdm(testfiles):\n fsplits = fpath.split()\n patient_id = fsplits[-]\n image_id = fsplits[-].split()[]\n npath = \n prediction_id = (test_csv.loc[test_csv.image_id == (image_id)].prediction_id.values[]).strip()\n predictions = \n :\n read & predict files \n :\n \n\n\n newdf = pd.DataFrame([[prediction_id, predictions]], columns=[,])\n g_sub = pd.concat([newdf, og_sub])\n\n KeyboardInterrupt:\n \n\n Exception e:\n (e)\n \n\n :\n :\n os.remove(npath)\n :\n \n\nog_sub = og_sub.groupby().mean() \nog_sub = og_sub.sort_index()\nog_sub.to_csv(, index=)\nI have also just added a new check in my \"read part\". To ignore files above 1.30GB
\n ():\n\n\n max_sz = ** \n\n :\n sz = os.path.getsize(filepath)\n :\n sz = max_sz + \n\n (sz > max_sz):\n \n\n \nI am using other notebook, where I just load weights of my model (I don't train) and test it on a test part, and create submission, and it fails. I can make my submission notebook public, and u could check it
", "rawMarkdown": "I am using other notebook, where I just load weights of my model (I don't train) and test it on a test part, and create submission, and it fails. I can make my submission notebook public, and u could check it" }, { "id": 2052833, "postDate": "2022-12-02T14:43:25.997Z", "content": "Now, I am getting \"notebook timeout\" :(
", "rawMarkdown": "Now, I am getting \"notebook timeout\" :( " } ] }, { "id": 2051253, "postDate": "2022-12-01T09:50:35.323Z", "content": "I start the submission notebook and have this error:
\nMy submission code:
I took my notebook private while I was trying to figure it out but I see that you already started to use my code.
\nI believe I have figured this out and will share the fix with the next iteration of the notebook.
", "votes": 1, "replies": [ { "id": 2051329, "author_name": "Vovinsa", "author_url": "", "post_date": "2022-12-01T10:46:11.413000", "content": "Yes, I've tried to use your code for submission part. Thanks for help, I'll check your notebook later!
", "votes": 0, "replies": [] } ] }, { "id": 2052224, "author_name": "Hey24sheep", "author_url": "", "post_date": "2022-12-02T02:52:26.203000", "content": "I am facing this same issue of \"threw exception\". Any solution?
", "votes": 0, "replies": [ { "id": 2052226, "author_name": "Radek Osmulski", "author_url": "", "post_date": "2022-12-02T02:57:38.457000", "content": "It will depend on your situation. Essentially, you need to think of scenarios where your code runs on the four images in the local test set but might explode when running on the true competition test set which is much larger.
\nIn my case (where the code above was copied from) there were images in the test set my code couldn't parse. I got lucky (or \"unlucky\") on the four images in the local test set as my code could parse them, but then in test an error was being thrown.
\nBut there can be many other reasons for this happening. Maybe you are infering with too big of a batch size and getting an out of memory error? The set of things that could be going wrong is really infinite and you have to analyze the situation in the context of your particular code.
", "votes": 2, "replies": [] }, { "id": 2052229, "author_name": "Hey24sheep", "author_url": "", "post_date": "2022-12-02T03:03:05.650000", "content": "Okay, thank you. I will try to check for parsing errors or maybe add a limit on file size to read? Idk, why no one has opened a discussion over it (if they have faced & fixed the issue).
", "votes": 1, "replies": [] }, { "id": 2052234, "author_name": "Radek Osmulski", "author_url": "", "post_date": "2022-12-02T03:08:05.267000", "content": "Because it all depends on the code that you are using, the error is very generic. You might get the error for many reasons, depending on the code that you are using.
\nAre you getting this error with the code above? If so, I hope to have a working version available very soon, just testing it now whether it works.
", "votes": 1, "replies": [] }, { "id": 2052253, "author_name": "Hey24sheep", "author_url": "", "post_date": "2022-12-02T03:32:08.750000", "content": "No, I have my own code.
\nI am doing like this
\ntest_csv = pd.read_csv()\nog_sub = pd.read_csv().head()\ntestfiles = glob.glob()\n\n fpath tqdm(testfiles):\n fsplits = fpath.split()\n patient_id = fsplits[-]\n image_id = fsplits[-].split()[]\n npath = \n prediction_id = (test_csv.loc[test_csv.image_id == (image_id)].prediction_id.values[]).strip()\n predictions = \n :\n read & predict files \n :\n \n\n\n newdf = pd.DataFrame([[prediction_id, predictions]], columns=[,])\n g_sub = pd.concat([newdf, og_sub])\n\n KeyboardInterrupt:\n \n\n Exception e:\n (e)\n \n\n :\n :\n os.remove(npath)\n :\n \n\nog_sub = og_sub.groupby().mean() \nog_sub = og_sub.sort_index()\nog_sub.to_csv(, index=)\nI have also just added a new check in my \"read part\". To ignore files above 1.30GB
\n ():\n\n\n max_sz = ** \n\n :\n sz = os.path.getsize(filepath)\n :\n sz = max_sz + \n\n (sz > max_sz):\n \n\n \nI am using other notebook, where I just load weights of my model (I don't train) and test it on a test part, and create submission, and it fails. I can make my submission notebook public, and u could check it
", "votes": 0, "replies": [] }, { "id": 2052833, "author_name": "Hey24sheep", "author_url": "", "post_date": "2022-12-02T14:43:25.997000", "content": "Now, I am getting \"notebook timeout\" :(
", "votes": 0, "replies": [] } ] } ], "raw_markdown_by_id": { "2051322": "I took my notebook private while I was trying to figure it out but I see that you already started to use my code.\n\nI believe I have figured this out and will share the fix with the next iteration of the notebook.", "2052224": "I am facing this same issue of \"threw exception\". Any solution?", "2051253": "I start the submission notebook and have this error:\nMy submission code: " } }