I am not sure anyone else noticed this.
\nBut on the Leaderboard, our score is shown as 0.57, while in our list of sorted submissions the highest score we have is 0.56.
\nI wonder if this is an issue with rounding, or something else going on.
\n", "messages": [ { "id": 2099427, "postDate": "2023-01-14T12:38:23.177Z", "content": "I am not sure anyone else noticed this.
\nBut on the Leaderboard, our score is shown as 0.57, while in our list of sorted submissions the highest score we have is 0.56.
\nI wonder if this is an issue with rounding, or something else going on.
\n", "rawMarkdown": "I am not sure anyone else noticed this.\n\nBut on the Leaderboard, our score is shown as 0.57, while in our list of sorted submissions the highest score we have is 0.56.\n\nI wonder if this is an issue with rounding, or something else going on.\n\n@sohier @ryanholbrook ", "votes": 6 }, { "id": 2099737, "postDate": "2023-01-14T17:10:11.200Z", "content": "Alien is interfering!
", "rawMarkdown": "Alien is interfering!", "votes": 3 }, { "id": 2100076, "postDate": "2023-01-14T23:14:04.530Z", "content": "Thank you for reporting the bug, there was a bug impacting the scores on a small number of submissions on the Submissions page. The bug should be fixed now, please let us know if you are still seeing inconsistent behavior.
", "rawMarkdown": "Thank you for reporting the bug, there was a bug impacting the scores on a small number of submissions on the Submissions page. The bug should be fixed now, please let us know if you are still seeing inconsistent behavior.", "votes": 4 }, { "id": 2099954, "postDate": "2023-01-14T19:41:38.380Z", "content": "@dster replied in the other thread
\n\n", "rawMarkdown": "@dster replied in the other thread\n\n> Hey there, thanks for reporting. I can confirm the bug, and that the error is on the My Submissions page, the Leaderboard value is correct. We'll have this fixed by the next business day which is Tuesday. Sorry for the inconvenience.", "votes": 1 }, { "id": 2099573, "postDate": "2023-01-14T14:17:51.483Z", "content": "Hey there, thanks for reporting. I can confirm the bug, and that the error is on the My Submissions page, the Leaderboard value is correct. We'll have this fixed by the next business day which is Tuesday. Sorry for the inconvenience.
\n
You can try select and unselect this submission and then it becomes equal to lb. But after refreshing page you'll need to do it again
\nIt can help to deal with non top submissions
", "rawMarkdown": "You can try select and unselect this submission and then it becomes equal to lb. But after refreshing page you'll need to do it again\n\nIt can help to deal with non top submissions ", "votes": 1, "replies": [ { "id": 2099605, "postDate": "2023-01-14T15:05:41.857Z", "content": "Interesting, thank you. Indeed that changes the score. Looking forward for the explanation of that behaviour 👀
", "rawMarkdown": "Interesting, thank you. Indeed that changes the score. Looking forward for the explanation of that behaviour 👀" } ] }, { "id": 2099432, "postDate": "2023-01-14T12:41:28.013Z", "content": "same here:
\nhttps://www.kaggle.com/discussions/product-feedback/378070
it just happens today
", "rawMarkdown": "same here:\nhttps://www.kaggle.com/discussions/product-feedback/378070\n\nit just happens today", "votes": 2, "replies": [ { "id": 2099434, "postDate": "2023-01-14T12:46:29.597Z", "content": "Okay, not alone then.
\nFor us it started happening yesterday it seems - or even the day before.
\nMaybe in the list the score is always floored, like it has been historically the case.
\nAnd on LB the score is rounded. But in the past this has not been the case.
And there is yet another score which can be different, which is in the notebook UI. It's never really worried me though, as long as it sorts before rounding/truncating.
\nActually, when you think about it, the difference between them actually provided slightly more information.
", "rawMarkdown": "And there is yet another score which can be different, which is in the notebook UI. It's never really worried me though, as long as it sorts before rounding/truncating.\n\nActually, when you think about it, the difference between them actually provided slightly more information.", "replies": [ { "id": 2100077, "postDate": "2023-01-14T23:17:16.143Z", "content": "It's a known issue that the Notebook Listing on the Code tab truncates scores before sorting which is not desired behavior, but unfortunately is not an easy fix due to how that pipeline is currently organized internally. It's not our top priority but something we hope to address in the medium-term.
", "rawMarkdown": "It's a known issue that the Notebook Listing on the Code tab truncates scores before sorting which is not desired behavior, but unfortunately is not an easy fix due to how that pipeline is currently organized internally. It's not our top priority but something we hope to address in the medium-term.", "votes": 1 } ] } ], "comments": [ { "id": 2099737, "author_name": "dragon zhang", "author_url": "", "post_date": "2023-01-14T17:10:11.200000", "content": "Alien is interfering!
", "votes": 3, "replies": [] }, { "id": 2100076, "author_name": "DJ Sterling", "author_url": "", "post_date": "2023-01-14T23:14:04.530000", "content": "Thank you for reporting the bug, there was a bug impacting the scores on a small number of submissions on the Submissions page. The bug should be fixed now, please let us know if you are still seeing inconsistent behavior.
", "votes": 4, "replies": [] }, { "id": 2099954, "author_name": "Psi", "author_url": "", "post_date": "2023-01-14T19:41:38.380000", "content": "@dster replied in the other thread
\n\n", "votes": 1, "replies": [] }, { "id": 2099573, "author_name": "Kolya Forrat", "author_url": "", "post_date": "2023-01-14T14:17:51.483000", "content": "Hey there, thanks for reporting. I can confirm the bug, and that the error is on the My Submissions page, the Leaderboard value is correct. We'll have this fixed by the next business day which is Tuesday. Sorry for the inconvenience.
\n
You can try select and unselect this submission and then it becomes equal to lb. But after refreshing page you'll need to do it again
\nIt can help to deal with non top submissions
", "votes": 1, "replies": [ { "id": 2099605, "author_name": "Pascal Pfeiffer", "author_url": "", "post_date": "2023-01-14T15:05:41.857000", "content": "Interesting, thank you. Indeed that changes the score. Looking forward for the explanation of that behaviour 👀
", "votes": 0, "replies": [] } ] }, { "id": 2099432, "author_name": "hengck23", "author_url": "", "post_date": "2023-01-14T12:41:28.013000", "content": "same here:
\nhttps://www.kaggle.com/discussions/product-feedback/378070
it just happens today
", "votes": 2, "replies": [ { "id": 2099434, "author_name": "Psi", "author_url": "", "post_date": "2023-01-14T12:46:29.597000", "content": "Okay, not alone then.
\nFor us it started happening yesterday it seems - or even the day before.
\nMaybe in the list the score is always floored, like it has been historically the case.
\nAnd on LB the score is rounded. But in the past this has not been the case.
And there is yet another score which can be different, which is in the notebook UI. It's never really worried me though, as long as it sorts before rounding/truncating.
\nActually, when you think about it, the difference between them actually provided slightly more information.
", "votes": 0, "replies": [ { "id": 2100077, "author_name": "DJ Sterling", "author_url": "", "post_date": "2023-01-14T23:17:16.143000", "content": "It's a known issue that the Notebook Listing on the Code tab truncates scores before sorting which is not desired behavior, but unfortunately is not an easy fix due to how that pipeline is currently organized internally. It's not our top priority but something we hope to address in the medium-term.
", "votes": 1, "replies": [] } ] } ], "raw_markdown_by_id": { "2099427": "I am not sure anyone else noticed this.\n\nBut on the Leaderboard, our score is shown as 0.57, while in our list of sorted submissions the highest score we have is 0.56.\n\nI wonder if this is an issue with rounding, or something else going on.\n\n@sohier @ryanholbrook ", "2099737": "Alien is interfering!", "2100076": "Thank you for reporting the bug, there was a bug impacting the scores on a small number of submissions on the Submissions page. The bug should be fixed now, please let us know if you are still seeing inconsistent behavior.", "2099954": "@dster replied in the other thread\n\n> Hey there, thanks for reporting. I can confirm the bug, and that the error is on the My Submissions page, the Leaderboard value is correct. We'll have this fixed by the next business day which is Tuesday. Sorry for the inconvenience.", "2099573": "You can try select and unselect this submission and then it becomes equal to lb. But after refreshing page you'll need to do it again\n\nIt can help to deal with non top submissions ", "2099432": "same here:\nhttps://www.kaggle.com/discussions/product-feedback/378070\n\nit just happens today", "2099967": "And there is yet another score which can be different, which is in the notebook UI. It's never really worried me though, as long as it sorts before rounding/truncating.\n\nActually, when you think about it, the difference between them actually provided slightly more information." } }