Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Massive slowdowns when handling many small files
View unanswered posts
View posts from last 24 hours

Goto page Previous  1, 2  
Reply to topic    Gentoo Forums Forum Index Kernel & Hardware
View previous topic :: View next topic  
Author Message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54901
Location: 56N 3W

PostPosted: Fri Feb 21, 2025 4:45 pm    Post subject: Reply with quote

Jimini,

Did you do this on SSD or magnetic HDD?

Writes to SSD are slow if you need to wait for erase cycles, as FLASH memory cells cannot be overwritten.
I don't think forcing an erase is possible. It depends how the drive implements trim.

Its supposed to make notes, then do the erase before it slows down writes.
In some drives, it is an immediate command, which is a bad thing for write amplification.
Use fstrim now and again. No the discard mount option.

Magnetic HDD just overwrite previously written space. No prior slow erase required.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
dmpogo
Advocate
Advocate


Joined: 02 Sep 2004
Posts: 3475
Location: Canada

PostPosted: Fri Feb 21, 2025 11:47 pm    Post subject: Reply with quote

NeddySeagoon wrote:
Jimini,

Did you do this on SSD or magnetic HDD?

Writes to SSD are slow if you need to wait for erase cycles, as FLASH memory cells cannot be overwritten.
I don't think forcing an erase is possible. It depends how the drive implements trim.

Its supposed to make notes, then do the erase before it slows down writes.
In some drives, it is an immediate command, which is a bad thing for write amplification.
Use fstrim now and again. No the discard mount option.

Magnetic HDD just overwrite previously written space. No prior slow erase required.


But that would not explain the difference between the kernel versions ?
Back to top
View user's profile Send private message
Jimini
l33t
l33t


Joined: 31 Oct 2006
Posts: 615
Location: Germany

PostPosted: Sat Feb 22, 2025 4:14 am    Post subject: Reply with quote

NeddySeagoon wrote:
Did you do this on SSD or magnetic HDD?


Only a RAID6 consisting of 7 HDD (1x Toshiba MG08ACA16TE, 1x Seagate Exos X18, 5x Seagate Exos X16) is affected here.
_________________
"The most merciful thing in the world, I think, is the inability of the human mind to correlate all its contents." (H.P. Lovecraft: The Call of Cthulhu)
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54901
Location: 56N 3W

PostPosted: Sat Feb 22, 2025 12:51 pm    Post subject: Reply with quote

dmpogo,

Correct ... unless the SSDs decided to do a block of erase cycles when the suspect kernel was running. Then it would be coincidence. :)
Anyway, its all rotating rust, so we can rule out random SSD oddities.

Jimini,

I suspect your drives all all OK but can you put
Code:
smartctl -x /dev/...
for each drive onto a pastebin please?
If one drive was being slow, or needing the kernel error handler, it would probably be kicked out of the set.
The error handler makes lots of noise in dmesg.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Jimini
l33t
l33t


Joined: 31 Oct 2006
Posts: 615
Location: Germany

PostPosted: Sat Feb 22, 2025 6:09 pm    Post subject: Reply with quote

Neddy, of course, here you are:
https://paste.gentoo.zip/EhoatfiT
https://paste.gentoo.zip/JMwdci4E
https://paste.gentoo.zip/SdndfX1M
https://paste.gentoo.zip/maMgWzab
https://paste.gentoo.zip/cdbfCRTg
https://paste.gentoo.zip/evchNp90
https://paste.gentoo.zip/9JhwJwe1

I am currently in a hurry and cannot check the results by myself right now, will do this later and, if necessary, edit my post.

Kind regards
Jimini
_________________
"The most merciful thing in the world, I think, is the inability of the human mind to correlate all its contents." (H.P. Lovecraft: The Call of Cthulhu)
Back to top
View user's profile Send private message
NeddySeagoon
Administrator
Administrator


Joined: 05 Jul 2003
Posts: 54901
Location: 56N 3W

PostPosted: Sat Feb 22, 2025 7:44 pm    Post subject: Reply with quote

Jimini,

That are all good.

Code:
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  5 Reallocated_Sector_Ct   PO--CK   100   100   010    -    0
197 Current_Pending_Sector  -O--C-   100   100   000    -    0
198 Offline_Uncorrectable   ----C-   100   100   000    -    0
199 UDMA_CRC_Error_Count    -OSRCK   200   200   000    -    0

and nothing in the error logs either.

That's another thing that it isn't :)
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Kernel & Hardware All times are GMT
Goto page Previous  1, 2
Page 2 of 2

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum