Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
disk usage question and confusion. error world update[slvd]
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Kernel & Hardware
View previous topic :: View next topic  
Author Message
cwc
Veteran
Veteran


Joined: 20 Mar 2006
Posts: 1337
Location: Tri-Cities, WA USA

PostPosted: Fri Aug 16, 2024 2:09 pm    Post subject: disk usage question and confusion. error world update[slvd] Reply with quote

Please throw me a bone on my disk usage question and confusion on world update.
this is my depclan line:
emerge --depclean --ask --exclude "sys-kernel/gentoo-sources"

when I check disk usage I get the following:
Code:


 df -H
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       916G  869G     0 100% /
. . . more below



I tried to do a world update and I get the following:

Code:

>>> Failed to emerge dev-lang/ruby-3.1.6-r1, Log file:

>>>  '/var/tmp/portage/dev-lang/ruby-3.1.6-r1/temp/build.log'

 * Messages for package dev-lang/ruby-3.1.6-r1:

 * The ebuild phase 'unpack' has exited unexpectedly. This type of behavior
 * is known to be triggered by things such as failed variable assignments
 * (bug #190128) or bad substitution errors (bug #200313). Normally, before
 * exiting, bash should have displayed an error message above. If bash did
 * not produce an error message above, it's possible that the ebuild has
 * called `exit` when it should have called `die` instead. This behavior
 * may also be triggered by a corrupt bash binary or a hardware problem
 * such as memory or cpu malfunction. If the problem is not reproducible or
 * it appears to occur randomly, then it is likely to be triggered by a
 * hardware problem. If you suspect a hardware problem then you should try
 * some basic hardware diagnostics such as memtest. Please do not report
 * this as a bug unless it is consistently reproducible and you are sure
 * that your bash binary and hardware are functioning properly.

 * GNU info directory index is up-to-date.
 * After world updates, it is important to remove obsolete packages with
 * emerge --depclean. Refer to `man emerge` for more information.




this is my /etc/fstab

Code:

/dev/sda1   /boot   ext4    defaults,noatime     0 2
/dev/sda2   none         swap    sw                   0 0
/dev/sda3   /            ext4    noatime              0 1

/dev/cdrom  /mnt/cdrom   auto    noauto,user          0 0


/dev/sdb /y ext4 noatime,user,exec 0 0
/dev/sdc /z xfs noatime,user,exec 0 0




Code:
# df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       853G  807G  2.3G 100% /
devtmpfs         10M     0   10M   0% /dev
tmpfs            13G  1.2M   13G   1% /run
shm              32G     0   32G   0% /dev/shm
/dev/sda1       459M  200M  230M  47% /boot
/dev/sdb        916G  185G  685G  22% /y
/dev/sdc        932G  309G  623G  34% /z
tmpfs           6.3G  2.4M  6.3G   1% /run/user/1000




Code:


yoda ~ # df -H
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       916G  869G     0 100% /
devtmpfs         11M     0   11M   0% /dev
tmpfs            14G  1.3M   14G   1% /run
shm              34G     0   34G   0% /dev/shm
/dev/sda1       481M  210M  241M  47% /boot
/dev/sdb        984G  199G  736G  22% /y
/dev/sdc        1.0T  329G  672G  33% /z
tmpfs           6.8G  2.5M  6.8G   1% /run/user/1000
yoda ~ # fdisk -l
Disk /dev/sdb: 931.51 GiB, 1000204886016 bytes, 1953525168 sectors
Disk model: WDC WD10EZEX-00B
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sda: 931.51 GiB, 1000204886016 bytes, 1953525168 sectors
Disk model: WDC  WDS100T2B0A
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x1d6021cc

Device     Boot     Start        End    Sectors  Size Id Type
/dev/sda1            2048    1026047    1024000  500M 83 Linux
/dev/sda2         1026048  135243775  134217728   64G 83 Linux
/dev/sda3       135243776 1953525167 1818281392  867G 83 Linux




_________________
Without diversity there can be no evolution:)


Last edited by cwc on Fri Aug 16, 2024 2:59 pm; edited 1 time in total
Back to top
View user's profile Send private message
Spanik
l33t
l33t


Joined: 12 Dec 2003
Posts: 985
Location: Belgium

PostPosted: Fri Aug 16, 2024 2:31 pm    Post subject: Reply with quote

I'm a bit confused as well but as I read your "df -H", your root partition (/dev/sda3 ?) is full. I suspect portage cannot even download the package to be emerged.
_________________
Expert in non-working solutions
Back to top
View user's profile Send private message
Hu
Administrator
Administrator


Joined: 06 Mar 2007
Posts: 22395

PostPosted: Fri Aug 16, 2024 2:40 pm    Post subject: Reply with quote

What is the disk usage question? The disk appears to be almost completely used. Are you asking why that happened?

What is the output of du -kx / | sort -n | tail -n50? Those will be the 50 worst offenders.


Last edited by Hu on Fri Aug 16, 2024 2:41 pm; edited 1 time in total
Back to top
View user's profile Send private message
cwc
Veteran
Veteran


Joined: 20 Mar 2006
Posts: 1337
Location: Tri-Cities, WA USA

PostPosted: Fri Aug 16, 2024 2:40 pm    Post subject: Reply with quote

Spanik wrote:
I'm a bit confused as well but as I read your "df -H", your root partition (/dev/sda3 ?) is full. I suspect portage cannot even download the package to be emerged.



Yes /dev/sda3 is / root and is full. I really do not know why? And why /dev/sda3 does not show on df -H
_________________
Without diversity there can be no evolution:)
Back to top
View user's profile Send private message
cwc
Veteran
Veteran


Joined: 20 Mar 2006
Posts: 1337
Location: Tri-Cities, WA USA

PostPosted: Fri Aug 16, 2024 2:52 pm    Post subject: Reply with quote

Hu wrote:
What is the disk usage question? The disk appears to be almost completely used. Are you asking why that happened?

What is the output of du -kx / | sort -n | tail -n50? Those will be the 50 worst offenders.




I just did a search for big files
#find /home -type f -size +500M
and found something strange files in ~/..config/Adrduino IDE
Code:

/home/cwc/.config/Arduino IDE/2024-08-14_log.log
/home/cwc/.config/Arduino IDE/2024-08-12_log.old.log
/home/cwc/.config/Arduino IDE/2024-08-11_log.old.log
/home/cwc/.config/Arduino IDE/2024-08-13_log.old.log
/home/cwc/.config/Arduino IDE/2024-08-16_log.old.log
/home/cwc/.config/Arduino IDE/2024-08-10_log.old.log


I wish I would have inspected these files. I just deleted them


along with some other files I downloaded from youtube with yt-dlp

Now my df -H is:

Code:

# df -H
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       916G  380G  490G  44% /
devtmpfs         11M     0   11M   0% /dev
tmpfs            14G  1.3M   14G   1% /run
shm              34G     0   34G   0% /dev/shm
/dev/sda1       481M  210M  241M  47% /boot
/dev/sdb        984G  199G  736G  22% /y
/dev/sdc        1.0T  332G  668G  34% /z



SOLVED
_________________
Without diversity there can be no evolution:)
Back to top
View user's profile Send private message
cwc
Veteran
Veteran


Joined: 20 Mar 2006
Posts: 1337
Location: Tri-Cities, WA USA

PostPosted: Fri Aug 16, 2024 2:55 pm    Post subject: Solved Reply with quote

Use this command and found some big files along with some strange ~/.config/Arduino IDE log files.

#find /home -type f -size +500M

Code:

/home/cwc/.config/Arduino IDE/2024-08-14_log.log
/home/cwc/.config/Arduino IDE/2024-08-12_log.old.log
/home/cwc/.config/Arduino IDE/2024-08-11_log.old.log
/home/cwc/.config/Arduino IDE/2024-08-13_log.old.log
/home/cwc/.config/Arduino IDE/2024-08-16_log.old.log
/home/cwc/.config/Arduino IDE/2024-08-10_log.old.log





New df -H


Code:

# df -H
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       916G  380G  490G  44% /
devtmpfs         11M     0   11M   0% /dev
tmpfs            14G  1.3M   14G   1% /run
shm              34G     0   34G   0% /dev/shm
/dev/sda1       481M  210M  241M  47% /boot
/dev/sdb        984G  199G  736G  22% /y
/dev/sdc        1.0T  332G  668G  34% /z
tmpfs           6.8G  2.5M  6.8G   1% /run/user/1000




I do not know why /dev/sda3 does not show up witha df -H?

fdisk -l
Disk /dev/sdb: 931.51 GiB, 1000204886016 bytes, 1953525168 sectors
Disk model: WDC WD10EZEX-00B
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sda: 931.51 GiB, 1000204886016 bytes, 1953525168 sectors
Disk model: WDC WDS100T2B0A
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x1d6021cc

Device Boot Start End Sectors Size Id Type
/dev/sda1 2048 1026047 1024000 500M 83 Linux
/dev/sda2 1026048 135243775 134217728 64G 83 Linux
/dev/sda3 135243776 1953525167 1818281392 867G 83 Linux
_________________
Without diversity there can be no evolution:)
Back to top
View user's profile Send private message
cwc
Veteran
Veteran


Joined: 20 Mar 2006
Posts: 1337
Location: Tri-Cities, WA USA

PostPosted: Fri Aug 16, 2024 4:40 pm    Post subject: Reply with quote

Hu wrote:
What is the disk usage question? The disk appears to be almost completely used. Are you asking why that happened?

What is the output of du -kx / | sort -n | tail -n50? Those will be the 50 worst offenders.


Thanks for the tip! This helps a lot!

Code:

10285524   /var/lib/libvirt/images
10285556   /var/lib/libvirt
10333744   /home/cwc/Videos
10334528   /var/lib
11343820   /usr/src
13018092   /var/www/html/craigcoleman.com/web-backup
13118744   /home/cwc/Desktop/capture/video-howto
15857028   /home/cwc/Pictures/100NIKON-SD-231202
17483144   /home/cwc/Desktop/capture
17483196   /home/cwc/Desktop
17874764   /usr
18557600   /home/cwc/Downloads/rpi/64bit
22244384   /home/cwc/Pictures
28344708   /var/www/html
32317520   /var/www
43146756   /home/cwc/Downloads/rpi
54310948   /home/cwc/Downloads
122827356   /home/cwc
122882632   /home
165257608   /var/cache/distfiles
165268672   /var/cache
209357796   /var
370417096   /


_________________
Without diversity there can be no evolution:)
Back to top
View user's profile Send private message
Hu
Administrator
Administrator


Joined: 06 Mar 2007
Posts: 22395

PostPosted: Fri Aug 16, 2024 4:59 pm    Post subject: Reply with quote

It looks like you have a lot of distfiles. Have you cleaned them out (eclean-dist) recently?

If you want that list in a form that uses human-friendly sizes, you can use du -hx / | sort -h instead. When dealing with very large amounts, that may be easier to reason about.
Back to top
View user's profile Send private message
cwc
Veteran
Veteran


Joined: 20 Mar 2006
Posts: 1337
Location: Tri-Cities, WA USA

PostPosted: Fri Aug 16, 2024 6:18 pm    Post subject: Reply with quote

Hu wrote:
It looks like you have a lot of distfiles. Have you cleaned them out (eclean-dist) recently?

If you want that list in a form that uses human-friendly sizes, you can use du -hx / | sort -h instead. When dealing with very large amounts, that may be easier to reason about.


wow! thank you!

[ 142.8 G ] Total space from 2078 files were freed in the distfiles directory

Thank you I have never run eclean-dist.

yoda ~ # df -H
Filesystem Size Used Avail Use% Mounted on
/dev/root 916G 227G 643G 27% /
devtmpfs 11M 0 11M 0% /dev
tmpfs 14G 1.3M 14G 1% /run
shm 34G 0 34G 0% /dev/shm
/dev/sda1 481M 210M 241M 47% /boot
/dev/sdb 984G 199G 736G 22% /y
/dev/sdc 1.0T 332G 668G 34% /z
tmpfs 6.8G 2.5M 6.8G 1% /run/user/1000
_________________
Without diversity there can be no evolution:)
Back to top
View user's profile Send private message
stefantalpalaru
n00b
n00b


Joined: 11 Jan 2009
Posts: 47
Location: Italy

PostPosted: Fri Aug 16, 2024 8:06 pm    Post subject: Reply with quote

cwc wrote:

Code:

 df -H
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       916G  869G     0 100% /



Looks like the 5% that ext4 reserves by default for the root user. Portage cannot make use of that, unless you get rid of the reserve altogether, with "tune2fs -m0 /dev/root".

cwc wrote:

I just did a search for big files


A very useful tool here is "sys-fs/ncdu" (I prefer a version before 2.0 that introduced a Zig rewrite). You can run it like this: "ncdu -x /".
Back to top
View user's profile Send private message
cwc
Veteran
Veteran


Joined: 20 Mar 2006
Posts: 1337
Location: Tri-Cities, WA USA

PostPosted: Fri Aug 16, 2024 11:23 pm    Post subject: Reply with quote

stefantalpalaru wrote:
cwc wrote:

Code:

 df -H
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       916G  869G     0 100% /



Looks like the 5% that ext4 reserves by default for the root user. Portage cannot make use of that, unless you get rid of the reserve altogether, with "tune2fs -m0 /dev/root".

cwc wrote:

I just did a search for big files


A very useful tool here is "sys-fs/ncdu" (I prefer a version before 2.0 that introduced a Zig rewrite). You can run it like this: "ncdu -x /".


i like it! Thank you {grazie amico} stefantalpalaru ncdu -x

Code:

   56.8 GiB [#############              ] /var
   17.0 GiB [###                        ] /usr
    9.6 GiB [##                         ] /opt
    8.1 GiB [#                          ] /ztmp
    1.2 GiB [                           ] /lib
  485.5 MiB [                           ]  stage3-amd64-desktop-openrc-20220807T170536Z.tar.xz
   19.2 MiB [                           ] /etc
   17.3 MiB [                           ] /root
   10.0 MiB [                           ] /bin
   10.0 MiB [                           ] /lib64
    9.1 MiB [                           ] /sbin
.   7.7 MiB [                           ] /tmp
e  16.0 KiB [                           ] /lost+found
   12.0 KiB [                           ] /mnt
    8.0 KiB [                           ] /v2
    4.0 KiB [                           ] /media
    4.0 KiB [                           ]  emerge-list-220811.txt
@   0.0   B [                           ]  v
>   0.0   B [                           ] /z
>   0.0   B [                           ] /y
>   0.0   B [                           ] /sys
>   0.0   B [                           ] /run
>   0.0   B [                           ] /proc
>   0.0   B [                           ] /dev
>   0.0   B [                           ] /boot


_________________
Without diversity there can be no evolution:)
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Kernel & Hardware All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum