Expedition root directory keeps growing

[stevenjwilliams83]

I have expanded the root directory like 2 times already and it keeps filling up. So now the expedition gui will not load. 

So what is taking all the space?  

expedition@pan-expedition:/hdd/PaloLogs$ df -h

Filesystem                       Size  Used Avail Use% Mounted on

udev                             2.9G     0  2.9G   0% /dev

tmpfs                            595M   24M  572M   4% /run

/dev/mapper/Expedition--vg-root  109G  106G     0 100% /

tmpfs                            3.0G     0  3.0G   0% /dev/shm

tmpfs                            5.0M     0  5.0M   0% /run/lock

tmpfs                            3.0G     0  3.0G   0% /sys/fs/cgroup

/dev/sdb                          99G   28G   67G  29% /hdd

/dev/sda1                        472M  109M  340M  25% /boot

tmpfs                            595M     0  595M   0% /run/user/1000

expedition@pan-expedition:/hdd/PaloLogs$

I think the "projects" live in the root so it must be large to be taking up that much room so what are some options here?

/dev/sbd is where the logs from the pan are getting exported.

[dgildelaig]

Could you please check if the folder /tmp/spark-warehouse is taking the space?

If so, how big did it get?

[stevenjwilliams83]

How do I check the size of the directory?

[dgildelaig]

du -hs /tmp/sparl-warehouse

I find it useful to see how much folders take by

for i in `ls`; do du -hs $i; done

[stevenjwilliams83]

expedition@pan-expedition:~$ du -hs /tmp/spark-warehouse

4.0K /tmp/spark-warehouse

expedition@pan-expedition:~$

[dgildelaig]

Try to locate the "big" folder with the script I mentioned above.

Start by / and trace the big folder down to the deep location.

I would appreciate this effort to see whether it is related to any task regarding Spark processes.

[stevenjwilliams83]

I am more than happy to help im just not a skilled linux guy so need a bit more detailed instructions on that script? Is it as easy as copy paste? I assume not. 

[dgildelaig]

You assumed right.

As easy as copy and paste.

It will let you know, from the different folders within your current path, the size of each of them.

So, start by

Step 1: cd /

Step 2: for i in `ls`; do du -hs $i; done

Step 3: Check which folder is the big one. Let's assume it is /tmp
Step 4: cd /tmp

Step 5: jump to step 2

[stevenjwilliams83]

Is there a way to sort? Also there is alot of permissions denied errors. 

[sjanita]

if there were many snapshots taken for each project this could grow the storage for the projects.

You can check the backup directories for each project.

Note: you will need su access to move into the project directory.

/home/userSpace/projects

within each project there will be a 'Backups' directory that can be checked for the snapshots.