747 questions
Advice
1
vote
0
replies
39
views
Transfer Learning: How do I only save the parameter I trained to save disk space?
So, I am having a transfer learning project using VGG16, however as we all know its model size is over 500MB. I somply don't have enough disk space to save more than 200 instance of said model, ...
- 11
0
votes
0
answers
59
views
Why does XGBoost training (with DMatrix) write heavily to disk instead of using RAM?
I am training an XGBoost model in Python on a dataset with approximately 20k features and 30M records.
The features are sparse, and I am using xgboost.DMatrix for training.
Problem
During training, ...
1
vote
0
answers
58
views
Get a list of all mounted file systems in Linux using prometheus
I used the following prometheus metric to get the available space under root directory, by changing mountpoint, I can get the available space for all other locations. How can I get the list of all ...
- 13
2
votes
1
answer
861
views
CoreSimulator storage space
My /Library/Developer/CoreSimulator folder is 27 GB with /Library/Developer/CoreSimulator/Images taking up 15 GB and /Library/Developer/CoreSimulator/Profiles taking up 12 GB. Can I clear anything in ...
- 37
1
vote
1
answer
135
views
How to reduce the required storage space for large indexes and large PostgreSQL tables to improve and ensure performance?
The Situation (updated):
I have 3 PostgreSQL tables (PostgreSQL Version 14.9) that are used to store sensor data from currently 2670 data points. The data was written to the database (blocks of data ...
- 23
0
votes
1
answer
373
views
I can't make changes in WordPress due to disk space limits and lack of FTP access
I am facing two issues related to a WordPress website hosted on SiteGround that I need to resolve:
1 Disk Space Limit Exceeded:
My client has reached the disk space limit on their SiteGround account. ...
1
vote
0
answers
42
views
How to clean all expired cookies from Firefox?
I want to ask how can I clean all expired cookies from Firefox browser while keeping all working/unexpired cookies untouched?
Can this be done by Firefox equivalent of "Expired Cookies Cleaner&...
1
vote
3
answers
1k
views
Find subfolders using a lot of disk space
I'd love to write a bash script that helps me find opportunities for reducing disk usage.
The script would accept 2 arguments: a parent folder (which for me will usually be /apps/), and a threshold (...
- 24.5k
0
votes
1
answer
24
views
Get Cromwell to increase disk space for task on GCP
It's possible to tell GCP to increase the amount of memory allocated to a VM when a run fails. For example:
PAPIv2 {
config {
# Setup GCP to give more memory with each retry
...
- 3,521
0
votes
2
answers
1k
views
Disk pressure on nodes
I have been working with GKE a lot for a while, I created the standard cluster and deployed my image and some dependencies as well. However, it was running fine for sometime and all of a sudden ...
user23422334
0
votes
1
answer
163
views
How to get disk usage stats of a share folder in windows in Java?
My shared folder looks like //shared/content and I want to know details like total space and available space of the folder. How can I do that in Java?
I have tried OSHI library but the file stores and ...
0
votes
0
answers
64
views
I have error Datalife engine panel diskfreespace
When website change PHP version 8.0 or 8.1 DLE panel display error and when I change php 7.4 everything is ok how can i fix this?enter image description here
I deleted this code line in main.php and ...
- 1
0
votes
1
answer
283
views
Does invoking a system call like statfs with Python subprocess use less overhead than invoking a C utility like df?
Unix-based system. I'm trying to use as little overhead as possible right now in the code I'm working on (it's in a resource constrained space). In this particular code, we are gathering some basic ...
- 506
-2
votes
1
answer
292
views
XAMPP tmp folder oversized and shows MySQL high CPU usage [duplicate]
I am running a PHP application on XAMPP (PHP 7.3) which my users are usually uploading files (Image and PDF) and the activities on the application are increasing day by day. But Recently I am facing ...
-2
votes
1
answer
404
views
A file with actual size 1 byte uses 8 blocks of 4096 bytes on the filesystem [closed]
In my home directory, I created a file named file_size_test.txt.
I added a single character a to its content (no newline).
Actual file size of file_size_test.txt = 1 byte.
However, stat file_size_test....
- 57
3
votes
2
answers
161
views
Avoid disk usage as an intermediate step for Zip Compression in C#
The official C# documentation states, that ZipFile.CreateFromDirectory() creates a zipfile on the disk, as an intermediate step. However I need my system to run on devices where disk space is critical....
user22829134
2
votes
1
answer
561
views
Why did Vim create a constantly growing .swp file?
Someone had opened vi via ssh, and pasted output into a buffer, and then later closed / crashed that terminal. The system was later discovered to be out of disk.
Self-answering.
Prior unaddressed ...
- 4,457
8
votes
1
answer
17k
views
How to properly resize disk usage in docker desktop WSL2?
I am having issues with too much space utilized by docker and wsl2 *.vhdx images.
tried running:
docker system prune --all
Restarting the pc.
Still the vhdx images are too big. In my case the image ...
- 596
0
votes
1
answer
184
views
Jenkins is failing at the Pre Set Up stage: "No space left on device"? All I did was change a comment in the code
So I have been pushing my branches to Github, and recently I have run into the following build fail:
The strange thing is that Jenkins was passing just a minute ago, and since then all I did was ...
- 43
-1
votes
1
answer
71
views
Iguazio, Errno 28
I got this error in Iguazio '[Errno 28] No space left on device', see information from log:
2023-08-04 08:53:16,283 [error] runtime error: [('/v3io/projects/krt/FeatureStore/tracing/parquet/sets/...
- 1,390
0
votes
1
answer
37
views
Could GAE Memory Limit Reached be due to large requirements.txt?
I have a couple very large libraries in my flask app's requirements.txt which I upload to Google App Engine for deployment, but I only load small submodules for my app.
I'm trying to understand what ...
- 59
3
votes
0
answers
146
views
unable to authenticate credentials on remote windows to get drive details
Below is the PowerShell check_disk_space.ps1 is used to get remote Windows server drives information but instead I get an error:
param ( [string]$passdrives,
[string]$connuser,
[...
- 3,195
0
votes
1
answer
142
views
Cannot find container from overlay2 subdirectory id
I'm trying to solve a filesystem filling issue because of docker containers, therefore I'm trying to find containers from overlay2 sub-directories structure :
$ sudo find /var/lib/docker/overlay2/ -...
- 4,965
0
votes
1
answer
306
views
Docker creating hundreds of volumes that cannot be pruned
We have an Ubuntu server that runs a few test environments under Docker. The system ran out of space today, and I eventually found that /var/lib/docker had grown to 826 GB with /var/lib/docker/volumes ...
- 4,521
0
votes
1
answer
732
views
grow up logical block size: - FAILED: failed to dump sfdisk info for /dev/sdb
How can I grow up space of the /dev/mapper/ubuntu--vg-ubuntu--lv?
$ df -h
Filesystem Size Used Avail Use% Mounted on
udev 1.5G 0 1.5G 0% /...
- 4,604
0
votes
1
answer
342
views
increase disk size on virtual box (cent os)
I need to increase the disk size.
my system is deployed on oracle virtualbox.
I increased the size of the disk in virtualbox on 200+ gb, but in cent os the system disk remained the same size(18 gb).
...
- 9
3
votes
0
answers
647
views
Disk space usage larger than expected (compared to Storage size)
I am currently working on a Software Project, where I’ve set up an M10 Dedicated cluster on MongoDB Atlas. The statistics of my database look like this:
As it can be seen in the picture above, my ...
- 177
1
vote
1
answer
515
views
Why would Kafka's disk usage cyclically drop every 7 days?
Such a pattern isn't seen on another cluster, which also has the (default) retention set to 7 days.
The cluster in question is v2.8.1 and has these configurations set (everything else is left to ...
- 353
0
votes
1
answer
416
views
Artifactory storage structure
We where running out of storage, and I noticed that the reported "binaries size" from the monitoring console isn't coherent with the actual disk space on the artifactory server.
I see that ...
- 129
2
votes
1
answer
220
views
How to utilize available space reported by volumeAvailableCapacityForImportantUsageKey?
One can query iOS device for available space in several ways. One of the ways is to query using .volumeAvailableCapacityForImportantUsageKey
This usually returns higher capacity due to the fact that ...
- 19
0
votes
2
answers
165
views
Exponential disk usage in Ontotext GraphDB Platform
We are facing some issues using graphdb 9.1 free edition: our disk usage its increasing in an exponential way.
I used the https://graphdb.ontotext.com/documentation/10.0/requirements.html#hardware-...
3
votes
2
answers
3k
views
Conda, command to list disk space used for each environment
Is there a conda command associated with:
conda env list
That allows one to list the size each conda environment is taking up on disk?
- 79
5
votes
4
answers
20k
views
Github runner out of disk space after building docker image
I have two github repos (call them A and B) that both have a .github/workflows/build_and_test.yml file that looks almost identical to this:
name: Build and test
on:
push:
branches: [ main ]
...
- 3,328
1
vote
0
answers
164
views
NLog stops logging due to disk space problem
I have a C# application who logs using the NLog library.
Due to a lack of disk space, the logging has stopped. That's ok, but now it seems that, even after disk cleanup, the logging does not start ...
- 17.6k
0
votes
0
answers
380
views
Historical data usage of a table in MSSQL
I'm a beginner in SQL and I executed the below Stored Procedure in MSSQL to get the disc space related stuff for a table. This one is giving the current status of this table. If I run the same ...
- 1
0
votes
1
answer
3k
views
FATAL: could not write lock file "postmaster.pid": No space left on device
I'm running a PostgreSQL database in a docker container. I allocated 300Gb for docker and everything was going great, having like 90% of free space. Some day I got this error, PostgreSQL Database ...
- 11
0
votes
1
answer
289
views
Is there a way to remove allocated pages that are not associated with a table in SQL Server?
We have an "mdf" file for a database that has grown enough to fill up a 200GB disk on our SQL Server Windows machine. I used the query shown below to list the tables in that database with ...
0
votes
0
answers
305
views
Nominatim - Postgres DB growing very fast in size when doing the daily updates
I have done a full import with the planet from OSM website and scheduled the updates to run daily on a cronjob.
But I have noticed that the disk usage is growing very fast in size on a daily basis.
...
- 52
2
votes
1
answer
4k
views
How to use PowerShell to detect unallocated space on a MBR disk?
I am currently facing an issue with one of my MBR disks on a Windows server. The disk is supposed to have a maximum size of 2048GB, but I have noticed that there is additional space allocated to it ...
- 700
0
votes
0
answers
2k
views
'No space left on device' when running a pipeline after adding additional storage
After purchasing the additional storage (10GB) on Gitlab and running the pipeline I'm running into problems related to space left on the device. I ran the "df -h" command to check the ...
- 1
1
vote
1
answer
222
views
Unable to make playbook fail if any of the disk space reached 80%
- name: Display any lines that have more FS usage than 80%
shell: df -h | awk ‘$NF { print $1, $5 } $5+0 > 80’
register: filesystem
- debug:
var: filesystem.stdout_lines
- fail:
msg: “...
- 11
1
vote
2
answers
6k
views
PG_WAL is very big size
I have a Postgres cluster with 3 nodes: ETCD+Patroni+Postgres13.
Now there was a problem of constantly growing pg_wal folder. It now contains 5127 files. After searching the internet, I found an ...
- 77
1
vote
0
answers
15
views
Is there a way to get DataNode's DiskUsage using java client?
I want to get disk-usage status of a DataNode over RPC/ Java Client. I know there is a way using WebAPI and parsing the response.
But, I am looking for RPC based approach only.
- 63
0
votes
0
answers
32
views
Need a monitoring script to compare the disk space of the build folders at two different NFS locations to identify the time
There are two different locations:
A) /nfs/appdata/6500_build : This is located at India Machine(linux)
B)/nfs/appdata/bamboo_6500_dest : This is located at Ottawa Machine(linux)
Builds are ...
- 49
0
votes
2
answers
870
views
How to read disk drive space for each different path in a PowerShell script?
I have my first small project and I just started a PowerShell (total beginner).
We have three different shared C:\ drives and I need to output each disk storage info (e.g. total and free space) by ...
- 43
2
votes
1
answer
13k
views
Kubernetes: avoid pod being evicted by DiskPressure
I am looking for best practices to avoid Pod The node had condition: [DiskPressure].
So what I'm doing is full database export of all our views which is massive. At some point the pod runs into ...
- 837
12
votes
3
answers
16k
views
Why does visual studio code consume so much disk space?
Visual studio code consumes a lot of disk space during execution:
3GB on start-up.
2GB when running a script (Julia, in my case).
When I kill the in-built terminal and rerun the code, the available ...
- 141
2
votes
2
answers
2k
views
When the kubelet reports that the node is in diskpressure?
I know that the kubelet reports that the node is in diskpressure if there is not enough space on the node.
But I want to know the exact threshold of diskpressure.
Please let me know the source code of ...
- 443
4
votes
1
answer
12k
views
Set max disk usage for Docker using WSL2
On Windows 11, my docker desktop increasingly uses more disk every time I run docker-compose up. I tracked it to the size of the following file which is currently at about 100GB.
%USERPROFILE%\AppData\...
- 3,418
0
votes
0
answers
41
views
Diskspace unaccounted for on azure managed mariadb
i have a managed Mariadb database (10.3.23) on Azure.
Azure tells me that 2.4tb of disk space is used yet when i check the databases i don't reach that figure.
select sum(data_length/1024/1024/1024) ...
- 89