Questions tagged [zfs]
ZFS is a modern file system and volume manager originally developed by Sun Microsystems and licensed under the CDDL. It is a copy-on-write file system with support for large storage arrays, protection against corruption, snapshots, clones, compression, deduplication and NFSv4 ACLs. An open-source fork of ZFS can be found at http://open-zfs.org/ , which is supported by ZFSonlinux.org, illumos.org and ZFS developers in the FreeBSD & Mac OS X communities.
1,403
questions
0
votes
0
answers
14
views
FreeBSD - Is it possible to create a clone of a snapshot in a different disk for improved performance?
I am a new to FreeBSD and want to make a virtual disk service via iSCSI.
I create snapshots of a dataset on the same disks, however I would like to create clones on a different disk like a nvme disk ...
0
votes
0
answers
11
views
ZFS list - root mounted twice?
I've followed this guide to install ubuntu with root on zfs. I've skipped creating all the dedicated (sub) datasets in step 3.3. Now "zfs list" looks like:
NAME USED ...
- 103
0
votes
0
answers
29
views
Bash script error when trying to create a snapshot
I am trying to create a snapshot using Bash script as below but error occurred.
Environment: FreeBSD,
Version: 13.2,
Script: Bash
#!/usr/local/bin/bash
name="17102023_1234"
zfs snapshot data/...
1
vote
1
answer
121
views
Why are files copied over usb to be 0 bytes?
This is a recurrent topic and I have read some answers on serverfault amongst them:
Folder sizes differ within two copied NTFS file trees (using ntfs-3g)
We have a ubuntu client from which researchers ...
5
votes
2
answers
75
views
Can ZFS send/receive help me recover from partial pool loss after upgrade to Ubuntu 22?
I have a long-running ZFS pool under Ubuntu, which has been through many upgrades. After upgrade from Ubuntu 20 to 22, the encrypted filesystems refuse to mount, though the rest seem OK. zpool ...
- 161
0
votes
0
answers
35
views
Enlarged my TrueNAS boot pool instead of mirroring. How can I fix it?
In Problems trying to replace disk in truenas mirrored boot, I was trying to fix a failed drive on my mirrored TrueNAS boot pool. I flailed around and eventually got it booted with just one drive of ...
- 153
0
votes
1
answer
45
views
Problems trying to replace disk in truenas mirrored boot
I have a TrueNAS box (TrueNAS-13.0-U5.3) and my boot pool is mirrored 32GB flash drives. One of the drives, da2, is getting errors, so I want to replace it.
I already have a new drive plugged in, da1, ...
- 153
1
vote
1
answer
75
views
proxmox image import creates an 50GB disk regardless of image size
If I import a disk image for vm 101 from a raw image, it will create an 50GB disk image:
# qm importdisk 101 disk.img local-zfs
importing disk '446-jenkinsmite.img' to VM 101 ...
transferred 0.0 B of ...
- 599
0
votes
1
answer
54
views
Scheduling SMART, scrub, resilvering considerations, conflicting?
I have set up regular scrub on my ZFS pools and am beginning to look at setting up smart check every now and then, but I have a distinct memory of an entry I am unable to find that one should not ...
0
votes
0
answers
74
views
How can I make Solaris' Fault Manager forget about an improperly removed ZFS pool?
On a Solaris 11.4 system I had a ZFS pool occupying three drives. While the system was powered off, these three drives were physically removed, but neither zpool export nor zpool destroy had been ...
- 1,598
0
votes
1
answer
68
views
TrueNas Encryption method changed - Is the data safe?
just a quick question of understanding. I have a TrueNas Scale server and I just changed the Encryption method from key to passphrase. Now I wonder if I need to rewrite the whole dataset for this to ...
- 45
0
votes
1
answer
85
views
ZFS import pool by ID as name already exists
My original system won't boot (startup). There are many errors which I am not able to solve.
I have installed ubuntu on a new device and can see the old pools from the old disk.
I cannot import the ...
0
votes
1
answer
152
views
How can I speed up a zfs resilver on a 24x 16TB drive draid2 array: "117T total... 47 days 02:31:23 to go"
(My apologies for the multiple edits to clarify formatting)
As above. The drives show no SMART errors.
Is there a way to check for HBA <--> drive communication errors?
This is running under ...
- 29
2
votes
1
answer
303
views
What ZFS pool, vdev and dataset properties should most people use?
ZFS has many different configurable properties for pools, for vdevs and for datasets. Many of those can be changed at any point, but some can only be set at creation time (or only affect data written ...
- 864
9
votes
1
answer
567
views
Understanding ZFS NVMe benchmarks with FIO
I'm trying to benchmark an all-NVMe ZFS disk array. I'm familiar with extremely fast benchmark results, with very little disk activity due to efficient ZFS caching. I ran into the reverse: massive ...
- 167
0
votes
1
answer
38
views
Home directory, user database and key-based authentication
I want to share it NFS share with my users just like the home-directories (traditional way), but I don't want to create the users instead I want to get the server integrated with the github or google ...
- 13
2
votes
1
answer
226
views
Why doesn't ZFS vdev removal work when any raidz devices are in the pool?
First: I'm perfectly okay with accepting that this is the case for now and am not looking for an immediate solution, rather I'm trying to understand the technical limitation for this constraint.
I'm ...
- 864
3
votes
1
answer
99
views
Why does my SLOG slow down sequential sync writes?
I jury-rigged a TrueNAS server to run a few tests in preparation for a proper NAS build. I got hold of an older Xeon server with 256GB RAM and a 10GbE NIC, equipped it with 6 sata disks configured as ...
- 153
3
votes
2
answers
94
views
ZFS mismatched replication level
I have a RAIDZ1 running 6x 3TB drives, and I want to expand my pool by adding 5x 2TB drives to it. But when I tell it to add to the pool I get this:
$ zpool add zpool1 raidz1 /dev/sda /dev/sdb /dev/...
- 83
1
vote
0
answers
84
views
ZFS permission error 'cannot set property' when receiving snapshot from remote machine despite delegated permission
Context
I'm setting up ZFS autobackup on my home server for offsite backups. All commands printed below are run as non-root.
Problem
A 'permission denied' error arises originating from the target ...
- 11
5
votes
1
answer
165
views
How to use targetcli to disable iSCSI write cache
I have exported a single disk as an iSCSI target using targetcli on a Linux host. On a remote machine I have connected to the device, and placed a ZFS volume on it (as a replication target with zrepl)...
- 1,095
0
votes
0
answers
182
views
Samba Windows ACL not working
I want to configure Samba to manage Windows ACL and manage them from Windows via the security tab.
The Samba server is standalone and not part of an AD tree; i already followed various offical and ...
- 101
1
vote
0
answers
84
views
Does the default zabbix SNMP trueNAS template catch disk failures?
I understand this might be a very basic question, but I would like to know the answer to this question before accidentally losing all the data on the NAS due to multiple drive failures with the first ...
- 139
0
votes
1
answer
40
views
Can I mirror a 2-disk striped zpool to a single large drive?
Currently I have a 4TB pool with two striped drives:
# zpool status
pool: lxd
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some ...
- 65
0
votes
0
answers
33
views
How to change keyformat of existing encrypted dataset
I had an unencrytped dataset that for which I used zfs send / receive to create an encrypted dataset with the data. The destination encrypted dataset used key-based creds. I would like to change this ...
- 101
1
vote
0
answers
33
views
zfs send to NAS with PIGZ compression slowness
The following command that I use to backup used to take 5 minutes to complete and since last week it is taking around 25 minutes. This is after restarting a switch stack the server is connected to. ...
- 11
0
votes
1
answer
140
views
ZFS I/O Error, Kernel Panic during import
I'm running a raidz1-0 (RAID5) setup with 4 data 2TB SSDs.
During midnight, somehow 2 of my data disks experience some I/O error (from /var/log/messages).
When I investigated in the morning, the zpool ...
2
votes
1
answer
79
views
zfs performance: split controller across mirrors vs splitting a mirror across controllers?
Suppose I have
4 disks split into 2 zfs mirrored pairs
2 sata controllers, where each can take 2 disks
Obviously, better expected uptime will be achieved by splitting each controller across both ...
- 123
1
vote
1
answer
131
views
ZFS: restore pool with detached drive
I have a Debian system installed on zfspool of 4 HDDs (like raid10 - raid0 of two raid1). And was displayed like set of 2 mirrors mirror0 and mirror1 each with 2 HDDs.
One of the disks became Faulted.
...
- 13
0
votes
1
answer
72
views
How does zfs know which snapshots to send with the `-I` flag?
From the manual:
A group of incremental snapshots can be combined into one snapshot by
using the zfs send -I option. For example:
# zfs send -I pool/fs@snapA pool/fs@snapD > /snaps/fs@all-I
How ...
- 101
0
votes
0
answers
21
views
Can I make running `zfs receive` without "-s" to save receive_resume_token by signal?
I am running a zfs send/receive. However I forget to set zfs receive -s.
Is this possible to inform a running zfs receive to save receive_resume_token by a signal sends from kill -s ?
Or is there ...
- 105
0
votes
0
answers
92
views
Rclone to a SFTP endpoint in a local network with a bunch of disks - suggested disks setup?
I have a need to copy a complex dataset (around 4 PB total, hundreds of millions of files) via Rclone copy, for some customers (each of them own around 100TB out of the 6PB) - to a bunch of disks via ...
- 65
4
votes
1
answer
398
views
How do I troubleshoot a zfs dataset that the server when the server can't agree if it's mounted or not?
I have a ZFS dataset that exists in /proc/mounts and in /etc/mtab, but the folder doesn't exist in the filesystem, zfs umount reports the dataset doesn't exist, and zfs mount reports that the dataset ...
- 151
0
votes
0
answers
75
views
Why isn't my zpool listed for export when plugged into new host?
I have a zpool called 'temp' with some data I'm trying to move between systems. I used zpool export temp to export the zpool, then I unplugged the disks, and installed them in my new computer. But now ...
- 333
0
votes
1
answer
74
views
Samba and ZFS resulting in NT_STATUS_BAD_NETWORK_NAME
I am currently trying to share my ZFS dataset using SMB. Unfortunately I receive the error NT_STATUS_BAD_NETWORK_NAME every time I try to connect to the share. The error does not make much sense to me ...
- 1
3
votes
1
answer
64
views
Pooled storage with varying redundancy per file system
I have some files that I want stored mirrored. I have some files that I only need single copies (i.e. scratch data, easily regenerated data, etc). And I have some files that are so critical, I want it ...
- 214
1
vote
1
answer
357
views
ZFS on Hetzner Rescue fails with `checking whether inode_owner_or_capable() takes user_ns... configure: error:`
Normally, when booting into the Hetzner rescue system, using the 'zfs' command will automatically install zfs tooling inside the rescue system.
This is currently not working;
checking whether ...
- 289
1
vote
0
answers
44
views
ZFS issues with reboot
After a reboot on Debian 11, I experienced 4 drives that just disappeared for no apparent reason. 2 are 'faulted' and 2 says they are unavailable.
Question: How do I identify the disks with the ...
- 11
1
vote
1
answer
126
views
How to explain that ZFS' snapshot reports 'WRITTEN' as 4.26GB, but the transfer size is actually 31.4GB?
When I run this query on a dataset
zfs list -d 1 -t all -o name,used,refer,written,compressratio sfg-backup/mx
I see the following stats:
zfs list -d 1 -t all -o name,used,refer,written,compressratio ...
- 327
2
votes
1
answer
349
views
Extremely slow MySQL writes in Ubuntu (ext4) guest on Promox 7.3-3 (ZFS) host
I'm trying out Proxmox 7.3-3 as a hypervisor and managed to install it using ZFS on my NVMe (Samsung_SSD_970_EVO_Plus_2TB_S6S2NS0T505403V)
I also installed a Ubuntu 22.04 VM and its filesystem is ext4
...
- 155
0
votes
1
answer
212
views
Uninstall ZFS installed via Ubuntu 20.04 installer
Apologies if this has been answered somewhere, I've searched everywhere and couldn't find anything.
I'm a PhD student and I manage a small cluster for our group. When installing Ubuntu 20.04 on our ...
1
vote
1
answer
286
views
Forcefully forget / unmount ZFS pool after drives disconnected
First off, I made a mistake & I acknowledge that, but now I'm stuck with a "broken" ZFS driver and want to restore it without rebooting my machine.
How I can say ZFS on Linux to just ...
- 103
2
votes
1
answer
268
views
ZFS Pool of USB Drives causes zsf-import-cache.service to fail on boot [closed]
I setup a ZFS pool on my "home server" (Raspberry Pi 4b) that consists of various HDD and SSD drives connected over USB to the Pi. I have noticed that whenever a reboot occurs, the ZFS pool ...
- 131
0
votes
0
answers
579
views
Bindmount External Drive In Proxmox for Nextcloud
I have a Proxmox LXC container with Nextcloud. The default data directory in Nextcloud requires the owner to be www-data with the default uid and gid of 33. I am using the following
Proxmox
Mount ...
0
votes
0
answers
268
views
Proxmox ZFS encryption issue
Used Proxmox 7.3 on a Hetzner baremetal server. Configured ZFS Encryption using following steps:
zpool import -f rpool
zfs snapshot -r rpool/ROOT@copy
zfs send -R rpool/ROOT@copy | zfs receive rpool/...
- 101
1
vote
1
answer
412
views
Connecting from windows to debian Samba share
I have a proxmox installation with a few ZFS shares.
The shares are created using
zfs create storage/photos
sudo zfs set acltype=posixacl storage/photos
The user is created using
sudo adduser --...
- 376
0
votes
1
answer
457
views
Cloud-init installing packages on Debian with contrib sources
I need to install some zfs packages on Debian instances using cloud-init. One of the packages needs the contrib sources. I can get it to update the sources list, but the packages fail to install. If ...
- 23
1
vote
2
answers
286
views
Will disk compression impact the performance of a MySQL database?
I've recently setup a TrueNAS storage server and hosted on it is a MySQL database. It's about 3GB; I'm not too concerned with how much space it's utilising.
By default, TrueNAS enables LZ4 compression ...
- 113
2
votes
2
answers
2k
views
Possible to start a RAID1 setup with a single drive?
Can I start a ZFS pool with a RAID1 setup using a single drive, and then add another one later?
Running Proxmox VE 7.2
- 33
0
votes
0
answers
29
views
ZFS Not Recovering Space
I've certainly made a few rookie mistakes when setting up my first ZFS from a 4 drive array (14tb platters), mainly forgetting to change the block size from default. However I am missing space in my ...
- 101