Unix and Linux Stack Exchange
Unix and Linux Stack Exchange

Questions tagged [ceph]

For Ceph, the open-source, distributed storage system, mounted as CephFS using FUSE or NFSv4.

Ceph is a massively scalable, open-source, distributed storage system that runs on commodity hardware and provides object, block and file-system storage.

CephFS, Ceph File System, can be mounted as Linux FUSE, or via NFSv4.

50 questions
4
votes
3 answers

How to delete a invalid osd in ceph cluster?

[root@dev-master ceph-cluster]# ceph osd tree ID WEIGHT TYPE NAME UP/DOWN REWEIGHT PRIMARY-AFFINITY -1 0.01740 root default -4 0.00580 host osd2 0 0.00580 osd.0 down 0 1.00000 -5 0.00580 host osd3 1 0.00580 …
Inuyasha
  • 41
  • 2
4
votes
3 answers

Can I enable cephx authentication using a pool in qemu/kvm?

(CentOS 7, Ceph Incunabulus, everything patched up to date) Background I've got a working converged Ceph/qemu/kvm cluster with cephx enabled for authentication. I'm trying to use this to store block devices for qemu/kvm virtual machines - not an…
Peter Crowther
  • 41
  • 6
3
votes
1 answer

ssh won't connect with RSA key pairs iff /home directory is ceph-mounted

I've got the problem that on a server I maintain, after switching to a Ceph filesystem for the homedirectories, suddenly ssh login through RSA keys stopped working. I've tried checking several things but none of the solutions I found on the internet…
Joeytje50
  • 165
  • 6
3
votes
1 answer

Ceph - Prepare Shared SSD For Journaling

The Ceph documentation for adding drives shows the use of the prepare statement twice, with the same drive for the journal as shown below (where /dev/ssd is the journal drive): Once the prepare statement has been executed once for preparing…
Programster
  • 2,157
  • 9
  • 23
  • 35
2
votes
2 answers

ceph luminous osd memory usage

I am trying to build small CEPH cluster on single box - testing in the lab, before switching bigger probject to it. Run into memory problems and can not find way to control it. We have old Core2Duo CPU, 4gb ram. Creating 3 OSDs with 3 local 8tb…
Anton Aleksandrov
  • 23
  • 1
  • 4
2
votes
1 answer

Comparison of Ceph vs btrfs for single node storage

Single Node Ceph: Your Next Home Storage Solution makes case for using Ceph over ZFS on a single node. This got me wondering about Ceph vs btrfs: What are the advantages / disadvantages of using Ceph with bluestore compared to btrfs in terms of…
Tom Hale
  • 28,728
  • 32
  • 139
  • 229
2
votes
1 answer

Using ceph storage directly for docker volumes

Does Docker or Kubernetes support Ceph storage interfaces (objects, red, cephfs)?
Ijaz Ahmad
  • 7,146
  • 5
  • 32
  • 45
2
votes
1 answer

Problems with overall ceph performance with QEMU

I am experiencing some performance problems with my QEMU KVMs on my ceph cluster. The cluster has 4 nodes with 4x1TB drives each, 48/64GB RAM, Intel Xeon and AMD Opterons. They are interconnected by 3x1 GBit Interfaces configured as one bonding…
devnull
  • 227
  • 2
  • 13
2
votes
0 answers

Remove orphaned rados block device

I'm testing ceph at the moment. Today I decided to start over with my cluster and deleted the old one to setup a new one. I forgot to unmap and delete a mapped rbd device from another host. Now I see the following errors in the log and I can't unmap…
devnull
  • 227
  • 2
  • 13
1
vote
1 answer

is it possible to run a ceph rbd on erasure coded ceph pool, without a separate replicated metadata pool?

I'm new to ceph so forgive me if this is common knowledge, but I can't find it. This seems like a simple question, but I can't find any solid answer. In 2017 when rbd on ec pools was first implemented, you had to have a separate replicated pool to…
stu
  • 143
  • 1
  • 7
1
vote
1 answer

Can't remove ceph xattrs on linux

I had set xattrs for quota limits on CephFS $ setfattr -n ceph.quota.max_bytes -v 1100000000 /mnt/cephfs/data/ I can get value of this attribute $ getfattr -n ceph.quota.max_bytes /mnt/cephfs/data/ getfattr: Removing leading '/' from absolute path…
Dan B
  • 11
  • 1
1
vote
1 answer

CEPH can't find OSD's

I installed ceph cluster using cephadm and bootstrapping. I can view disks via inventory, but they do not show in the device list. Why is this the case? How can I add a disk to the cluster? root@RX570:~# ceph-volume inventory Device Path …
Trevor K Smith
  • 71
  • 2
1
vote
2 answers

How do I create a raw (no filesystem) loopback device that passes as a legitimate blockdevice?

The question How do I create and mount a fake block device (using a large file/disk image) that passes as a legitimate unformatted disk? Backstory I am trying to set up rook with ceph (a distributed storage system) in my hobby kubernetes cluster.…
Hannes Knutsson
  • 33
  • 4
1
vote
1 answer

Creating cephfs volume in a test environment is very slow

I've installed Ceph into a single VM for testing purposes (I'm not testing ceph, per se, but I need a ceph endpoint for the tools I'll be running). The install was easy enough, but the cephfs filesystem I've tried to create (ceph fs volume create…
larsks
  • 32,449
  • 5
  • 54
  • 70
1
vote
0 answers

Open-iSCSI Target IQN Naming Case

I'm using LRBD to configure iSCSI targets from a Ceph cluster, LRBD uses Open-iSCSI/targetcli to configure the targets. When I use an uppercase letter in the unique part of the iqn (after the colon), I get the following error message: Invalid iqn…
rusty shackleford
  • 2,365
  • 9
  • 21
1
2 3 4