Unix and Linux Stack Exchange
Unix and Linux Stack Exchange

Questions tagged [distributed-filesystem]

24 questions
13
votes
3 answers

Small Distributed Computing Cluster

I'm a high school student trying to build a linux cluster for a project (I have a bunch of decent computers slated for re-image this summer, so the tech department basically says as long as I don't physically break them I can do whatever. Anyway, I…
user6026
9
votes
3 answers

What are you using instead of DCE Distributed File System?

What are you using instead of DCE Distributed File System? How does it compare? Or are you still using it? Note that DCE/DFS is not Microsoft Distributed File System
CW Holeman II
  • 3,654
  • 5
  • 31
  • 49
7
votes
2 answers

Parallel vs Distributed vs Traditional File system

I am trying to understand the differences between these three file system at a very basic level. Distributed FS: HDFS Parallel FS : Lustre Traditional FS : ext4/ext3/ NTFS/FAT etc. I want to know what are the basic conceptual differences…
puneet336
  • 188
  • 1
  • 7
5
votes
2 answers

raid 1/LVM at the level of directories (aka mknodding a directory)

I just experienced data loss, so I am interested in some form of data duplication. I was thinking of mdadm and companions to raid 1 through software. However, I just want a given, not too big directory to be covered. I have no real experience with…
user495100
  • 113
  • 5
5
votes
2 answers

Recommendations for replacing a GFS cluster?

I have a couple of CentOS GFS-clusters (GFS as in Global File System) using a shared disk in a Fibre Channel SAN. They are mature now, and the time has come to start planning for their replacement. They are an odd number of nodes (3 or 5) with…
MattBianco
  • 3,676
  • 6
  • 27
  • 43
3
votes
2 answers

Peer to peer~ish LAN storage

I have a distributed application that consists in a main CMS server where "human" users can upload videos, pictures (media content, basically) and a bunch of "players" that play those videos or pictures at certain times. Right now, each and every…
Savir
  • 1,221
  • 1
  • 17
  • 24
3
votes
0 answers

Is it crazy to consider keeping my home directory on OpenAFS?

I am a sysadmin by trade, and I do what I do at work at home as well for fun. I have a Gentoo Linux laptop, Raspberry Pis running Raspian, a Gentoo server, ARM devices running Debian and have various Android devices. I'm always wrestling and…
Jesse Adelman
  • 246
  • 2
  • 11
3
votes
0 answers

Meta Data Server (MDS) cluster for pnfs

TL;DR pNFS seems a great method for multiple concurrent access to centralised shared storage, but it has a problem: the single NFS server providing NFS metadata (meta data server, MDS) is a single point of failure. If the MDS becomes inaccessible…
Bananguin
  • 7,796
  • 2
  • 25
  • 57
3
votes
2 answers

"Junctioned" symbolic links

Does Linux have the capability to use "junctioned" symbolic links? I'm not sure if this is an actual term or not, so let me explain the concept. I have a git repository containing all my configuration dot files in ~/dotfiles. I use symbolic links…
magnus
  • 439
  • 1
  • 4
  • 12
3
votes
2 answers

Virtualbox, mounting guest directory on host computer

Is there a way to mount a directory residing on my VB guest (linux) on my host (linux)? I know I can do it the other way around with the shared folders feature on Virtualbox, but is there a way to do it this way? I'd really like to actually mount…
Falmarri
  • 12,897
  • 17
  • 58
  • 71
2
votes
2 answers

Does Opensolaris offer distributed ZFS filesystems

I haven't had any luck getting a confirmed yes or no to this question. I'd like to run ZFS as a distributed file system (like Gluster or CEPH). OpenZFS and ZFS on Linux does not (yet) have file system clustering. My understanding is distributed is…
BurningKrome
  • 228
  • 4
  • 11
2
votes
1 answer

Unable to mount gfs2 file system on Debian Stretch, probable dlm mis-config?

I am experimenting with gfs2 on Debian Stretch, and having some difficulties. I am a reasonably experienced Linux admin, but new to shared-disk and parallel file systems. My immediate project is to mount a gfs2-formatted iscsi-exported device on…
Andrew Reid
  • 53
  • 7
2
votes
2 answers

ZFS read-only mount on Linux + simultaneous read-write mount on Solaris

We have to regularly copy quite huge files from Solaris to Linux (using network). It currently takes almost half a day for one file. The files in Solaris are on a ZFS filesystem. So I thought what a heck - we could probably mount that ZFS on…
Tagar
  • 243
  • 3
  • 9
2
votes
2 answers

set up NFS two way syncronization

I have two servers that I want to "share" the home folder of, such that when I make changes on Server A they appear on Server B and when I make changes on Server B they appear on Server A. Right now I have NFS set up such that when I make changes on…
Spencer Smolen
  • 31
  • 4
2
votes
1 answer

Validate start-dfs.sh

I am trying to setup a Hadoop cluster, where master is my laptop and slave is the virtualbox, following this guide. So, I did, from master: gsamaras@gsamaras:/home/hadoopuser/hadoop/sbin$ sudo ./start-dfs.sh Starting namenodes on…
gsamaras
  • 191
  • 1
  • 4
  • 12
1
2