[lug] Cluster File Systems

[Lee Woodworth]

On 08/02/2018 05:33 PM, Davide Del Vento wrote:
> I'd suggest you take a look at http://lustre.org/
> I don't know how it is from an administrative perspective, but it certainly
> can do what you ask. It might be overkill, but that's your call.

Thanks for the suggestion. It appears to require kernel patches and using
RHEL for the server (Lustre Support Matrix only has RHEL for the server).

   http://lustre.org/getting-started-with-lustre/:
     Metadata and Object Storage Server require the Lustre patched Linux kernel,
     Lustre modules, Lustre utilities and e2fsprogs installed. The clients
     require the Lustre client modules, client utilities and, optionally,
     the Lustre patched kernel.

> 
> On Thu, Aug 2, 2018 at 5:01 PM, Lee Woodworth <blug-mail at duboulder.com>
> wrote:
> 
>> Can anyone recommend an open-source cluster file system
>> that can handle doing lots of reads/writes to a remote
>> file, especially >10GB files? Would like to have a
>> mix of host architectures and not have to setup a full
>> cluster + management.
>>
>> A few years ago I used glusterfs with the native fs driver
>> in the kernel. I would get hard kernel-level lockups
>> in the above scenario (client reboot was the only way
>> to recover).
>>
>> Even nfsv4 servers locked up, though I haven't tried doing
>> that in awhile.
>>
>>
>> _______________________________________________
>> Web Page:  http://lug.boulder.co.us
>> Mailing List: http://lists.lug.boulder.co.us/mailman/listinfo/lug
>> Join us on IRC: irc.hackingsociety.org port=6667 channel=#hackingsociety
> 
> 
> 
> _______________________________________________
> Web Page:  http://lug.boulder.co.us
> Mailing List: http://lists.lug.boulder.co.us/mailman/listinfo/lug
> Join us on IRC: irc.hackingsociety.org port=6667 channel=#hackingsociety
>