I would like to ask for your experience on clustering systems. I've got 2 identical servers with both 44TB (24x2TB RAID5 on a Qlogic fiber card) and am looking for a possible clustering solution. The raid will most likely contain large files (re-encoded movies, dvd images, etc.) (yes these are legal). I want to keep both machines in sync at all times, and want our customers to be able to download files from both servers (we use loadbalancing to spread the downloads). We will upload new movies to only 1 servers and should be replicated over the cluster automatically (or when it's requested). I've only been testing a little bit with GlusterFS, which looked oke, but haven't really stress tested it (yet). Though i'm wondering if clustering is suitable for these large files. (Ofcourse they will are connected with a gbit eth card and if needed i can aggregate them) Any of you have experiences with other clustering systems? Or is GFS the way to go? p.s. I'd like to start with a 44tb cluster and as it grows add more filers to expand the cluster.
So far I've only tested GlusterFS, and it looked ok, but I've not yet used it on production systems. Another option might be to use rsync.
Well yes, rsync is an option, but that would mean i've to run it more then once to keep both servers up to date .. and i want to be prepared for the future in which i see more filers being added to the cluster. Next to that HA is nice to have, i want at least 1 other copy of a file in the cluster (just like raid1 has) ..
