MooseFS
Scalable, fault-tolerant distributed file system for high-performance data storage
About MooseFS
MooseFS is a distributed file system designed for high availability, scalability, and performance. It leverages commodity hardware to provide petabyte-scale storage with redundancy, ensuring data safety and minimal downtime. Ideal for big data, mission-critical applications, and cost-effective storage solutions.
FAQ
Write and read speeds depend on hardware performance, including hard drive performance and network capacity and topology (network latency). Better hardware and network throughput result in higher system performance.
Generally, goal setting does not significantly alter speeds. For reading, a higher goal may help if multiple clients access different copies. For writing, higher goals use a chain-like process to avoid overburdening the client's throughput.
Chunkserver CPU usage is about 15-30% during constant file transfer, and RAM usage is between 100MiB and 1GiB. The master server uses about 50% of a modern CPU and 12GiB RAM, with CPU load depending on operations and RAM on the number of files and folders.
Yes, you can add or remove Chunkservers on the fly. For disks, you must mark them for removal in the mfshdd.cfg file, reload the Chunkserver, wait for replication, and then safely disconnect the disk.
The metadata server keeps the entire file system structure in RAM for performance. This increases memory requirements, but metadata is frequently flushed to files on the master server to ensure durability.
The directory size represents the total length of all files inside, displayed in exponential notation (e.g., 2010616 means 106.16 MiB). This is different from standard Linux ls -l output.
Each Chunkserver adds 256MB per used partition to its disk usage report, and the master sums these values. If disks contain other data, df will count those files too. Use mfsdirinfo for accurate MooseFS space usage.
Yes, you can store source code on MooseFS. Small files occupy more space due to a fixed 64MiB chunk size and 64KiB block size, plus overhead for checksums and headers. This overhead is negligible for most use cases.
Alternatives to consider
Community ratings & full list
Badges
Promote MooseFS giving it more exposure, by adding these badges to your website, documentation, or product listing. Each badge links back to MooseFS page on Webfolio.
<a href="https://www.webfolio.to/tools/moosefs?utm_source=badge&utm_campaign=badge" target="_blank" rel="noopener noreferrer"><img src="https://www.webfolio.to/badges/featured_color.svg" alt="Featured on Webfolio" style="max-width: 150px" /></a>
Categories
Claim this tool
Are you the founder? Claim your profile to update details and track views.