SeaweedFS 是简单,高伸缩性的分布式文件系统,包含两部分:存储数十亿的文件;快速为文件服务。SeaweedFS 作为支持全 POSIX 文件系统语义替代,Seaweed-FS 选择仅实现 key-file 的映射,类似 “NoSQL”,也可以说是 “NoFS”。
SeaweedFS 仅花费 40 字节的硬盘来存储每个文件的元数据。
基准测试基于 Mac Book,固态硬盘,CPU:1 Intel Core i7 2.6GHz。
编写 1 百万的 1KB 文件:
Concurrency Level: 16
Time taken for tests: 88.796 seconds
Complete requests: 1048576
Failed requests: 0
Total transferred: 1106764659 bytes
Requests per second: 11808.87 [#/sec]
Transfer rate: 12172.05 [Kbytes/sec]
Connection Times (ms)
min avg max std
Total: 0.2 1.3 44.8 0.9
Percentage of the requests served within a certain time (ms)
50% 1.1 ms
66% 1.3 ms
75% 1.5 ms
80% 1.7 ms
90% 2.1 ms
95% 2.6 ms
98% 3.7 ms
99% 4.6 ms
100% 44.8 ms
自由读取 1 百万文件:
Concurrency Level: 16
Time taken for tests: 34.263 seconds
Complete requests: 1048576
Failed requests: 0
Total transferred: 1106762945 bytes
Requests per second: 30603.34 [#/sec]
Transfer rate: 31544.49 [Kbytes/sec]
Connection Times (ms)
min avg max std
Total: 0.0 0.5 20.7 0.7
Percentage of the requests served within a certain time (ms)
50% 0.4 ms
75% 0.5 ms
95% 0.6 ms
98% 0.8 ms
99% 1.2 ms
100% 20.7 ms
SeaweedFS 1.80版本更新内容如下:
- Filer
- 默认的 leveldb 存储添加自动恢复,报告正确的错误
- Hadoop
- HBase 可以正常工作
- Volume
- 在 Windows 上,支持
-max=0
自动设置最大音量 - 如果低于可配置的可用磁盘空间百分比,则可以将 volume 设置为只读
- 在 Windows 上,支持
- Master
- 删除选项以更改 CLI 选项
-pulseSeconds
- 删除选项以更改 CLI 选项
- WebDAV
- 修复文件大小小于 512 并且由于未安装
/etc/mime.types
而无法通过文件扩展名检测到内容类型时的错误。
- 修复文件大小小于 512 并且由于未安装
更新说明:https://github.com/chrislusf/seaweedfs/releases/tag/1.80