到目前为止,我的搜索没有提出任何有用的.
谢谢你的帮助
Ubuntu(nfs客户端)上/ proc / self / mountstats的示例输出:
... device IPADRESS:/mountpoint mounted on /mnt/mountpoint with fstype nfs4 statvers=1.0 opts: rw,vers=4,rsize=1048576,wsize=1048576,acregmin=3,acregmax=60,acdirmin=30,acdirmax=60,hard,nointr,proto=tcp,timeo=600,retrans=2,sec=sys age: 77663 caps: caps=0x1e,wtmult=512,dtsize=4096,bsize=0,namelen=255 nfsv4: bm0=0xfdffbfff,bm1=0xf9be3e,acl=0x3 sec: flavor=1,pseudoflavor=1 events: 1462723 25756220 1025148 1164028 1083099 2027020 31347107 1984730 279773 1915700 1346583 21077199 520498 31825 525298 39026 2180470 1083041 0 16822 990144 11011 0 0 0 bytes: 46686144592 3990939437 0 0 30238687174 3759616491 7739053 1346583 RPC iostats version: 1.0 p/v: 100003/4 (nfs) xprt: tcp 852 1 2 0 0 11822378 11822377 0 17669710 13357205 per-op statistics NULL: 0 0 0 0 0 0 0 0 READ: 1950114 1950114 0 330348288 30355844804 105050 6678050 6907640 WRITE: 911822 911822 0 3932410080 215189360 10653830 1472320 12211620 COMMIT: 389509 389509 0 65718096 88808052 8060 253550 284360 OPEN: 1168845 1168845 0 292577612 554554444 430040 628900 1229990 OPEN_CONFIRM: 43 43 0 7048 2924 0 10 10 OPEN_NOATTR: 0 0 0 0 0 0 0 0 OPEN_DOWNGRADE: 54 54 0 9952 12744 90 0 120 CLOSE: 1081161 1081161 0 191495392 255153996 201030 404620 767870 SETATTR: 43303 43303 0 8753024 10046296 1060 25650 30380 FSINFO: 2 2 0 268 184 0 0 0 RENEW: 0 0 0 0 0 0 0 0 SETCLIENTID: 0 0 0 0 0 0 0 0 SETCLIENTID_CONFIRM: 0 0 0 0 0 0 0 0 LOCK: 1140050 1140050 0 246277244 77523400 76270 326950 469890 LOCKT: 1 1 0 188 52 0 0 0 LOCKU: 1037895 1037895 0 187916912 70576860 18130 357530 441480 ACCESS: 450451 450451 0 72511716 102702828 21440 222460 280950 GETATTR: 1462724 1462724 0 224029496 310097488 21290 390910 485350 LOOKUP: 2043380 2043380 0 361899452 532433688 18200 499200 585170 LOOKUP_ROOT: 1 1 0 116 232 0 0 0 REMOVE: 32356 32356 0 5953448 7765440 600 15450 18560 RENAME: 20388 20388 0 5593088 9215376 510 7740 9750 LINK: 537 537 0 132024 231984 0 220 270 SYMLINK: 0 0 0 0 0 0 0 0 CREATE: 999 999 0 227376 293140 30 650 830 PATHCONF: 1 1 0 140 72 0 0 0 STATFS: 2872 2872 0 419360 333152 580 3980 4880 READLINK: 0 0 0 0 0 0 0 0 READDIR: 82718 82718 0 14625720 118955760 770 48470 53310 SERVER_CAPS: 3 3 0 400 264 0 0 0 DELEGRETURN: 0 0 0 0 0 0 0 0 GETACL: 0 0 0 0 0 0 0 0 SETACL: 0 0 0 0 0 0 0 0 FS_LOCATIONS: 0 0 0 0 0 0 0 0 ...
解决方法
Format of NFS mountstat
Linux内核版本:2.6.32-358.el6.x86_64
- linux/fs/nfs/super.c: nfs_show_stats - linux/include/linux/nfs_iostat.h: nfs_stat_eventcounters - linux/net/sunrpc/stats.c: rpc_print_iostats - linux/net/sunrpc/xprtsock.c: xs_tcp_print_stats
服务器功能(上限)
>上限:服务器功能
> wtmult:服务器磁盘块大小
> dtsize:readdir大小
> bsize:服务器块大小
>纳伦:
nfsv4(nfs_show_stats)
> bm0:attribute_bitmask [0],支持哪些属性
> bm1:attribute_bitmask [1],支持哪些属性
> acl:acl_bitmask,支持哪些acl属性
sec,此安装有效的安全风格(nfs_show_stats)
> flavor:auth-> au_ops-> au_flavor
> pseudoflavor:auth-> au_flavor
事件(linux / nfs_iostat.h:nfs_stat_eventcounters)
> inoderevalidate
> dentryrevalidate
> datainvalidate
> attrinvalidate
> vfsopen
> vfslookup
> vfsaccess
> vfsupdatepage
> vfsreadpage
> vfsreadpages
> vfswritepage
> vfswritepages
> vfsgetdents
> vfssetattr
> vfsflush
> vfsfsync
> vfslock
> vfsrelease
>拥挤等
> setattrtrunc
> extendwrite
> sillyrename
>短读
>写作
>延迟
> pnfs_read
> pnfs_write
字节数(linux / nfs_iostat.h:nfs_stat_bytecounters)
> normalreadbytes
> normalwritebytes
> directreadbytes
> directwritebytes
> serverreadbytes
> serverwritebytes(serverwrittenbytes)
> readpages
>写作
xprt(tcp)
> linux / net / sunrpc / xprtsock.c:xs_tcp_print_stats
> linux / include / linux / sunrpc / xprt.h:struct rpc_xprt
> srcport:短暂的端口
> bind_count:rpcbind操作有多少
> connect_count:TCP连接的数量
> connect_time:连接多长时间
> idle_time:传输空闲多长时间
> rpcsends:多少套接字发送
> rpcrecvs:接收多少个套接字
> badxids:已收到多少个无法匹配的XID
> req_u:线路上的平均请求(槽表利用率)
> bklog_u:积压队列利用率(baklog队列的平均长度)
> max_slots:使用max rpc_slots
> sending_u:发送q利用率
> pending_u:pend q利用率
每个RPC操作类型显示(rpc_print_iostats)
统计记录:rpc_exit_task —> xprt_release —> rpc_count_iostats
这里解释了所有NFS协议:http://www.freesoft.org/CIE/Topics/115.htm
> op类型的名称
> ops已请求此类型的操作数
> trans:已发送此op类型的传输次数
>超时:此op类型发生了多少次超时
> bytes_sent:已为此op类型发送了多少字节
> bytes_recv:此op类型已接收到多少字节
> queue:此类型的ops在进入队列之前等待了多长时间
传输(微秒)
> rtt:客户等待接收此操作的回复多长时间
从服务器输入(微秒)
> execute:执行此类型的操作多长时间(来自
rpc_init_task到rpc_exit_task)(微秒)
rpc_run_task —> rpc_new_task —> rpc_init_task
使用ns收集最后三次统计信息,但它们将被转换
打印出来时的ms.
执行时间应接近(队列rtt).
注意,在Linux源代码中,字段的名称以前缀为前缀
例如,“om_”,第一个字段是“om_ops”而不是“ops”.
NFSv4.0示例
device 130.245.177.235:/nfsdata/ mounted on /mnt with fstype nfs4 statvers=1.1 opts: rw,namlen=255,port=0,sec=sys,clientaddr=130.245.177.234,minorversion=0,local_lock=none age: 19 (time,in seconds,since the NFS is mounted) caps: caps=0xfff7,dtsize=32768,namlen=255 nfsv4: bm0=0xfdffafff,acl=0x0 sec: flavor=1,pseudoflavor=1 events: 0 168232 0 0 0 10095 217808 0 2 9797 0 9739 0 0 19739 19739 0 19739 0 0 0 0 0 0 0 0 0 bytes: 1612840960 0 0 0 627536112 0 158076 0 RPC iostats version: 1.0 p/v: 100003/4 (nfs) xprt: tcp 737 0 1 0 0 69698 69697 0 81817 0 2 1082 12119 per-op statistics NULL: 0 0 0 0 0 0 0 0 READ: 9797 9797 0 1567520 628138612 71 7953 8200 WRITE: 0 0 0 0 0 0 0 0 COMMIT: 0 0 0 0 0 0 0 0 OPEN: 19740 19740 0 4737600 7343280 505 3449 4172 OPEN_CONFIRM: 10211 10211 0 1552072 694348 74 836 1008 OPEN_NOATTR: 0 0 0 0 0 0 0 0 OPEN_DOWNGRADE: 0 0 0 0 0 0 0 0 CLOSE: 19739 19739 0 3316152 2605548 334 3045 3620 SETATTR: 0 0 0 0 0 0 0 0 FSINFO: 1 1 0 132 108 0 0 0 RENEW: 0 0 0 0 0 0 0 0 SETCLIENTID: 0 0 0 0 0 0 0 0 SETCLIENTID_CONFIRM: 0 0 0 0 0 0 0 0 LOCK: 0 0 0 0 0 0 0 0 LOCKT: 0 0 0 0 0 0 0 0 LOCKU: 0 0 0 0 0 0 0 0 ACCESS: 96 96 0 14584 19584 0 8 10 GETATTR: 1 1 0 132 188 0 0 0 LOOKUP: 10095 10095 0 1655576 2382420 36 898 1072 LOOKUP_ROOT: 0 0 0 0 0 0 0 0 REMOVE: 0 0 0 0 0 0 0 0 RENAME: 0 0 0 0 0 0 0 0 LINK: 0 0 0 0 0 0 0 0 SYMLINK: 0 0 0 0 0 0 0 0 CREATE: 0 0 0 0 0 0 0 0 PATHCONF: 1 1 0 128 72 0 0 0 STATFS: 0 0 0 0 0 0 0 0 READLINK: 0 0 0 0 0 0 0 0 READDIR: 0 0 0 0 0 0 0 0 SERVER_CAPS: 2 2 0 256 176 0 0 0 DELEGRETURN: 0 0 0 0 0 0 0 0 GETACL: 0 0 0 0 0 0 0 0 SETACL: 0 0 0 0 0 0 0 0 FS_LOCATIONS: 0 0 0 0 0 0 0 0 RELEASE_LOCKOWNER: 0 0 0 0 0 0 0 0 SECINFO: 0 0 0 0 0 0 0 0 EXCHANGE_ID: 0 0 0 0 0 0 0 0 CREATE_SESSION: 0 0 0 0 0 0 0 0 DESTROY_SESSION: 0 0 0 0 0 0 0 0 SEQUENCE: 0 0 0 0 0 0 0 0 GET_LEASE_TIME: 0 0 0 0 0 0 0 0 RECLAIM_COMPLETE: 0 0 0 0 0 0 0 0 LAYOUTGET: 0 0 0 0 0 0 0 0 GETDEVICEINFO: 0 0 0 0 0 0 0 0 LAYOUTCOMMIT: 0 0 0 0 0 0 0 0 LAYOUTRETURN: 0 0 0 0 0 0 0 0 NFSv4.1 EXAMPLE =============== device 130.245.177.235:/nfsdata mounted on /mnt with fstype nfs4 statvers=1.1 opts: rw,vers=4.1,local_lock=none age: 44 impl_id: name='',domain='',date='0,0' caps: caps=0x3ffff,namlen=255 nfsv4: bm0=0xfdffbfff,bm2=0x800,acl=0x3,sessions,pnfs=not configured sec: flavor=1,pseudoflavor=1 events: 67379 1692812 0 30749 0 980 1984612 0 0 0 0 0 0 0 96611 96611 0 96611 0 0 0 0 0 0 0 0 0 bytes: 0 0 0 0 0 0 0 0 RPC iostats version: 1.0 p/v: 100003/4 (nfs) xprt: tcp 674 0 1 0 0 279772 279771 0 649944 0 5 1711 90409 per-op statistics NULL: 0 0 0 0 0 0 0 0 READ: 0 0 0 0 0 0 0 0 WRITE: 0 0 0 0 0 0 0 0 COMMIT: 0 0 0 0 0 0 0 0 OPEN: 96612 96612 0 27824256 34007424 13349 16253 32061 OPEN_CONFIRM: 0 0 0 0 0 0 0 0 OPEN_NOATTR: 0 0 0 0 0 0 0 0 OPEN_DOWNGRADE: 0 0 0 0 0 0 0 0 CLOSE: 96610 96610 0 19708440 17003360 2936 11082 15386 SETATTR: 0 0 0 0 0 0 0 0 FSINFO: 1 1 0 168 152 0 0 0 RENEW: 0 0 0 0 0 0 0 0 SETCLIENTID: 0 0 0 0 0 0 0 0 SETCLIENTID_CONFIRM: 0 0 0 0 0 0 0 0 LOCK: 0 0 0 0 0 0 0 0 LOCKT: 0 0 0 0 0 0 0 0 LOCKU: 0 0 0 0 0 0 0 0 ACCESS: 16932 16932 0 3183200 2844576 83 1919 2308 GETATTR: 67380 67380 0 12128380 15632160 336 8367 10644 LOOKUP: 1236 1236 0 247176 167784 7 153 197 LOOKUP_ROOT: 0 0 0 0 0 0 0 0 REMOVE: 0 0 0 0 0 0 0 0 RENAME: 0 0 0 0 0 0 0 0 LINK: 0 0 0 0 0 0 0 0 SYMLINK: 0 0 0 0 0 0 0 0 CREATE: 980 980 0 219516 305760 5 168 197 PATHCONF: 1 1 0 164 116 0 0 0 STATFS: 0 0 0 0 0 0 0 0 READLINK: 0 0 0 0 0 0 0 0 READDIR: 0 0 0 0 0 0 0 0 SERVER_CAPS: 2 2 0 328 280 0 0 0 DELEGRETURN: 0 0 0 0 0 0 0 0 GETACL: 0 0 0 0 0 0 0 0 SETACL: 0 0 0 0 0 0 0 0 FS_LOCATIONS: 0 0 0 0 0 0 0 0 RELEASE_LOCKOWNER: 0 0 0 0 0 0 0 0 SECINFO: 0 0 0 0 0 0 0 0 EXCHANGE_ID: 0 0 0 0 0 0 0 0 CREATE_SESSION: 0 0 0 0 0 0 0 0 DESTROY_SESSION: 0 0 0 0 0 0 0 0 SEQUENCE: 0 0 0 0 0 0 0 0 GET_LEASE_TIME: 0 0 0 0 0 0 0 0 RECLAIM_COMPLETE: 0 0 0 0 0 0 0 0 LAYOUTGET: 0 0 0 0 0 0 0 0 GETDEVICEINFO: 0 0 0 0 0 0 0 0 LAYOUTCOMMIT: 0 0 0 0 0 0 0 0 LAYOUTRETURN: 0 0 0 0 0 0 0 0 SECINFO_NO_NAME: 0 0 0 0 0 0 0 0 TEST_STATEID: 0 0 0 0 0 0 0 0 FREE_STATEID: 0 0 0 0 0 0 0 0 GETDEVICELIST: 0 0 0 0 0 0 0 0 BIND_CONN_TO_SESSION: 0 0 0 0 0 0 0 0 DESTROY_CLIENTID: 0 0 0 0 0 0 0 0 # vim: tabstop=2:shiftwidth=2:expandtab:foldmethod=indent
另外https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/include/linux/nfs_iostat.h和https://utcc.utoronto.ca/~cks/space/blog/linux/NFSMountstatsIndex进行额外阅读.