2021-10-29T05:49:00.020168+0700 mgr.server-3s03 (mgr.88486564) 1089105 : cluster [DBG] pgmap v1091724: 297 pgs: 1 active+clean+scrubbing, 2 active+clean+scrubbing+deep, 294 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 22 MiB/s rd, 12 MiB/s wr, 10.10k op/s
2021-10-29T05:49:02.022089+0700 mgr.server-3s03 (mgr.88486564) 1089106 : cluster [DBG] pgmap v1091725: 297 pgs: 2 active+clean+laggy, 1 active+clean+scrubbing, 2 active+clean+scrubbing+deep, 292 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 20 MiB/s rd, 10 MiB/s wr, 10.65k op/s
2021-10-29T05:49:04.024641+0700 mgr.server-3s03 (mgr.88486564) 1089107 : cluster [DBG] pgmap v1091726: 297 pgs: 1 active+clean+scrubbing, 2 active+clean+laggy, 2 active+clean+scrubbing+deep, 292 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 18 MiB/s rd, 9.4 MiB/s wr, 8.68k op/s
2021-10-29T05:49:06.026528+0700 mgr.server-3s03 (mgr.88486564) 1089108 : cluster [DBG] pgmap v1091727: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing, 2 active+clean+laggy, 1 active+clean+scrubbing+deep, 292 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 13 MiB/s rd, 7.0 MiB/s wr, 7.30k op/s
2021-10-29T05:49:08.028411+0700 mgr.server-3s03 (mgr.88486564) 1089109 : cluster [DBG] pgmap v1091728: 297 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep+laggy, 2 active+clean+laggy, 1 active+clean+scrubbing+deep, 292 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 11 MiB/s rd, 5.4 MiB/s wr, 6.42k op/s
2021-10-29T05:49:10.030537+0700 mgr.server-3s03 (mgr.88486564) 1089110 : cluster [DBG] pgmap v1091729: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 2 active+clean+laggy, 292 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 6.6 MiB/s rd, 3.8 MiB/s wr, 4.11k op/s
2021-10-29T05:49:12.032375+0700 mgr.server-3s03 (mgr.88486564) 1089111 : cluster [DBG] pgmap v1091730: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 2 active+clean+laggy, 292 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 3.8 MiB/s rd, 1.5 MiB/s wr, 3.12k op/s
2021-10-29T05:49:14.034847+0700 mgr.server-3s03 (mgr.88486564) 1089112 : cluster [DBG] pgmap v1091731: 297 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing+deep+laggy, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 1.05k op/s
2021-10-29T05:49:16.036751+0700 mgr.server-3s03 (mgr.88486564) 1089113 : cluster [DBG] pgmap v1091732: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 461 KiB/s rd, 787 KiB/s wr, 609 op/s
2021-10-29T05:49:18.038506+0700 mgr.server-3s03 (mgr.88486564) 1089114 : cluster [DBG] pgmap v1091733: 297 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing+deep, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 266 KiB/s rd, 597 KiB/s wr, 465 op/s
2021-10-29T05:49:20.040644+0700 mgr.server-3s03 (mgr.88486564) 1089115 : cluster [DBG] pgmap v1091734: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 163 KiB/s rd, 492 KiB/s wr, 332 op/s
2021-10-29T05:49:22.042546+0700 mgr.server-3s03 (mgr.88486564) 1089116 : cluster [DBG] pgmap v1091735: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 73 KiB/s rd, 265 KiB/s wr, 186 op/s
2021-10-29T05:49:24.044989+0700 mgr.server-3s03 (mgr.88486564) 1089117 : cluster [DBG] pgmap v1091736: 297 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing+deep+laggy, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 52 KiB/s rd, 186 KiB/s wr, 131 op/s
2021-10-29T05:49:26.046879+0700 mgr.server-3s03 (mgr.88486564) 1089118 : cluster [DBG] pgmap v1091737: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 8.8 KiB/s rd, 38 KiB/s wr, 23 op/s
2021-10-29T05:49:27.035034+0700 osd.23 (osd.23) 36910 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:27.230045+0700 osd.21 (osd.21) 12261 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:27.230060+0700 osd.21 (osd.21) 12262 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:28.048621+0700 mgr.server-3s03 (mgr.88486564) 1089119 : cluster [DBG] pgmap v1091738: 297 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing+deep, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 340 B/s rd, 170 B/s wr, 0 op/s
2021-10-29T05:49:28.084926+0700 osd.23 (osd.23) 36911 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:28.221108+0700 osd.21 (osd.21) 12263 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:28.221115+0700 osd.21 (osd.21) 12264 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:29.081229+0700 osd.23 (osd.23) 36912 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:29.183522+0700 osd.21 (osd.21) 12265 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:29.183528+0700 osd.21 (osd.21) 12266 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:30.037496+0700 osd.23 (osd.23) 36913 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:30.037538+0700 osd.23 (osd.23) 36914 : cluster [WRN] slow request osd_op(client.112960632.0:1543628763 11.11s0 11:8b0eac2a:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f390063:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28995 in=28995b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:48:59.700439+0700 currently started
2021-10-29T05:49:30.037551+0700 osd.23 (osd.23) 36915 : cluster [WRN] slow request osd_op(client.117888524.0:140762169 11.11s0 11:8b21402d:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-6%2fSUBTYPE-0%2f856293:head [getxattrs,stat,read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:49:00.014302+0700 currently delayed
2021-10-29T05:49:30.050822+0700 mgr.server-3s03 (mgr.88486564) 1089120 : cluster [DBG] pgmap v1091739: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 426 B/s rd, 0 op/s
2021-10-29T05:49:30.160566+0700 mon.server-3s01 (mon.0) 3576367 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec, osd.23 has slow ops (SLOW_OPS)
2021-10-29T05:49:30.193470+0700 osd.21 (osd.21) 12267 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:30.193477+0700 osd.21 (osd.21) 12268 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:31.054751+0700 osd.23 (osd.23) 36916 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:31.054762+0700 osd.23 (osd.23) 36917 : cluster [WRN] slow request osd_op(client.112960632.0:1543628763 11.11s0 11:8b0eac2a:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f390063:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28995 in=28995b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:48:59.700439+0700 currently started
2021-10-29T05:49:31.054769+0700 osd.23 (osd.23) 36918 : cluster [WRN] slow request osd_op(client.117888524.0:140762169 11.11s0 11:8b21402d:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-6%2fSUBTYPE-0%2f856293:head [getxattrs,stat,read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:49:00.014302+0700 currently delayed
2021-10-29T05:49:31.158344+0700 osd.21 (osd.21) 12269 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:31.158350+0700 osd.21 (osd.21) 12270 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:32.016409+0700 osd.23 (osd.23) 36919 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:32.016423+0700 osd.23 (osd.23) 36920 : cluster [WRN] slow request osd_op(client.112960632.0:1543628763 11.11s0 11:8b0eac2a:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f390063:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28995 in=28995b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:48:59.700439+0700 currently started
2021-10-29T05:49:32.016429+0700 osd.23 (osd.23) 36921 : cluster [WRN] slow request osd_op(client.117888524.0:140762169 11.11s0 11:8b21402d:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-6%2fSUBTYPE-0%2f856293:head [getxattrs,stat,read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:49:00.014302+0700 currently delayed
2021-10-29T05:49:32.016475+0700 osd.23 (osd.23) 36922 : cluster [WRN] slow request osd_op(client.112960632.0:1543636132 11.11s0 11:88dc521e:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f391563:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28007 in=28007b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:49:01.823976+0700 currently delayed
2021-10-29T05:49:32.052760+0700 mgr.server-3s03 (mgr.88486564) 1089121 : cluster [DBG] pgmap v1091740: 297 pgs: 1 active+clean+scrubbing+deep+laggy, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 596 B/s rd, 0 op/s
2021-10-29T05:49:32.200329+0700 osd.21 (osd.21) 12271 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:32.200337+0700 osd.21 (osd.21) 12272 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:32.375116+0700 mon.server-3s01 (mon.0) 3576370 : cluster [DBG] osd.7 reported failed by osd.34
2021-10-29T05:49:32.967163+0700 osd.23 (osd.23) 36923 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:32.967175+0700 osd.23 (osd.23) 36924 : cluster [WRN] slow request osd_op(client.112960632.0:1543628763 11.11s0 11:8b0eac2a:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f390063:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28995 in=28995b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:48:59.700439+0700 currently started
2021-10-29T05:49:32.967181+0700 osd.23 (osd.23) 36925 : cluster [WRN] slow request osd_op(client.117888524.0:140762169 11.11s0 11:8b21402d:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-6%2fSUBTYPE-0%2f856293:head [getxattrs,stat,read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:49:00.014302+0700 currently delayed
2021-10-29T05:49:32.967186+0700 osd.23 (osd.23) 36926 : cluster [WRN] slow request osd_op(client.112960632.0:1543636132 11.11s0 11:88dc521e:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f391563:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28007 in=28007b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:49:01.823976+0700 currently delayed
2021-10-29T05:49:33.238451+0700 osd.21 (osd.21) 12273 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:33.238459+0700 osd.21 (osd.21) 12274 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:33.503870+0700 mon.server-3s01 (mon.0) 3576371 : cluster [DBG] osd.7 reported failed by osd.33
2021-10-29T05:49:33.968638+0700 osd.23 (osd.23) 36927 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:33.968649+0700 osd.23 (osd.23) 36928 : cluster [WRN] slow request osd_op(client.112960632.0:1543628763 11.11s0 11:8b0eac2a:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f390063:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28995 in=28995b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:48:59.700439+0700 currently started
2021-10-29T05:49:33.968664+0700 osd.23 (osd.23) 36929 : cluster [WRN] slow request osd_op(client.117888524.0:140762169 11.11s0 11:8b21402d:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-6%2fSUBTYPE-0%2f856293:head [getxattrs,stat,read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:49:00.014302+0700 currently delayed
2021-10-29T05:49:33.968671+0700 osd.23 (osd.23) 36930 : cluster [WRN] slow request osd_op(client.112960632.0:1543636132 11.11s0 11:88dc521e:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f391563:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28007 in=28007b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:49:01.823976+0700 currently delayed
2021-10-29T05:49:34.055118+0700 mgr.server-3s03 (mgr.88486564) 1089122 : cluster [DBG] pgmap v1091741: 297 pgs: 1 active+clean+scrubbing, 1 active+clean+scrubbing+deep, 1 active+clean+scrubbing+deep+laggy, 3 active+clean+laggy, 291 active+clean; 52 TiB data, 105 TiB used, 280 TiB / 404 TiB avail; 852 B/s rd, 0 op/s
2021-10-29T05:49:34.257998+0700 osd.21 (osd.21) 12275 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:34.258004+0700 osd.21 (osd.21) 12276 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:34.258101+0700 osd.21 (osd.21) 12277 : cluster [WRN] slow request osd_op(client.112960632.0:1543636473 11.9s0 11:93d36cca:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f388326:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28319 in=28319b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:49:04.004705+0700 currently delayed
2021-10-29T05:49:34.386857+0700 mon.server-3s01 (mon.0) 3576376 : cluster [DBG] osd.7 reported failed by osd.31
2021-10-29T05:49:34.454037+0700 mon.server-3s01 (mon.0) 3576377 : cluster [DBG] osd.7 reported failed by osd.22
2021-10-29T05:49:34.666758+0700 mon.server-3s01 (mon.0) 3576379 : cluster [DBG] osd.7 reported failed by osd.6
2021-10-29T05:49:34.807714+0700 mon.server-3s01 (mon.0) 3576382 : cluster [DBG] osd.7 reported failed by osd.11
2021-10-29T05:49:34.924026+0700 osd.23 (osd.23) 36931 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:34.924040+0700 osd.23 (osd.23) 36932 : cluster [WRN] slow request osd_op(client.112960632.0:1543628763 11.11s0 11:8b0eac2a:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f390063:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28995 in=28995b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:48:59.700439+0700 currently started
2021-10-29T05:49:34.924046+0700 osd.23 (osd.23) 36933 : cluster [WRN] slow request osd_op(client.117888524.0:140762169 11.11s0 11:8b21402d:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-6%2fSUBTYPE-0%2f856293:head [getxattrs,stat,read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:49:00.014302+0700 currently delayed
2021-10-29T05:49:34.924052+0700 osd.23 (osd.23) 36934 : cluster [WRN] slow request osd_op(client.112960632.0:1543636132 11.11s0 11:88dc521e:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f391563:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28007 in=28007b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:49:01.823976+0700 currently delayed
2021-10-29T05:49:35.299696+0700 osd.21 (osd.21) 12278 : cluster [WRN] slow request osd_op(client.117618025.0:180043798 11.9s0 11:914cc9e3:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f359224:head [getxattrs out=945b,stat out=16b,read 0~29635] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.427483+0700 currently started
2021-10-29T05:49:35.299701+0700 osd.21 (osd.21) 12279 : cluster [WRN] slow request osd_op(client.117888524.0:140749850 11.9s0 11:906720e0:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f361381:head [getxattrs out=947b,stat out=16b,read 0~31680] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:57.002602+0700 currently started
2021-10-29T05:49:35.299711+0700 osd.21 (osd.21) 12280 : cluster [WRN] slow request osd_op(client.112960632.0:1543636473 11.9s0 11:93d36cca:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f388326:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28319 in=28319b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:49:04.004705+0700 currently delayed
2021-10-29T05:49:35.503104+0700 mon.server-3s01 (mon.0) 3576389 : cluster [DBG] osd.7 reported failed by osd.2
2021-10-29T05:49:35.918276+0700 osd.23 (osd.23) 36935 : cluster [WRN] slow request osd_op(client.117618025.0:180044810 11.11s0 11:8b6ba66c:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f375165:head [getxattrs out=947b,stat out=16b,read 0~33205] snapc 0=[] ondisk+read+known_if_redirected e18773) initiated 2021-10-29T05:48:56.683511+0700 currently started
2021-10-29T05:49:35.918289+0700 osd.23 (osd.23) 36936 : cluster [WRN] slow request osd_op(client.112960632.0:1543628763 11.11s0 11:8b0eac2a:::9213182a-14ba-48ad-bde9-289a1c0c0de8.6034919.1_%2fWHITELABEL-1%2fPAGETPYE-7%2fDEVICE-1%2fLANGUAGE-19%2fSUBTYPE-0%2f390063:head [create,setxattr user.rgw.idtag (56) in=70b,setxattr user.rgw.tail_tag (56) in=73b,writefull 0~28995 in=28995b,setxattr user.rgw.manifest (375) in=392b,setxattr user.rgw.acl (123) in=135b,setxattr user.rgw.content_type (10) in=31b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-storagetimestamp (40) in=76b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e18773) initiated 2021-10-29T05:48:59.700439+0700 currently started
