2022-12-19T13:34:00.011 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-19T13:34:00.012 DEBUG:teuthology.run:Teuthology command: teuthology --name nmordech-2022-12-18_05:36:25-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi --archive /home/teuthworker/archive/nmordech-2022-12-18_05:36:25-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7121155 --lock --verbose --owner scheduled_nmordech@teuthology --block --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} -- /tmp/teuthology-worker.4zsguqdn.tmp 2022-12-19T13:34:00.099 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-12-19T13:34:00.517 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/nmordech-2022-12-18_05:36:25-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7121155 branch: wip-nitzan-peering-auth-log-shard-change-in-interval description: rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} email: null first_in_suite: false job_id: '7121155' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: nmordech-2022-12-18_05:36:25-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-nitzan-peering-auth-log-shard-change-in-interval ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd debug verify cached snaps: true osd debug verify missing on start: true osd heartbeat use min delay socket: true osd max backfills: 4 osd max markdown count: 1000 osd mclock override recovery settings: true osd objectstore: filestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd sloppy crc: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dca0fc1e54909c143338d609c8f876e588f53d9a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: dca0fc1e54909c143338d609c8f876e588f53d9a workunit: branch: wip-nitzan-peering-auth-log-shard-change-in-interval sha1: dca0fc1e54909c143338d609c8f876e588f53d9a owner: scheduled_nmordech@teuthology priority: 40 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: dca0fc1e54909c143338d609c8f876e588f53d9a sleep_before_teardown: 0 suite: rados:thrash-erasure-code suite_branch: wip-nitzan-peering-auth-log-shard-change-in-interval suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_dca0fc1e54909c143338d609c8f876e588f53d9a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: dca0fc1e54909c143338d609c8f876e588f53d9a tasks: - install: null - ceph: null - thrashosds: chance_pgnum_grow: 2 chance_pgpnum_fix: 1 min_in: 4 timeout: 1200 - full_sequential: - radosbench: clients: - client.0 ec_pool: true time: 150 unique_pool: true - radosbench: clients: - client.0 ec_pool: true time: 150 unique_pool: true - radosbench: clients: - client.0 ec_pool: true time: 150 unique_pool: true - radosbench: clients: - client.0 ec_pool: true time: 150 unique_pool: true - radosbench: clients: - client.0 ec_pool: true time: 150 unique_pool: true teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 19d18db866afdc31fd6586f558fc29b95a87ccfb timestamp: 2022-12-18_05:36:25 tube: smithi user: nmordech verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.14387 2022-12-19T13:34:00.517 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_dca0fc1e54909c143338d609c8f876e588f53d9a/qa; will attempt to use it 2022-12-19T13:34:00.518 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_dca0fc1e54909c143338d609c8f876e588f53d9a/qa/tasks 2022-12-19T13:34:00.518 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-12-19T13:34:00.520 INFO:teuthology.task.internal:Checking packages... 2022-12-19T13:34:00.551 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'dca0fc1e54909c143338d609c8f876e588f53d9a' 2022-12-19T13:34:00.551 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-12-19T13:34:00.551 INFO:teuthology.packaging:ref: None 2022-12-19T13:34:00.551 INFO:teuthology.packaging:tag: None 2022-12-19T13:34:00.552 INFO:teuthology.packaging:branch: wip-nitzan-peering-auth-log-shard-change-in-interval 2022-12-19T13:34:00.552 INFO:teuthology.packaging:sha1: dca0fc1e54909c143338d609c8f876e588f53d9a 2022-12-19T13:34:00.552 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-nitzan-peering-auth-log-shard-change-in-interval 2022-12-19T13:34:00.729 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1501-gdca0fc1e-1focal 2022-12-19T13:34:00.730 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-12-19T13:34:00.737 INFO:teuthology.task.internal:no buildpackages task found 2022-12-19T13:34:00.737 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2022-12-19T13:34:00.750 INFO:teuthology.lock.ops:Locking machines... 2022-12-19T13:34:00.751 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-12-19T13:34:01.599 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:34:11.623 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:34:21.643 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:34:31.664 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:34:41.686 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:34:51.708 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:35:01.731 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:35:11.754 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:35:21.777 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:35:31.799 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:35:41.820 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:35:51.838 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:36:01.859 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:36:11.881 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:36:21.902 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:36:31.922 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:36:41.944 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:36:51.965 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:37:01.985 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:37:12.006 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:37:22.028 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:37:32.048 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:37:42.069 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:37:52.090 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:38:02.111 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:38:12.131 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:38:22.152 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:38:32.173 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:38:42.194 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:38:52.215 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:39:02.235 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:39:12.256 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:39:22.277 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:39:32.303 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:39:42.324 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:39:52.341 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:40:02.377 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:40:12.397 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:40:22.420 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:40:32.441 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:40:42.462 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:40:52.483 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:41:02.505 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:41:12.526 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:41:22.548 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:41:32.572 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:41:42.594 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:41:52.616 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:42:02.639 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:42:12.660 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:42:22.681 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:42:32.704 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:42:42.725 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:42:52.747 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:43:02.766 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:43:12.785 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:43:22.806 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:43:32.827 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:43:42.849 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:43:52.870 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:44:02.892 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:44:12.916 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:44:22.939 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:44:32.960 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:44:42.978 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:44:52.999 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:45:03.020 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:45:13.042 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:45:23.063 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:45:33.086 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:45:43.112 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:45:53.133 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:46:03.155 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:46:13.175 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:46:23.197 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:46:33.222 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:46:43.243 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:46:53.264 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:47:03.282 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:47:13.304 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:47:23.326 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:47:33.348 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:47:43.369 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:47:53.390 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:48:03.411 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:48:13.433 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:48:23.454 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:48:33.474 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:48:43.497 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:48:53.519 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:49:03.540 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:49:13.561 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:49:23.583 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:49:33.604 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:49:43.628 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:49:53.646 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:50:03.673 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:50:13.694 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:50:23.715 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:50:33.734 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:50:43.755 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:50:53.770 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:51:03.791 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:51:13.812 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:51:23.833 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:51:33.855 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:51:43.877 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:51:53.900 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:52:03.921 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:52:13.943 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:52:23.968 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:52:33.990 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:52:44.011 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:52:54.035 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:53:04.050 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:53:14.075 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:53:24.108 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:53:34.129 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:53:44.150 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:53:54.173 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:54:04.193 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:54:14.211 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:54:24.234 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:54:34.256 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:54:44.278 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:54:54.301 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:55:04.323 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:55:14.345 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:55:24.370 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:55:34.393 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:55:44.416 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:55:54.438 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:56:04.462 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:56:14.485 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:56:24.508 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:56:34.529 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:56:44.548 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:56:54.571 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:57:04.593 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:57:14.607 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:57:24.629 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2022-12-19T13:57:34.651 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)...