Fix hang in pointcloud conflict tests #6252

Job	Run time
Run Type Checking	31s
amazon-ecr-auth	7s
macOS 13/x86_64	21m 58s
Windows 2019/x64	25m 22s
macOS 13/arm64	9m 25s
Linux dev	12m 35s
Linux amd64	43m 8s
Linux arm64	57m 20s
Linux dev+vendor	5m 34s
Install-check: tgz-ubuntu-22.04/amd64	37s
Install-check: ubuntu-22.04/amd64	41s
Install-check: ubuntu-20.04/amd64	37s
Install-check: ubuntu-18.04/amd64	42s
Install-check: debian-stable/amd64	31s
Install-check: debian-oldstable/amd64	30s
Install-check: amazonlinux-2023/amd64	39s
Install-check: fedora-latest/amd64	49s
Install-check: almalinux-9/amd64	43s
Install-check: almalinux-8/amd64	46s
Install-check: tgz-ubuntu-22.04/arm64	55s
Install-check: ubuntu-22.04/arm64	1m 1s
Install-check: ubuntu-20.04/arm64	50s
Install-check: ubuntu-18.04/arm64	57s
Install-check: debian-stable/arm64	49s
Install-check: debian-oldstable/arm64	55s
Install-check: amazonlinux-2023/arm64	1m 56s
Install-check: fedora-latest/arm64	1m 55s
Install-check: almalinux-9/arm64	1m 55s
Install-check: almalinux-8/arm64	1m 3s
	3h 14m 51s

Provide feedback