We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Training progress: 25%|██████████▎ | 10000/40000 [04:26<12:52, 38.83it/s, Loss=0.0322972]C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [64,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [65,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [66,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [67,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [68,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [69,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [70,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [71,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [72,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [73,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [74,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [75,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [76,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [77,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [78,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [79,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [80,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [81,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [82,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [83,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [84,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [85,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [86,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [87,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [88,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [89,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [90,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [91,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [92,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [93,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [94,0,0] Assertion srcIndex < srcSelectDimSize failed. C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [95,0,0] Assertion srcIndex < srcSelectDimSize failed. Traceback (most recent call last): File ".\train.py", line 559, in training(lp.extract(args), op.extract(args), pp.extract(args), dataset, args.test_iterations, args.save_iterations, args.checkpoint_iterations, args.start_checkpoint, args.debug_from, wandb, logger) File ".\train.py", line 172, in training training_report(tb_writer, dataset_name, iteration, Ll1, loss, l1_loss, iter_start.elapsed_time(iter_end), testing_iterations, scene, render, (pipe, background), wandb, logger) File ".\train.py", line 261, in training_report image = torch.clamp(renderFunc(viewpoint, scene.gaussians, *renderArgs, visible_mask=voxel_visible_mask)["render"], 0.0, 1.0) File "D:\fufus\github\Octree-GS\gaussian_renderer_init_.py", line 167, in render xyz, color, opacity, scaling, rot = generate_neural_gaussians(viewpoint_camera, pc, visible_mask, is_training=is_training, ape_code=ape_code) File "D:\fufus\github\Octree-GS\gaussian_renderer_init_.py", line 110, in generate_neural_gaussians opacity = neural_opacity[mask] RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Training progress: 25%|██████████▎ | 10000/40000 [04:27<13:23, 37.33it/s, Loss=0.0322972]
srcIndex < srcSelectDimSize
cuda:11.6 pytorch=1.12.1
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Training progress: 25%|██████████▎ | 10000/40000 [04:26<12:52, 38.83it/s, Loss=0.0322972]C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [64,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [65,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [66,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [67,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [68,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [69,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [70,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [71,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [72,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [73,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [74,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [75,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [76,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [77,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [78,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [79,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [80,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [81,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [82,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [83,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [84,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [85,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [86,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [87,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [88,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [89,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [90,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [91,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [92,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [93,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [94,0,0] Assertion
srcIndex < srcSelectDimSizefailed.C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\cuda\Indexing.cu:975: block: [34,0,0], thread: [95,0,0] Assertion
srcIndex < srcSelectDimSizefailed.Traceback (most recent call last):
File ".\train.py", line 559, in
training(lp.extract(args), op.extract(args), pp.extract(args), dataset, args.test_iterations, args.save_iterations, args.checkpoint_iterations, args.start_checkpoint, args.debug_from, wandb, logger)
File ".\train.py", line 172, in training
training_report(tb_writer, dataset_name, iteration, Ll1, loss, l1_loss, iter_start.elapsed_time(iter_end), testing_iterations, scene, render, (pipe, background), wandb, logger)
File ".\train.py", line 261, in training_report
image = torch.clamp(renderFunc(viewpoint, scene.gaussians, *renderArgs, visible_mask=voxel_visible_mask)["render"], 0.0, 1.0)
File "D:\fufus\github\Octree-GS\gaussian_renderer_init_.py", line 167, in render
xyz, color, opacity, scaling, rot = generate_neural_gaussians(viewpoint_camera, pc, visible_mask, is_training=is_training, ape_code=ape_code)
File "D:\fufus\github\Octree-GS\gaussian_renderer_init_.py", line 110, in generate_neural_gaussians
opacity = neural_opacity[mask]
RuntimeError: CUDA error: device-side assert triggered
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Training progress: 25%|██████████▎ | 10000/40000 [04:27<13:23, 37.33it/s, Loss=0.0322972]
cuda:11.6 pytorch=1.12.1
The text was updated successfully, but these errors were encountered: