[10.15]Thru3D媒体服务器（原VR视频透视服务器）V1.5.2版（支持字幕、离线鱼眼转透视）

joe123

zelefans 发表于 2026-5-14 16:16
已经改了代码准备晚上真机测试了……问题找到就好，可以看下fps。比如离线模式不限制速度，我的4k有100fp ...

4060ti 16G离线模式4K有87FPS，不过matanyone2用不了
[matting] CuPy 14.0.1 detected, GPU composite enabled.
[matting] options: input_size=1024 square=False split_sbs=True sbs_batch=True alpha_stride=3 alpha_mode=reuse alpha_cutoff=0.0 alpha_hard_edge=False alpha_contrast=1.0
[offline] MatAnyone2 requires an NVIDIA GPU with at least 16GB VRAM.
[offline] run: D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\pt_core.exe tool offline_passthrough "\\mynas\vr\����\jellyfin\ɭ������\SAVR-509-4K ɭ������\SAVR-509-4K-cd1.mp4" --engine matanyone2_onnx --out "\\mynas\vr\����\jellyfin\ɭ������\SAVR-509-4K ɭ������\SAVR-509-4K-cd1_matanyone2_S000500_15S_passthrough.mp4" --audio copy --start 300.0 --duration 15.0 --fps 30.0
[matting] CuPy 14.0.1 detected, GPU composite enabled.
[matting] options: input_size=1024 square=False split_sbs=True sbs_batch=True alpha_stride=3 alpha_mode=reuse alpha_cutoff=0.0 alpha_hard_edge=False alpha_contrast=1.0
[offline] SAM3 prepass subprocess=D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\pt_core.exe D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\_internal\tools\offline_passthrough.py "\\mynas\vr\����\jellyfin\ɭ������\SAVR-509-4K ɭ������\SAVR-509-4K-cd1.mp4" --engine matanyone2_onnx --model D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\models\matanyone2_onnx_512_bs2 --matanyone2-size 512 --matanyone2-batch auto --sam3-model-dir D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\models\sam3_onnx --sam3-prompt person --sam3-score-threshold 0.5 --sam3-min-area-ratio 0.0005 --sam3-max-area-ratio 0.95 --sam3-top-k 0 --sam3-scan hybrid --sam3-scan-interval-sec 1.0 --sam3-active-min-area-ratio 0.001 --sam3-provider cuda --sam3-decoder-provider cuda --sam3-cuda-memory-limit-mb 8192 --sam3-decoder-cuda-memory-limit-mb 4096 --sam3-min-vram-gb 15.5 --sam3-release-interval 0 --no-sam3-low-memory --sam3-low-memory-batch 1 --sam3-log-vram --matanyone2-segment-frames 300 --matanyone2-min-segment-sec 3.0 --frames 450 --fps 30.0 --sam3-prepass-out D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\debug_output\_sam3_prepass\sam3_prepass_1778746946246_1835747259744.npz
[matting] CuPy 14.0.1 detected, GPU composite enabled.
[matting] options: input_size=1024 square=False split_sbs=True sbs_batch=True alpha_stride=3 alpha_mode=reuse alpha_cutoff=0.0 alpha_hard_edge=False alpha_contrast=1.0
usage: pt_core.exe [-h] [--debug] [{DEBUG,debug}]
pt_core.exe: error: argument mode: invalid choice: 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\_internal\\tools\\offline_passthrough.py' (choose from DEBUG, debug)
Traceback (most recent call last):
  File "main.py", line 310, in <module>
  File "main.py", line 131, in main
  File "main.py", line 66, in _run_legacy_tool
  File "tools\offline_passthrough.py", line 1582, in main
  File "tools\offline_passthrough.py", line 1197, in _precompute_sam3_segment_masks
  File "tools\offline_passthrough.py", line 1403, in _precompute_sam3_segment_masks_subprocess
  File "subprocess.py", line 571, in run
subprocess.CalledProcessError: Command '['D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\pt_core.exe', 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\_internal\\tools\\offline_passthrough.py', '\\\\mynas\\vr\\����\\jellyfin\\ɭ������\\SAVR-509-4K ɭ������\\SAVR-509-4K-cd1.mp4', '--engine', 'matanyone2_onnx', '--model', 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\models\\matanyone2_onnx_512_bs2', '--matanyone2-size', '512', '--matanyone2-batch', 'auto', '--sam3-model-dir', 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\models\\sam3_onnx', '--sam3-prompt', 'person', '--sam3-score-threshold', '0.5', '--sam3-min-area-ratio', '0.0005', '--sam3-max-area-ratio', '0.95', '--sam3-top-k', '0', '--sam3-scan', 'hybrid', '--sam3-scan-interval-sec', '1.0', '--sam3-active-min-area-ratio', '0.001', '--sam3-provider', 'cuda', '--sam3-decoder-provider', 'cuda', '--sam3-cuda-memory-limit-mb', '8192', '--sam3-decoder-cuda-memory-limit-mb', '4096', '--sam3-min-vram-gb', '15.5', '--sam3-release-interval', '0', '--no-sam3-low-memory', '--sam3-low-memory-batch', '1', '--sam3-log-vram', '--matanyone2-segment-frames', '300', '--matanyone2-min-segment-sec', '3.0', '--frames', '450', '--fps', '30.0', '--sam3-prepass-out', 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\debug_output\\_sam3_prepass\\sam3_prepass_1778746946246_1835747259744.npz']' returned non-zero exit status 2.
[PYI-6656:ERROR] Failed to execute script 'main' due to unhandled exception!
[matting] CuPy 14.0.1 detected, GPU composite enabled.
[matting] options: input_size=1024 square=False split_sbs=True sbs_batch=True alpha_stride=3 alpha_mode=reuse alpha_cutoff=0.0 alpha_hard_edge=False alpha_contrast=1.0
[offline] MatAnyone2 requires an NVIDIA GPU with at least 16GB VRAM.
[offline] run: D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\pt_core.exe tool offline_passthrough "\\mynas\vr\����\jellyfin\ɭ������\SAVR-509-4K ɭ������\SAVR-509-4K-cd1.mp4" --engine matanyone2_onnx --out "\\mynas\vr\����\jellyfin\ɭ������\SAVR-509-4K ɭ������\SAVR-509-4K-cd1_matanyone2_S000500_15S_passthrough.mp4" --audio copy --start 300.0 --duration 15.0 --fps 30.0
[matting] CuPy 14.0.1 detected, GPU composite enabled.
[matting] options: input_size=1024 square=False split_sbs=True sbs_batch=True alpha_stride=3 alpha_mode=reuse alpha_cutoff=0.0 alpha_hard_edge=False alpha_contrast=1.0
[offline] SAM3 prepass subprocess=D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\pt_core.exe D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\_internal\tools\offline_passthrough.py "\\mynas\vr\����\jellyfin\ɭ������\SAVR-509-4K ɭ������\SAVR-509-4K-cd1.mp4" --engine matanyone2_onnx --model D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\models\matanyone2_onnx_512_bs2 --matanyone2-size 512 --matanyone2-batch auto --sam3-model-dir D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\models\sam3_onnx --sam3-prompt person --sam3-score-threshold 0.5 --sam3-min-area-ratio 0.0005 --sam3-max-area-ratio 0.95 --sam3-top-k 0 --sam3-scan hybrid --sam3-scan-interval-sec 1.0 --sam3-active-min-area-ratio 0.001 --sam3-provider cuda --sam3-decoder-provider cuda --sam3-cuda-memory-limit-mb 8192 --sam3-decoder-cuda-memory-limit-mb 4096 --sam3-min-vram-gb 15.5 --sam3-release-interval 0 --no-sam3-low-memory --sam3-low-memory-batch 1 --sam3-log-vram --matanyone2-segment-frames 300 --matanyone2-min-segment-sec 3.0 --frames 450 --fps 30.0 --sam3-prepass-out D:\VR_Video_Passthrough_Server_v0.1.0-alpha.2\VR_Video_Passthrough_Server\debug_output\_sam3_prepass\sam3_prepass_1778746970633_2824802497696.npz
[matting] CuPy 14.0.1 detected, GPU composite enabled.
[matting] options: input_size=1024 square=False split_sbs=True sbs_batch=True alpha_stride=3 alpha_mode=reuse alpha_cutoff=0.0 alpha_hard_edge=False alpha_contrast=1.0
usage: pt_core.exe [-h] [--debug] [{DEBUG,debug}]
pt_core.exe: error: argument mode: invalid choice: 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\_internal\\tools\\offline_passthrough.py' (choose from DEBUG, debug)
Traceback (most recent call last):
  File "main.py", line 310, in <module>
  File "main.py", line 131, in main
  File "main.py", line 66, in _run_legacy_tool
  File "tools\offline_passthrough.py", line 1582, in main
  File "tools\offline_passthrough.py", line 1197, in _precompute_sam3_segment_masks
  File "tools\offline_passthrough.py", line 1403, in _precompute_sam3_segment_masks_subprocess
  File "subprocess.py", line 571, in run
subprocess.CalledProcessError: Command '['D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\pt_core.exe', 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\_internal\\tools\\offline_passthrough.py', '\\\\mynas\\vr\\����\\jellyfin\\ɭ������\\SAVR-509-4K ɭ������\\SAVR-509-4K-cd1.mp4', '--engine', 'matanyone2_onnx', '--model', 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\models\\matanyone2_onnx_512_bs2', '--matanyone2-size', '512', '--matanyone2-batch', 'auto', '--sam3-model-dir', 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\models\\sam3_onnx', '--sam3-prompt', 'person', '--sam3-score-threshold', '0.5', '--sam3-min-area-ratio', '0.0005', '--sam3-max-area-ratio', '0.95', '--sam3-top-k', '0', '--sam3-scan', 'hybrid', '--sam3-scan-interval-sec', '1.0', '--sam3-active-min-area-ratio', '0.001', '--sam3-provider', 'cuda', '--sam3-decoder-provider', 'cuda', '--sam3-cuda-memory-limit-mb', '8192', '--sam3-decoder-cuda-memory-limit-mb', '4096', '--sam3-min-vram-gb', '15.5', '--sam3-release-interval', '0', '--no-sam3-low-memory', '--sam3-low-memory-batch', '1', '--sam3-log-vram', '--matanyone2-segment-frames', '300', '--matanyone2-min-segment-sec', '3.0', '--frames', '450', '--fps', '30.0', '--sam3-prepass-out', 'D:\\VR_Video_Passthrough_Server_v0.1.0-alpha.2\\VR_Video_Passthrough_Server\\debug_output\\_sam3_prepass\\sam3_prepass_1778746970633_2824802497696.npz']' returned non-zero exit status 2.
[PYI-2764:ERROR] Failed to execute script 'main' due to unhandled exception!

ying1221

4070s显卡

pwzdby

离线透视ALpha直通，处理好的视频播放画面很闪，根本没法看

joe123

ying1221 发表于 2026-5-14 17:26
4070s显卡

装cuda12.6和cuddn

zelefans

pwzdby 发表于 2026-5-14 17:31
离线透视ALpha直通，处理好的视频播放画面很闪，根本没法看

给一下车牌哈

zelefans

ying1221 发表于 2026-5-14 17:26
4070s显卡

应该是我打包漏了cudnn了，今晚补一个新版本

zelefans

joe123 发表于 2026-5-14 17:45
装cuda12.6和cuddn

应该是这个原因。上午alpha2解决了cuda路径指向本地，cudnn查了没封进去。晚上重新写打包。非技术的确难搞这些

pwzdby

成了，捣鼓出来了，here播放器播放不能快进，播放时卡时卡的，还有我离线我试了直通模式，所有片子转出来的直播片源都很闪烁，不清楚是什么问题造成的

zelefans

pwzdby 发表于 2026-5-14 18:33
成了，捣鼓出来了，here播放器播放不能快进，播放时卡时卡的，还有我离线我试了直通模式，所有片子转出来的 ...

直通闪烁我之前部分视频出现过，比如KAVR系列，但后来忘了改了啥都好了，回头查一下日志。车牌给我，我再查一下。
卡的问题，降低一下出口帧率到输出20帧应该会缓解。 显卡是什么型号的。

biuboom

大佬写代码的速度就这么快吗