12
框架组件
提问帖
有回复
K100运行T5模型有精度问题,结果全为NaN
2026-04-15 11:12:40
62
这是我的测试脚本 ```python import argparse import sys import torch from sentence_transformers import SentenceTransformer def main() -> int: parser = argparse.ArgumentParser(description="Check text encoder output health") parser.add_argument( "--model", type=str, default="sentence-transformers/sentence-t5-xxl", help="SentenceTransformer model path or model id", ) parser.add_argument( "--batch-size", type=int, default=2, help="Batch size for encoding", ) args = parser.parse_args() texts = [ "hello world", "test item title", "Title: Toy Story; Brand: Pixar; Categories: Movies; Price: 19.99;", ] model = SentenceTransformer(args.model) emb = model.encode( inputs=texts, batch_size=args.batch_size, show_progress_bar=False, convert_to_tensor=True, ) nan_count = torch.isnan(emb).sum().item() inf_count = torch.isinf(emb).sum().item() finite_ratio = torch.isfinite(emb).float().mean().item() print("model:", args.model) print("shape:", tuple(emb.shape)) print("dtype:", emb.dtype) print("nan:", nan_count) print("inf:", inf_count) print("finite_ratio:", finite_ratio) if finite_ratio < 1.0: print("ERROR: encoder output contains non-finite values.") return 1 print("OK: encoder output is fully finite.") return 0 if __name__ == "__main__": sys.exit(main()) ``` 结果全是NaN ![1776222657041.png](/api-forum/file/RedirectImage?path=20260415/1776222657204_1776222657041.png '1776222657041.png')
全部评论(2)
只看楼主
Y
yanzy
1楼
请问用的是哪个镜像呢?
4/16
Y
yudeng
回复 @yanzy

pytorch:2.5.1_ubuntu22.04_dtk25.04.4_1230_py3.10

这个
4/16
没有更多内容了
--
楼主
Level.2
0 帖子
楼主热帖
暂无数据