AI产品精选78°

NVIDIA 推出 TensorRT Model Connect 公测版

We just released TensorRT Model Connect in Public Preview. You can take a supported @huggingface mo...

精选理由

NVIDIA 发了个工具,两行命令把 Hugging Face 模型转 TensorRT,省去 ONNX 导出步骤。

AI 摘要

NVIDIA 发布了 TensorRT Model Connect 公测版。用户只需两个命令即可将 Hugging Face 模型转换为 TensorRT 推理格式。该工具无需中间 ONNX 导出,生成的包支持原生 C++ API。整个项目由 OpenAI Codex agents 构建,人类负责指导和审查工作。

原文 · NVIDIA AI

We just released TensorRT Model Connect in Public Preview. You can take a supported @huggingface mo...

We just released TensorRT Model Connect in Public Preview. You can take a supported @huggingface model to end-to-end TensorRT inference in just two commands. No intermediate ONNX export, and the resulting bundle can run through native C++ APIs. We also built the entire project with @OpenAIDevs Codex agents, with humans directing and reviewing the work. That includes model implementations, performance tuning, tests, integrations, and docs. It’s open source, so go try it out, dig into the implementations, or contribute support for a new model: github.com/NVIDIA/TensorR… 💬 2 🔄 12 ❤️ 89 👀 6658 📊 17 ⚡