Content-Length: 331926 | pFad | https://github.com/NVIDIA/TensorRT-Model-Optimizer/issues/#start-of-content

17 Issues · NVIDIA/TensorRT-Model-Optimizer · GitHub
Skip to content

Issues: NVIDIA/TensorRT-Model-Optimizer

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

85 Open 96 Closed
85 Open 96 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Explicit quantization in PyTorch before ONNX leads to slower TRT engine than ONNX PTQ bug Something isn't working
#207 opened Jun 8, 2025 by liukang1811
@i-riyad
3
Apart from fp8, are there any plans to directly support vllm inference with awq in the future feature request New feature or request
#204 opened May 28, 2025 by dingjingzhen
llama 4 scout fp8 not work on sglang bug Something isn't working roadmap
#203 opened May 27, 2025 by zhyncs
@Edwardf0t1
3
get_modelike_from_algo_cfg doesn't accept QuantizeAlgorithmConfig, but it's typing says it should bug Something isn't working
#201 opened May 21, 2025 by ORippler
How can I use the HistogramCalibrator feature request New feature or request
#200 opened May 20, 2025 by AnnaTrainingG
@i-riyad
4
[BUG] FP8 real_quantization doesnt work with block_sizes bug Something isn't working
#193 opened May 9, 2025 by ishan-modi
@meenchen @realAsma
1
is fp8 quantization with block-wise/per-token/per-channel supported feature request New feature or request
#192 opened May 9, 2025 by YSF-A
1
What is the difference of config in mtq.quantize() and config in TensorQuantizer
#190 opened May 6, 2025 by YSF-A
@realAsma
1
Support for W4A16 and W4A8 Quantization in TensorRT Model Optimizer feature request New feature or request
#189 opened Apr 30, 2025 by david-PHR
4
Cannot serve modelopt quantized nvfp4 model on TensorRT LLM bug Something isn't working
#187 opened Apr 27, 2025 by enisaras
@meenchen
2
[BUG] modelopt restore quantized models using 'AutoModelForCausalLM.from_pretrained' doesn't work for mixtral-8x7b bug Something isn't working
#186 opened Apr 27, 2025 by wanzhenchn
3
Support more Quantization methods for "onnx_ptq"? feature request New feature or request
#184 opened Apr 24, 2025 by s101010tw
@i-riyad
[BUG] Issue processing NF4 double quantization bug Something isn't working
#183 opened Apr 22, 2025 by ishan-modi
1
@meenchen
3
Qwen2_MoE AWQ(w4a16/w4a8) quantization failed with Nan AssertionError
#182 opened Apr 22, 2025 by wanzhenchn
@meenchen
2
QAT weight load error bug Something isn't working
#180 opened Apr 18, 2025 by white-wolf-tech
@realAsma
3
Torch Quantization: Allow restoring quantized model and re-running calibration on new data (PTQ) feature request New feature or request
#179 opened Apr 16, 2025 by david-PHR
@realAsma
1
Run w4a8 quant for deepseek r1 on 8xH20 OOM
#177 opened Apr 14, 2025 by Kiokana
1
Explicit INT8 Quantization Fails to Fuse Concat-Conv Block Compared to Implicit Mode
#174 opened Apr 9, 2025 by patrickgrommelt
@i-riyad
5
Getting Real quantization not supported for this format error when using mtq.compress(model)
#171 opened Apr 5, 2025 by RivenSama
@meenchen
1
SDPA Int8 Quantisation using MTQ
#170 opened Apr 4, 2025 by satya-penamakuri
@jingyu-ml
2
slower when quantize whole bert model than quantize only ffn
#159 opened Mar 20, 2025 by DamonsJ
11
pi0 support?
#151 opened Mar 9, 2025 by johnnynunez
4
PyTorch Quantization Failed to Quantize Scaled Dot Product
#149 opened Mar 7, 2025 by YixuanSeanZhou
@jingyu-ml
10
[RFC] TensorRT Model Optimizer - Product Roadmap roadmap
#146 opened Mar 6, 2025 by omrialmog
@omrialmog
Not support torch.compile() ?
#145 opened Mar 5, 2025 by Vieeo
1
ProTip! What’s not been updated in a month: updated:<2025-05-09.








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: https://github.com/NVIDIA/TensorRT-Model-Optimizer/issues/#start-of-content

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy