 Lin Manhui
|
f4a679ff9f
[Feat] Support lazy imports (#3764)
|
vor 7 Monaten |
 a31413510
|
12ec01f6b8
upload npu ultra_infer tutorials (#3763)
|
vor 7 Monaten |
|
Lin Manhui
|
bc54f1bb90
[Infra] Prune and sort imports (#3694)
|
vor 7 Monaten |
|
Lin Manhui
|
a65d269b21
[Feat] Support multi-backend inference (#2860)
|
vor 7 Monaten |
 zhink
|
80cb6da064
fix Paddle-TRT some model within FP16
|
vor 8 Monaten |
 gaotingquan
|
c5c819d47b
support to disable trt half ops
|
vor 8 Monaten |
|
gaotingquan
|
696089a110
call enable_use_gpu() first to use TensorRT engine
|
vor 8 Monaten |
|
gaotingquan
|
976eeb533f
when pir trt, it's need that enabling use gpu in convert_trt
|
vor 8 Monaten |
 EnflameGCU
|
0599a222ed
[GCU] Update gcu config (#3605)
|
vor 8 Monaten |
|
gaotingquan
|
19863acc7f
bugfix
|
vor 8 Monaten |
|
gaotingquan
|
db1bbfe948
support to set more trt config by model
|
vor 8 Monaten |
|
gaotingquan
|
d3dc02cb7a
support to set trt config by model
|
vor 8 Monaten |
|
gaotingquan
|
774737c06b
support paddle_fp32 and paddle_fp16 mode
|
vor 8 Monaten |
 zhang-prog
|
eb3e60685b
add cache func (#3509)
|
vor 8 Monaten |
|
gaotingquan
|
5abc0bfdca
set trt config for PP-YOLOE_seg-S
|
vor 8 Monaten |
|
gaotingquan
|
bf87804450
support trt_dynamic_shape_input_data for pir trt
|
vor 8 Monaten |
|
gaotingquan
|
0742a15ef8
Manually delete the predictor to trigger its destructor, ensuring that the shape_range_info file would be saved
|
vor 8 Monaten |
|
Lin Manhui
|
bea5ad68f9
[Fix] Allow bypassing model white list checks when performing internal tests (#3499)
|
vor 8 Monaten |
|
gaotingquan
|
ded6b3ab2b
bugfix: call enable_use_gpu() before calling enable_tensorrt_engine()
|
vor 8 Monaten |
|
Lin Manhui
|
8412aa82cb
Circumvent paddle inference bug (#3490)
|
vor 8 Monaten |
|
zhang-prog
|
3c9400e6dd
Enhance benchmark (#3475)
|
vor 8 Monaten |
|
zhang-prog
|
5158085f23
[Feat] upgrade benchmark (#3416)
|
vor 8 Monaten |
|
gaotingquan
|
9a4a934d47
support set trt config by model
|
vor 9 Monaten |
|
a31413510
|
7b5288bd6f
predict
|
vor 9 Monaten |
|
gaotingquan
|
68f3ff5b6f
fix redundantly create predictor
|
vor 9 Monaten |
|
gaotingquan
|
f48f8e4fdf
call enable_gpu() on dcu device
|
vor 9 Monaten |
|
gaotingquan
|
a5b997876d
use dcu device type
|
vor 9 Monaten |
|
gaotingquan
|
fcbf6b11d2
dcu also use gpu as the flag
|
vor 9 Monaten |
|
gaotingquan
|
8e9b8ddca2
change workspace_size to 30 in trt infer to be compatible with more models
|
vor 10 Monaten |
|
gaotingquan
|
adb12d98b6
update trt
|
vor 10 Monaten |
