Kernel Merge

Adaptive Kernel Merge and Fusion for Multi-Tenant Inference in Embedded GPUs
This paper proposes a new scheme that improves throughput and reduces queuing delay while running multiple inferences in embedded …
PDF Cite Project DOI
Adaptive Kernel Merge and Fusion for Multi-Tenant Inference in Embedded GPUs