一种高分辨率实时屏幕共享硬件加速系统

A Hardware-Accelerated System for High ResolutionReal-Time Screen SharingAbstract:Establishing an interactive screen sharing system that supports ultra high resolution (such as4k)is challenging,with latency and frame rate playing important roles in user experience.The screenframe needs to be compressed efficiently without consuming extensive computational resources.Wepresent a hardware-accelerated system for real-time screen sharing,which decreases encoding workloadby exploiting content redundancies between successive screen frames.We propose a multiple codecapproach that utilizes several encoders with H.264 Advanced Video Coding(H.264/AVC)of differentinput sizes,creating savings in encoding time by selecting the appropriate one for updated screencontent.An optimized metadata processing method is proposed as well.Small but distant updates withina frame can be split into independent frames for more efficient compression,which is also beneficial forinteractive latency.In the evaluation,the proposed system takes less encoding time than general singlecodec implementation in common screen sharing scenarios.Measurement for latency shows that theend-to-end latency for 4K resolution screen sharing is only about 17-25 ms,which makes the proposedsystem suitable for various applications in local wired and wireless connections.Keywords:Screen content sharing,4K resolution,hardware-accelerated encoding,low-latency screensharing