How I Study AI - Learn AI Papers & Lectures the Easy Way

Proact-VL: A Proactive VideoLLM for Real-Time AI Companions

Beginner

Weicai Yan, Yuhong Dai et al.Mar 3arXiv

Proact-VL is a video-talking AI that knows not only what to say but also when to say it, like a great sports commentator.

#Proactive VideoLLM#real-time commentary#streaming video understanding

HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understanding

Intermediate

Haowei Zhang, Shudong Yang et al.Jan 21arXiv

HERMES is a training-free way to make video-language models understand live, streaming video quickly and accurately.

#HERMES#KV cache#hierarchical memory

InfiniteVL: Synergizing Linear and Sparse Attention for Highly-Efficient, Unlimited-Input Vision-Language Models

Intermediate

Hongyuan Tao, Bencheng Liao et al.Dec 9arXiv

InfiniteVL is a vision-language model that mixes two ideas: local focus with Sliding Window Attention and long-term memory with a linear module called Gated DeltaNet.

#InfiniteVL#linear attention#Gated DeltaNet

Papers3

Proact-VL: A Proactive VideoLLM for Real-Time AI Companions

HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understanding

InfiniteVL: Synergizing Linear and Sparse Attention for Highly-Efficient, Unlimited-Input Vision-Language Models