How I Study AI - Learn AI Papers & Lectures the Easy Way

UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?

Intermediate

Zimo Wen, Boxiu Li et al.Mar 3arXiv

This paper builds UniG2U-Bench, a big test to find out when making pictures (generation) actually helps models understand pictures and text together.

#Unified multimodal models#Vision-language models#Generation-to-Understanding (G2U)

DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing

Beginner

Dianyi Wang, Ruihang Li et al.Feb 12arXiv

DeepGen 1.0 is a small 5B-parameter model that can both make new images and smartly edit existing ones from text instructions.

#Unified multimodal model#Stacked Channel Bridging#Think tokens

Trainable Log-linear Sparse Attention for Efficient Diffusion Transformers

Beginner

Yifan Zhou, Zeqi Xiao et al.Dec 18arXiv

This paper introduces Log-linear Sparse Attention (LLSA), a new way for Diffusion Transformers to focus only on the most useful information using a smart, layered search.

#Log-linear Sparse Attention#Hierarchical Top-K#Hierarchical KV Enrichment

Papers3

UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?

DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing

Trainable Log-linear Sparse Attention for Efficient Diffusion Transformers