TULIP: Towards Unified Language-Image Pretraining
Paper • 2503.15485 • Published • 49
Animation2Code
community
AI & ML interests
None defined yet.
davidchanÂ
authored a
paper about 1 year ago
davidchanÂ
authored 4
papers almost 2 years ago
Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition
Paper • 2403.19822 • Published
ALOHa: A New Measure for Hallucination in Captioning Models
Paper • 2404.02904 • Published
Virtual Personas for Language Models via an Anthology of Backstories
Paper • 2407.06576 • Published • 1
Visual Haystacks: Answering Harder Questions About Sets of Images
Paper • 2407.13766 • Published • 2
Post
635
🚨 Launching The Visual Haystacks (VHs) Benchmark: the first "visual-centric" Needle-In-A-Haystack (NIAH) benchmark to assess LMMs' capability in long-context visual retrieval and reasoning.
Check it out!
tsunghanwu/visual_haystacks
https://visual-haystacks.github.io/
https://arxiv.org/abs/2407.13766
https://github.com/visual-haystacks/vhs_benchmark
Check it out!
tsunghanwu/visual_haystacks
https://visual-haystacks.github.io/
https://arxiv.org/abs/2407.13766
https://github.com/visual-haystacks/vhs_benchmark
davidchanÂ
authored 6
papers over 2 years ago
Task Oriented Dialogue as a Catalyst for Self-Supervised Automatic Speech Recognition
Paper • 2401.02417 • Published • 1
Multimodal Attention Merging for Improved Speech Recognition and Audio Event Classification
Paper • 2312.14378 • Published
See, Say, and Segment: Teaching LMMs to Overcome False Premises
Paper • 2312.08366 • Published
CLAIR: Evaluating Image Captions with Large Language Models
Paper • 2310.12971 • Published
Using External Off-Policy Speech-To-Text Mappings in Contextual End-To-End Automated Speech Recognition
Paper • 2301.02736 • Published
ANIM-400K: A Large-Scale Dataset for Automated End-To-End Dubbing of Video
Paper • 2401.05314 • Published • 12