Episodios

  • Arxiv paper - ImplicitQA: Going beyond frames towards Implicit Video Reasoning

    Arxiv paper - ImplicitQA: Going beyond frames towards Implicit Video Reasoning
    Jul 11 2025
    In this episode, we discuss ImplicitQA: Going beyond frames towards Implicit Video Reasoning by Sirnam Swetha, Rohit Gupta, Parth Parag Kulkarni, David G Shatwell, Jeffrey A Chan Santiago, Nyle Siddiqui, Joseph Fioresi, Mubarak Shah. The paper introduces ImplicitQA, a new VideoQA benchmark designed to evaluate models on implicit reasoning in creative and cinematic videos, requiring understanding beyond explicit visual cues. It contains 1,000 carefully annotated question-answer pairs from over 320 narrative-driven video clips, emphasizing complex reasoning such as causality and social interactions. Evaluations show current VideoQA models struggle with these challenges, highlighting the need for improved implicit reasoning capabilities in the field.
    Más Menos
    7 m
  • Arxiv paper - BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing

    Arxiv paper - BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing
    Jul 8 2025
    In this episode, we discuss BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing by Jiacheng Chen, Ramin Mehran, Xuhui Jia, Saining Xie, Sanghyun Woo. BlenderFusion is a generative visual compositing framework that enables scene synthesis by segmenting inputs into editable 3D elements, editing them in Blender, and recomposing them with a generative compositor. The compositor uses a fine-tuned diffusion model trained with source masking and object jittering strategies for flexible and disentangled scene manipulation. This approach achieves superior performance in complex 3D-grounded visual editing and compositing tasks compared to prior methods.
    Más Menos
    7 m
  • Arxiv paper - Strategic Intelligence in Large Language Models: Evidence from evolutionary Game Theory

    Arxiv paper - Strategic Intelligence in Large Language Models: Evidence from evolutionary Game Theory
    Jul 8 2025
    In this episode, we discuss Strategic Intelligence in Large Language Models: Evidence from evolutionary Game Theory by Kenneth Payne, Baptiste Alloui-Cros. The paper investigates whether Large Language Models (LLMs) can engage in strategic decision-making by testing them in evolutionary Iterated Prisoner’s Dilemma tournaments against classic strategies. Results show that LLMs are highly competitive and exhibit distinct strategic behaviors, with different models displaying varying levels of cooperation and retaliation. The authors further analyze the models’ reasoning processes, revealing that LLMs actively consider future interactions and opponent strategies, bridging game theory with machine psychology.
    Más Menos
    8 m
  • Blogpost paper - Project Vend: Can Claude run a small shop? (And why does that matter?)

    Blogpost paper - Project Vend: Can Claude run a small shop? (And why does that matter?)
    Jul 2 2025

    In this episode, we discuss Project Vend: Can Claude run a small shop? (And why does that matter?) The paper describes a month-long experiment where the AI model Claude autonomously managed an office store as a small business. The study reveals both how close the AI came to successfully running the business and the unexpected ways it failed. These findings offer insights into a near-future scenario where AI models independently operate real-world economic activities.
    Más Menos
    8 m
  • Arxiv paper - Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens

    Arxiv paper - Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens
    Jul 2 2025
    In this episode, we discuss Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens by Zeyuan Yang, Xueyang Yu, Delin Chen, Maohao Shen, Chuang Gan. The paper proposes Mirage, a framework that enables vision-language models to perform internal visual reasoning by generating latent visual tokens alongside text, without producing explicit images. Mirage is trained through a combination of distillation from image embeddings, text-only supervision, and reinforcement learning to align visual reasoning with task goals. Experiments show that this approach improves multimodal reasoning performance on various benchmarks without the need for heavy image generation.
    Más Menos
    8 m
  • Arxiv paper - SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editing

    Arxiv paper - SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editing
    Jun 30 2025
    In this episode, we discuss SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editing by Ming Li, Xin Gu, Fan Chen, Xiaoying Xing, Longyin Wen, Chen Chen, Sijie Zhu. The paper addresses the issue of noisy supervision in instruction-based image editing datasets by rectifying editing instructions to better align with image pairs and introducing contrastive instruction supervision using triplet loss. Their method leverages inherent model generation attributes to guide editing instruction correction without relying on vision-language models or pre-training, resulting in a simpler and more effective training process. Experiments show significant improvements over state-of-the-art methods with much less data and smaller models, and all resources are publicly released.
    Más Menos
    7 m
  • Arxiv paper - OMEGA: Can LLMs Reason Outside the Box in Math? Evaluating Exploratory, Compositional, and Transformative Generalization

    Arxiv paper - OMEGA: Can LLMs Reason Outside the Box in Math? Evaluating Exploratory, Compositional, and Transformative Generalization
    Jun 27 2025
    In this episode, we discuss OMEGA: Can LLMs Reason Outside the Box in Math? Evaluating Exploratory, Compositional, and Transformative Generalization by Yiyou Sun, Shawn Hu, Georgia Zhou, Ken Zheng, Hannaneh Hajishirzi, Nouha Dziri, Dawn Song. The paper introduces OMEGA, a new benchmark to evaluate large language models' out-of-distribution generalization on math problems along three creativity-inspired axes: exploratory, compositional, and transformative reasoning. Evaluations reveal that state-of-the-art LLMs struggle increasingly with problem complexity, especially in compositional and transformative reasoning. Fine-tuning improves exploratory skills but not the other two, highlighting challenges in achieving genuine mathematical creativity beyond routine problem-solving.
    Más Menos
    7 m
  • Arxiv paper - Long-Context State-Space Video World Models

    Arxiv paper - Long-Context State-Space Video World Models
    Jun 25 2025
    In this episode, we discuss Long-Context State-Space Video World Models by Ryan Po, Yotam Nitzan, Richard Zhang, Berlin Chen, Tri Dao, Eli Shechtman, Gordon Wetzstein, Xun Huang. The paper introduces a novel video diffusion model architecture that uses state-space models (SSMs) to extend temporal memory efficiently for causal sequence modeling. It employs a block-wise SSM scanning scheme combined with dense local attention to balance long-term memory with spatial coherence. Experiments on Memory Maze and Minecraft datasets show the method outperforms baselines in long-range memory retention while maintaining fast inference suitable for real-time use.
    Más Menos
    7 m