• Benchmarking Domain Intelligence | Data Brew | Episode 45

  • Apr 24 2025
  • Duración: 32 m
  • Podcast

Benchmarking Domain Intelligence | Data Brew | Episode 45

  • Resumen

  • In this episode, Pallavi Koppol, Research Scientist at Databricks, explores the importance of domain-specific intelligence in large language models (LLMs). She discusses how enterprises need models tailored to their unique jargon, data, and tasks rather than relying solely on general benchmarks.

    Highlights include:
    - Why benchmarking LLMs for domain-specific tasks is critical for enterprise AI.
    - An introduction to the Databricks Intelligence Benchmarking Suite (DIBS).
    - Evaluating models on real-world applications like RAG, text-to-JSON, and function calling.
    - The evolving landscape of open-source vs. closed-source LLMs.
    - How industry and academia can collaborate to improve AI benchmarking.

    Más Menos
adbl_web_global_use_to_activate_webcro768_stickypopup

Lo que los oyentes dicen sobre Benchmarking Domain Intelligence | Data Brew | Episode 45

Calificaciones medias de los clientes

Reseñas - Selecciona las pestañas a continuación para cambiar el origen de las reseñas.