Tag: Vision Foundation Model

All the articles with the tag "Vision Foundation Model".

• LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications

  Published: 14 May, 2025 |  at  11:12 AM

  

  90.54 🤔

  LiteWebAgent is an open-source suite for VLM-based web agents that bridges the gap in production-ready solutions by offering an extensible framework with decoupled action generation and grounding, advanced planning, memory, tree search, and practical deployments via Vercel and Chrome extension.

• Steering Away from Harm: An Adaptive Approach to Defending Vision Language Model Against Jailbreaks

  Published: 8 May, 2025 |  at  11:07 AM

  

  87.75 🤔

  ASTRA introduces an efficient defense for Vision Language Models by adaptively steering activations away from adversarial directions using image attribution, achieving state-of-the-art performance in mitigating jailbreak attacks with minimal impact on benign utility and high inference efficiency.

• Merge to Mix: Mixing Datasets via Model Merging

  Published: 26 May, 2025 |  at  11:24 AM

  

  87.71 🤔

  本文提出*Merge to Mix*方法，通过模型合并技术作为代理，高效选择数据集混合用于大型模型微调，在图像分类和语言任务中显著优于传统方法，接近甚至部分超过Oracle性能。

• Scalable Model Merging with Progressive Layer-wise Distillation

  Published: 4 Jun, 2025 |  at  11:26 AM

  

  87.67 🤔

  本文提出ProDistill算法，通过逐层教师-学生蒸馏高效合并大型预训练模型，理论证明领域特定数据的必要性，并在视觉、语言任务上实现显著性能提升（6.14%-6.61%），展现出优越的内存和计算效率。

• Zero-Shot Vision Encoder Grafting via LLM Surrogates

  Published: 2 Jun, 2025 |  at  11:23 AM

  

  87.49 🤔

  本文提出通过构建小型代理模型训练视觉编码器并零样本嫁接至大型LLM（如Llama-70B），在保持视觉理解能力的同时将VLM训练成本降低约45%。