Meta-Radiology (Nov 2023)

Review of large vision models and visual prompt engineering

  • Jiaqi Wang,
  • Zhengliang Liu,
  • Lin Zhao,
  • Zihao Wu,
  • Chong Ma,
  • Sigang Yu,
  • Haixing Dai,
  • Qiushi Yang,
  • Yiheng Liu,
  • Songyao Zhang,
  • Enze Shi,
  • Yi Pan,
  • Tuo Zhang,
  • Dajiang Zhu,
  • Xiang Li,
  • Xi Jiang,
  • Bao Ge,
  • Yixuan Yuan,
  • Dinggang Shen,
  • Tianming Liu,
  • Shu Zhang

Journal volume & issue
Vol. 1, no. 3
p. 100047

Abstract

Read online

Visual prompt engineering is a fundamental methodology in the field of visual and image artificial general intelligence. As the development of large vision models progresses, the importance of prompt engineering becomes increasingly evident. Designing suitable prompts for specific visual tasks has emerged as a meaningful research direction. This review aims to summarize the methods employed in the computer vision domain for large vision models and visual prompt engineering, exploring the latest advancements in visual prompt engineering. We present influential large models in the visual domain and a range of prompt engineering methods employed on these models. It is our hope that this review provides a comprehensive and systematic description of prompt engineering methods based on large visual models, offering valuable insights for future researchers in their exploration of this field.

Keywords