Vision-Language Models for Filtering and Clustering Forensic Data

Axel Weißenfeld; David Weichselbaum; Christopher Wimmer; Martina Tschapka; Bernhard Strobl

Vision-Language Models for Filtering and Clustering Forensic Data

Axel Weißenfeld, David Weichselbaum, Christopher Wimmer, Martina Tschapka, Bernhard Strobl

Data Science & Artifical Intelligence

T3K-Forensics GmbH

Research output: Chapter in Book or Conference Proceedings › Conference Proceedings with Oral Presentation › peer-review

Abstract

With image- and video-capable devices in the hands of a majority of the population worldwide, the amount of media data keeps growing. Hence, the search of specific images and clustering of datasets is of great importance to extract the relevant information, e.g. search for a specific person by legal enforcement agencies (LEAs). This paper presents a new tool which uses vision-language models to filter and cluster forensic data. The tool provides a GUI, which enables a flexible search by accepting textual as well as image input, to search large amounts of data in near real-time.

Original language	English
Title of host publication	Proceedings of the OAGM Workshop 2022
Subtitle of host publication	Digitalization for Smart Farming and Forestry
Editors	Hermann Bürstmayr, Andreas Gronauer, Andreas Holzinger, Peter M. Roth, Karl Stampfer
Pages	82-84
Publication status	Published - 2022
Event	ÖAGM - Austrian Association for Pattern recognition - Duration: 18 Oct 2022 → …

Other

Other	ÖAGM - Austrian Association for Pattern recognition
Period	18/10/22 → …

Research Field

Former Research Field - Data Science
Former Research Field - Surveillance and Protection

Access to Document

https://workshops.aapr.at/Documents/proceedings.pdf

Cite this

Weißenfeld, A., Weichselbaum, D., Wimmer, C., Tschapka, M., & Strobl, B. (2022). Vision-Language Models for Filtering and Clustering Forensic Data. In H. Bürstmayr, A. Gronauer, A. Holzinger, P. M. Roth, & K. Stampfer (Eds.), Proceedings of the OAGM Workshop 2022: Digitalization for Smart Farming and Forestry (pp. 82-84) https://workshops.aapr.at/Documents/proceedings.pdf

@inproceedings{affe121ffecf453eb510a348abe39684,

title = "Vision-Language Models for Filtering and Clustering Forensic Data",

abstract = "With image- and video-capable devices in the hands of a majority of the population worldwide, the amount of media data keeps growing. Hence, the search of specific images and clustering of datasets is of great importance to extract the relevant information, e.g. search for a specific person by legal enforcement agencies (LEAs). This paper presents a new tool which uses vision-language models to filter and cluster forensic data. The tool provides a GUI, which enables a flexible search by accepting textual as well as image input, to search large amounts of data in near real-time.",

author = "Axel Wei{\ss}enfeld and David Weichselbaum and Christopher Wimmer and Martina Tschapka and Bernhard Strobl",

year = "2022",

language = "English",

pages = "82--84",

editor = "Hermann B{\"u}rstmayr and Andreas Gronauer and Andreas Holzinger and Roth, {Peter M.} and Karl Stampfer",

booktitle = "Proceedings of the OAGM Workshop 2022",

note = "{\"O}AGM - Austrian Association for Pattern recognition ; Conference date: 18-10-2022",

}

Weißenfeld, A, Weichselbaum, D, Wimmer, C, Tschapka, M & Strobl, B 2022, Vision-Language Models for Filtering and Clustering Forensic Data. in H Bürstmayr, A Gronauer, A Holzinger, PM Roth & K Stampfer (eds), Proceedings of the OAGM Workshop 2022: Digitalization for Smart Farming and Forestry. pp. 82-84, ÖAGM - Austrian Association for Pattern recognition, 18/10/22. <https://workshops.aapr.at/Documents/proceedings.pdf>

Vision-Language Models for Filtering and Clustering Forensic Data. / Weißenfeld, Axel; Weichselbaum, David; Wimmer, Christopher et al.
Proceedings of the OAGM Workshop 2022: Digitalization for Smart Farming and Forestry. ed. / Hermann Bürstmayr; Andreas Gronauer; Andreas Holzinger; Peter M. Roth; Karl Stampfer. 2022. p. 82-84.

Research output: Chapter in Book or Conference Proceedings › Conference Proceedings with Oral Presentation › peer-review

TY - GEN

T1 - Vision-Language Models for Filtering and Clustering Forensic Data

AU - Weißenfeld, Axel

AU - Weichselbaum, David

AU - Wimmer, Christopher

AU - Tschapka, Martina

AU - Strobl, Bernhard

PY - 2022

Y1 - 2022

N2 - With image- and video-capable devices in the hands of a majority of the population worldwide, the amount of media data keeps growing. Hence, the search of specific images and clustering of datasets is of great importance to extract the relevant information, e.g. search for a specific person by legal enforcement agencies (LEAs). This paper presents a new tool which uses vision-language models to filter and cluster forensic data. The tool provides a GUI, which enables a flexible search by accepting textual as well as image input, to search large amounts of data in near real-time.

AB - With image- and video-capable devices in the hands of a majority of the population worldwide, the amount of media data keeps growing. Hence, the search of specific images and clustering of datasets is of great importance to extract the relevant information, e.g. search for a specific person by legal enforcement agencies (LEAs). This paper presents a new tool which uses vision-language models to filter and cluster forensic data. The tool provides a GUI, which enables a flexible search by accepting textual as well as image input, to search large amounts of data in near real-time.

M3 - Conference Proceedings with Oral Presentation

SP - 82

EP - 84

BT - Proceedings of the OAGM Workshop 2022

A2 - Bürstmayr, Hermann

A2 - Gronauer, Andreas

A2 - Holzinger, Andreas

A2 - Roth, Peter M.

A2 - Stampfer, Karl

T2 - ÖAGM - Austrian Association for Pattern recognition

Y2 - 18 October 2022

ER -

Vision-Language Models for Filtering and Clustering Forensic Data

Abstract

Other

Research Field

Access to Document

Fingerprint

Cite this