Tool Sharing#
Queryable allows you to perform offline fuzzy searches for photos using natural language on your phone.
Features#
Queryable is an open-source iOS application that utilizes OpenAI's CLIP model for offline searching in your photo library. It enables searching for photos using natural language sentences. It runs offline and respects your privacy.
Principle#
This tool is based on the CLIP model. The principle of CLIP involves encoding all the photos in your library using the CLIP Encoder, calculating image vectors, and saving them. For each new text query, the corresponding text vector is computed using the Text Encoder. The similarity between this text vector and each image vector is compared. The top K most similar results are ranked and returned.
The project uses the fine-tuned CLIP ViT-B/32 model, and its performance may be slightly worse when using Chinese.
Platform#
Disclaimer#
This article is solely for the purpose of sharing a tool.
This article is synchronized with Hblog.