< Back to previous page

Patent

Method for evaluating an image

A computer-implemented searching method for evaluating an image in dependence on a multimodal query is disclosed. The method comprises receiving a multimodal query comprising a query image and a query modifier (e.g., query text). The query modifier modifies the query image or adds attributes to the query image. The query image comprises at least one query image fragment, each of the at least one query image fragment having a corresponding query image fragment intermodal representation in a multimodal space. The query modifier comprises at least one query modifier fragment, each of the at least one query modifier fragment having a corresponding query modifier fragment intermodal representation in the multimodal space. The method comprises receiving a candidate image comprising at least one candidate image fragment, each of the at least one candidate image fragment having a corresponding candidate image fragment intermodal representation in the multimodal space. The method comprises calculating a first similarity between the query image and the candidate image in dependence upon at least one query image fragment intermodal representation and at least one candidate image fragment intermodal representation. The method comprises calculating a second similarity between the query modifier and the candidate image in dependence upon at least one query modifier fragment intermodal representation and at least one candidate image fragment intermodal representation. The method comprises calculating an overall similarity between the multimodal query and the candidate image in dependence upon the first similarity and the second similarity.
Patent Publication Number: WO2019011936
Source: WIPO
Year filing: 2018
Year approval: 2020
Year publication: 2019
Status: Requested
Validated for IOF-key: Yes
Attributed to: Associatie KULeuven