Document (#41578)

Author

Li, H.
Wu, H.
Li, D.
Lin, S.
Su, Z.
Luo, X.

Title

PSI: A probabilistic semantic interpretable framework for fine-grained image ranking

Source

Journal of the Association for Information Science and Technology. 69(2018) no.12, S.1488-1501

Year

2018

Abstract

Image Ranking is one of the key problems in information science research area. However, most current methods focus on increasing the performance, leaving the semantic gap problem, which refers to the learned ranking models are hard to be understood, remaining intact. Therefore, in this article, we aim at learning an interpretable ranking model to tackle the semantic gap in fine-grained image ranking. We propose to combine attribute-based representation and online passive-aggressive (PA) learning based ranking models to achieve this goal. Besides, considering the highly localized instances in fine-grained image ranking, we introduce a supervised constrained clustering method to gather class-balanced training instances for local PA-based models, and incorporate the learned local models into a unified probabilistic framework. Extensive experiments on the benchmark demonstrate that the proposed framework outperforms state-of-the-art methods in terms of accuracy and speed.

Content

https://onlinelibrary.wiley.com/doi/10.1002/asi.24068.

Theme

Retrievalalgorithmen

Form

Bilder

Similar documents (content)

1. Chen, Z.; Huang, Y.; Tian, J.; Liu, X.; Fu, K.; Huang, T.: Joint model for subsentence-level sentiment analysis with Markov logic (2015) 0.19

   0.18856823 = sum of:
     0.18856823 = product of:
       0.673458 = sum of:
         0.05556756 = weight(abstract_txt:tackle in 2210) [ClassicSimilarity], result of:
           0.05556756 = score(doc=2210,freq=1.0), product of:
             0.11745178 = queryWeight, product of:
               1.0417945 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.014893468 = queryNorm
             0.47310954 = fieldWeight in 2210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.0625 = fieldNorm(doc=2210)
         0.027474293 = weight(abstract_txt:learning in 2210) [ClassicSimilarity], result of:
           0.027474293 = score(doc=2210,freq=1.0), product of:
             0.09252798 = queryWeight, product of:
               1.307687 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.014893468 = queryNorm
             0.29692957 = fieldWeight in 2210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.0625 = fieldNorm(doc=2210)
         0.0365061 = weight(abstract_txt:local in 2210) [ClassicSimilarity], result of:
           0.0365061 = score(doc=2210,freq=1.0), product of:
             0.111831896 = queryWeight, product of:
               1.43764 = boost
               5.2229967 = idf(docFreq=647, maxDocs=44218)
               0.014893468 = queryNorm
             0.3264373 = fieldWeight in 2210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2229967 = idf(docFreq=647, maxDocs=44218)
               0.0625 = fieldNorm(doc=2210)
         0.03622348 = weight(abstract_txt:framework in 2210) [ClassicSimilarity], result of:
           0.03622348 = score(doc=2210,freq=1.0), product of:
             0.127354 = queryWeight, product of:
               1.8789672 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.014893468 = queryNorm
             0.28443143 = fieldWeight in 2210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=2210)
         0.051242724 = weight(abstract_txt:models in 2210) [ClassicSimilarity], result of:
           0.051242724 = score(doc=2210,freq=1.0), product of:
             0.17663911 = queryWeight, product of:
               2.5552049 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.014893468 = queryNorm
             0.2900984 = fieldWeight in 2210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=2210)
         0.20168756 = weight(abstract_txt:fine in 2210) [ClassicSimilarity], result of:
           0.20168756 = score(doc=2210,freq=2.0), product of:
             0.31753764 = queryWeight, product of:
               2.966952 = boost
               7.1860275 = idf(docFreq=90, maxDocs=44218)
               0.014893468 = queryNorm
             0.6351611 = fieldWeight in 2210, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1860275 = idf(docFreq=90, maxDocs=44218)
               0.0625 = fieldNorm(doc=2210)
         0.26475623 = weight(abstract_txt:grained in 2210) [ClassicSimilarity], result of:
           0.26475623 = score(doc=2210,freq=2.0), product of:
             0.3806916 = queryWeight, product of:
               3.2486248 = boost
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.014893468 = queryNorm
             0.6954612 = fieldWeight in 2210, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.0625 = fieldNorm(doc=2210)
       0.28 = coord(7/25)
   

2. Li, M.; Li, H.; Zhou, Z.-H.: Semi-supervised document retrieval (2009) 0.18

   0.18370773 = sum of:
     0.18370773 = product of:
       0.57408667 = sum of:
         0.050141167 = weight(abstract_txt:benchmark in 4218) [ClassicSimilarity], result of:
           0.050141167 = score(doc=4218,freq=1.0), product of:
             0.10967518 = queryWeight, product of:
               1.0067148 = boost
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.014893468 = queryNorm
             0.4571788 = fieldWeight in 4218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.0625 = fieldNorm(doc=4218)
         0.09222293 = weight(abstract_txt:supervised in 4218) [ClassicSimilarity], result of:
           0.09222293 = score(doc=4218,freq=3.0), product of:
             0.114155695 = queryWeight, product of:
               1.0270724 = boost
               7.462781 = idf(docFreq=68, maxDocs=44218)
               0.014893468 = queryNorm
             0.80786973 = fieldWeight in 4218, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.462781 = idf(docFreq=68, maxDocs=44218)
               0.0625 = fieldNorm(doc=4218)
         0.036539312 = weight(abstract_txt:methods in 4218) [ClassicSimilarity], result of:
           0.036539312 = score(doc=4218,freq=4.0), product of:
             0.0704924 = queryWeight, product of:
               1.1414015 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.014893468 = queryNorm
             0.518344 = fieldWeight in 4218, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=4218)
         0.072690144 = weight(abstract_txt:learning in 4218) [ClassicSimilarity], result of:
           0.072690144 = score(doc=4218,freq=7.0), product of:
             0.09252798 = queryWeight, product of:
               1.307687 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.014893468 = queryNorm
             0.7856018 = fieldWeight in 4218, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.0625 = fieldNorm(doc=4218)
         0.012451536 = weight(abstract_txt:based in 4218) [ClassicSimilarity], result of:
           0.012451536 = score(doc=4218,freq=1.0), product of:
             0.06249344 = queryWeight, product of:
               1.316225 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.014893468 = queryNorm
             0.19924548 = fieldWeight in 4218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=4218)
         0.03622348 = weight(abstract_txt:framework in 4218) [ClassicSimilarity], result of:
           0.03622348 = score(doc=4218,freq=1.0), product of:
             0.127354 = queryWeight, product of:
               1.8789672 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.014893468 = queryNorm
             0.28443143 = fieldWeight in 4218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=4218)
         0.051242724 = weight(abstract_txt:models in 4218) [ClassicSimilarity], result of:
           0.051242724 = score(doc=4218,freq=1.0), product of:
             0.17663911 = queryWeight, product of:
               2.5552049 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.014893468 = queryNorm
             0.2900984 = fieldWeight in 4218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=4218)
         0.2225754 = weight(abstract_txt:ranking in 4218) [ClassicSimilarity], result of:
           0.2225754 = score(doc=4218,freq=2.0), product of:
             0.44976553 = queryWeight, product of:
               5.3937945 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.014893468 = queryNorm
             0.49486983 = fieldWeight in 4218, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=4218)
       0.32 = coord(8/25)
   

3. Li, W.; Zheng, Y.; Zhan, Y.; Feng, R.; Zhang, T.; Fan, W.: Cross-modal retrieval with dual multi-angle self-attention (2021) 0.16

   0.16320248 = sum of:
     0.16320248 = product of:
       0.6800103 = sum of:
         0.050141167 = weight(abstract_txt:benchmark in 67) [ClassicSimilarity], result of:
           0.050141167 = score(doc=67,freq=1.0), product of:
             0.10967518 = queryWeight, product of:
               1.0067148 = boost
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.014893468 = queryNorm
             0.4571788 = fieldWeight in 67, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.314861 = idf(docFreq=79, maxDocs=44218)
               0.0625 = fieldNorm(doc=67)
         0.018269656 = weight(abstract_txt:methods in 67) [ClassicSimilarity], result of:
           0.018269656 = score(doc=67,freq=1.0), product of:
             0.0704924 = queryWeight, product of:
               1.1414015 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.014893468 = queryNorm
             0.259172 = fieldWeight in 67, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=67)
         0.0344254 = weight(abstract_txt:semantic in 67) [ClassicSimilarity], result of:
           0.0344254 = score(doc=67,freq=1.0), product of:
             0.1231039 = queryWeight, product of:
               1.8473485 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.014893468 = queryNorm
             0.2796451 = fieldWeight in 67, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=67)
         0.051227733 = weight(abstract_txt:framework in 67) [ClassicSimilarity], result of:
           0.051227733 = score(doc=67,freq=2.0), product of:
             0.127354 = queryWeight, product of:
               1.8789672 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.014893468 = queryNorm
             0.40224677 = fieldWeight in 67, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=67)
         0.20168756 = weight(abstract_txt:fine in 67) [ClassicSimilarity], result of:
           0.20168756 = score(doc=67,freq=2.0), product of:
             0.31753764 = queryWeight, product of:
               2.966952 = boost
               7.1860275 = idf(docFreq=90, maxDocs=44218)
               0.014893468 = queryNorm
             0.6351611 = fieldWeight in 67, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1860275 = idf(docFreq=90, maxDocs=44218)
               0.0625 = fieldNorm(doc=67)
         0.32425883 = weight(abstract_txt:grained in 67) [ClassicSimilarity], result of:
           0.32425883 = score(doc=67,freq=3.0), product of:
             0.3806916 = queryWeight, product of:
               3.2486248 = boost
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.014893468 = queryNorm
             0.85176253 = fieldWeight in 67, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.0625 = fieldNorm(doc=67)
       0.24 = coord(6/25)
   

4. Tan, X.; Luo, X.; Wang, X.; Wang, H.; Hou, X.: Representation and display of digital images of cultural heritage : a semantic enrichment approach (2021) 0.16

   0.16319643 = sum of:
     0.16319643 = product of:
       0.67998517 = sum of:
         0.018269656 = weight(abstract_txt:methods in 455) [ClassicSimilarity], result of:
           0.018269656 = score(doc=455,freq=1.0), product of:
             0.0704924 = queryWeight, product of:
               1.1414015 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.014893468 = queryNorm
             0.259172 = fieldWeight in 455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.012451536 = weight(abstract_txt:based in 455) [ClassicSimilarity], result of:
           0.012451536 = score(doc=455,freq=1.0), product of:
             0.06249344 = queryWeight, product of:
               1.316225 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.014893468 = queryNorm
             0.19924548 = fieldWeight in 455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.1032762 = weight(abstract_txt:semantic in 455) [ClassicSimilarity], result of:
           0.1032762 = score(doc=455,freq=9.0), product of:
             0.1231039 = queryWeight, product of:
               1.8473485 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.014893468 = queryNorm
             0.83893526 = fieldWeight in 455, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.07954397 = weight(abstract_txt:image in 455) [ClassicSimilarity], result of:
           0.07954397 = score(doc=455,freq=1.0), product of:
             0.23681192 = queryWeight, product of:
               2.958585 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.014893468 = queryNorm
             0.33589512 = fieldWeight in 455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.20168756 = weight(abstract_txt:fine in 455) [ClassicSimilarity], result of:
           0.20168756 = score(doc=455,freq=2.0), product of:
             0.31753764 = queryWeight, product of:
               2.966952 = boost
               7.1860275 = idf(docFreq=90, maxDocs=44218)
               0.014893468 = queryNorm
             0.6351611 = fieldWeight in 455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1860275 = idf(docFreq=90, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
         0.26475623 = weight(abstract_txt:grained in 455) [ClassicSimilarity], result of:
           0.26475623 = score(doc=455,freq=2.0), product of:
             0.3806916 = queryWeight, product of:
               3.2486248 = boost
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.014893468 = queryNorm
             0.6954612 = fieldWeight in 455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.0625 = fieldNorm(doc=455)
       0.24 = coord(6/25)
   

5. Luo, L.; Ju, J.; Li, Y.-F.; Haffari, G.; Xiong, B.; Pan, S.: ChatRule: mining logical rules with large language models for knowledge graph reasoning (2023) 0.15

   0.15157634 = sum of:
     0.15157634 = product of:
       0.54134405 = sum of:
         0.018269656 = weight(abstract_txt:methods in 1171) [ClassicSimilarity], result of:
           0.018269656 = score(doc=1171,freq=1.0), product of:
             0.0704924 = queryWeight, product of:
               1.1414015 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.014893468 = queryNorm
             0.259172 = fieldWeight in 1171, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=1171)
         0.012451536 = weight(abstract_txt:based in 1171) [ClassicSimilarity], result of:
           0.012451536 = score(doc=1171,freq=1.0), product of:
             0.06249344 = queryWeight, product of:
               1.316225 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.014893468 = queryNorm
             0.19924548 = fieldWeight in 1171, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=1171)
         0.0344254 = weight(abstract_txt:semantic in 1171) [ClassicSimilarity], result of:
           0.0344254 = score(doc=1171,freq=1.0), product of:
             0.1231039 = queryWeight, product of:
               1.8473485 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.014893468 = queryNorm
             0.2796451 = fieldWeight in 1171, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=1171)
         0.051227733 = weight(abstract_txt:framework in 1171) [ClassicSimilarity], result of:
           0.051227733 = score(doc=1171,freq=2.0), product of:
             0.127354 = queryWeight, product of:
               1.8789672 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.014893468 = queryNorm
             0.40224677 = fieldWeight in 1171, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=1171)
         0.19511698 = weight(abstract_txt:interpretable in 1171) [ClassicSimilarity], result of:
           0.19511698 = score(doc=1171,freq=1.0), product of:
             0.341863 = queryWeight, product of:
               2.5135837 = boost
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.014893468 = queryNorm
             0.5707461 = fieldWeight in 1171, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.0625 = fieldNorm(doc=1171)
         0.072468154 = weight(abstract_txt:models in 1171) [ClassicSimilarity], result of:
           0.072468154 = score(doc=1171,freq=2.0), product of:
             0.17663911 = queryWeight, product of:
               2.5552049 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.014893468 = queryNorm
             0.4102611 = fieldWeight in 1171, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=1171)
         0.15738457 = weight(abstract_txt:ranking in 1171) [ClassicSimilarity], result of:
           0.15738457 = score(doc=1171,freq=1.0), product of:
             0.44976553 = queryWeight, product of:
               5.3937945 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.014893468 = queryNorm
             0.34992582 = fieldWeight in 1171, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=1171)
       0.28 = coord(7/25)