Document (#34023)

Author

Göker, A.
Myrhaug, H.

Title

Evaluation of a mobile information system in context

Source

Information processing and management. 44(2008) no.1, S.39-65

Year

2008

Abstract

The motivation for this work has been to provide relevant information to the right situation for mobile phone users. We have iteratively developed applications for travellers and tourists to provide a general travel guide with local tourist information. This used a combination of wireless tag technology and information from content service providers. The paper presents our evaluation methodology and how we used it to develop the applications. The methodology is user centred, iterative, and progressive. It combines information retrieval (IR) evaluation methods with human-computer interaction (HCI) development techniques. Two groups of three user studies and a large survey were conducted in context with the studies scaling up to 238 participants and 438 user survey responses. The participants tested the applications in context, including the IR functions. They also filled in a pre and post questionnaire immediately before and after the system use. Some participants were additionally interviewed.

Footnote

Beitrag eines Themenbereichs: Evaluation of Interactive Information Retrieval Systems

Similar documents (content)

1. Sachse, J.: ¬The influence of snippet length on user behavior in mobile web search (2019) 0.17

   0.16752222 = sum of:
     0.16752222 = product of:
       0.59829366 = sum of:
         0.009116506 = weight(abstract_txt:with in 5493) [ClassicSimilarity], result of:
           0.009116506 = score(doc=5493,freq=1.0), product of:
             0.058351863 = queryWeight, product of:
               1.0162345 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.022970323 = queryNorm
             0.15623334 = fieldWeight in 5493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=5493)
         0.025241653 = weight(abstract_txt:provide in 5493) [ClassicSimilarity], result of:
           0.025241653 = score(doc=5493,freq=1.0), product of:
             0.100511834 = queryWeight, product of:
               1.0890042 = boost
               4.0180984 = idf(docFreq=2161, maxDocs=44218)
               0.022970323 = queryNorm
             0.25113115 = fieldWeight in 5493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0180984 = idf(docFreq=2161, maxDocs=44218)
               0.0625 = fieldNorm(doc=5493)
         0.037294105 = weight(abstract_txt:methodology in 5493) [ClassicSimilarity], result of:
           0.037294105 = score(doc=5493,freq=1.0), product of:
             0.13038635 = queryWeight, product of:
               1.2403294 = boost
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.022970323 = queryNorm
             0.28602767 = fieldWeight in 5493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.0625 = fieldNorm(doc=5493)
         0.029170575 = weight(abstract_txt:user in 5493) [ClassicSimilarity], result of:
           0.029170575 = score(doc=5493,freq=1.0), product of:
             0.12670656 = queryWeight, product of:
               1.4974976 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.022970323 = queryNorm
             0.23022151 = fieldWeight in 5493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=5493)
         0.013802304 = weight(abstract_txt:information in 5493) [ClassicSimilarity], result of:
           0.013802304 = score(doc=5493,freq=1.0), product of:
             0.09121923 = queryWeight, product of:
               1.640341 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022970323 = queryNorm
             0.15130915 = fieldWeight in 5493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=5493)
         0.32768497 = weight(abstract_txt:mobile in 5493) [ClassicSimilarity], result of:
           0.32768497 = score(doc=5493,freq=6.0), product of:
             0.3055338 = queryWeight, product of:
               1.8986747 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.022970323 = queryNorm
             1.0724999 = fieldWeight in 5493, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.0625 = fieldNorm(doc=5493)
         0.15598358 = weight(abstract_txt:participants in 5493) [ClassicSimilarity], result of:
           0.15598358 = score(doc=5493,freq=3.0), product of:
             0.26864657 = queryWeight, product of:
               2.1805058 = boost
               5.3636074 = idf(docFreq=562, maxDocs=44218)
               0.022970323 = queryNorm
             0.5806275 = fieldWeight in 5493, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.3636074 = idf(docFreq=562, maxDocs=44218)
               0.0625 = fieldNorm(doc=5493)
       0.28 = coord(7/25)
   

2. Arif, A.S.M.; Du, J.T.; Lee, I.: Understanding tourists' collaborative information retrieval behavior to inform design (2015) 0.16

   0.15854375 = sum of:
     0.15854375 = product of:
       0.7927187 = sum of:
         0.009116506 = weight(abstract_txt:with in 2327) [ClassicSimilarity], result of:
           0.009116506 = score(doc=2327,freq=1.0), product of:
             0.058351863 = queryWeight, product of:
               1.0162345 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.022970323 = queryNorm
             0.15623334 = fieldWeight in 2327, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=2327)
         0.19237304 = weight(abstract_txt:travel in 2327) [ClassicSimilarity], result of:
           0.19237304 = score(doc=2327,freq=3.0), product of:
             0.21421558 = queryWeight, product of:
               1.1241686 = boost
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.022970323 = queryNorm
             0.89803475 = fieldWeight in 2327, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.0625 = fieldNorm(doc=2327)
         0.15643492 = weight(abstract_txt:tourist in 2327) [ClassicSimilarity], result of:
           0.15643492 = score(doc=2327,freq=1.0), product of:
             0.26916453 = queryWeight, product of:
               1.2601286 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.022970323 = queryNorm
             0.581187 = fieldWeight in 2327, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0625 = fieldNorm(doc=2327)
         0.38698167 = weight(abstract_txt:tourists in 2327) [ClassicSimilarity], result of:
           0.38698167 = score(doc=2327,freq=5.0), product of:
             0.2879159 = queryWeight, product of:
               1.3032831 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.022970323 = queryNorm
             1.3440789 = fieldWeight in 2327, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=2327)
         0.047812585 = weight(abstract_txt:information in 2327) [ClassicSimilarity], result of:
           0.047812585 = score(doc=2327,freq=12.0), product of:
             0.09121923 = queryWeight, product of:
               1.640341 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022970323 = queryNorm
             0.52415025 = fieldWeight in 2327, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2327)
       0.2 = coord(5/25)
   

3. Berri, J.; Benlamri, R.: Context-aware mobile search engine (2012) 0.15

   0.15445985 = sum of:
     0.15445985 = product of:
       0.6435827 = sum of:
         0.022791265 = weight(abstract_txt:with in 104) [ClassicSimilarity], result of:
           0.022791265 = score(doc=104,freq=4.0), product of:
             0.058351863 = queryWeight, product of:
               1.0162345 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.022970323 = queryNorm
             0.39058334 = fieldWeight in 104, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=104)
         0.03646322 = weight(abstract_txt:user in 104) [ClassicSimilarity], result of:
           0.03646322 = score(doc=104,freq=1.0), product of:
             0.12670656 = queryWeight, product of:
               1.4974976 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.022970323 = queryNorm
             0.2877769 = fieldWeight in 104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.078125 = fieldNorm(doc=104)
         0.038578615 = weight(abstract_txt:information in 104) [ClassicSimilarity], result of:
           0.038578615 = score(doc=104,freq=5.0), product of:
             0.09121923 = queryWeight, product of:
               1.640341 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022970323 = queryNorm
             0.42292193 = fieldWeight in 104, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=104)
         0.14608073 = weight(abstract_txt:context in 104) [ClassicSimilarity], result of:
           0.14608073 = score(doc=104,freq=6.0), product of:
             0.17588978 = queryWeight, product of:
               1.7643586 = boost
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.022970323 = queryNorm
             0.83052427 = fieldWeight in 104, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.078125 = fieldNorm(doc=104)
         0.2896353 = weight(abstract_txt:mobile in 104) [ClassicSimilarity], result of:
           0.2896353 = score(doc=104,freq=3.0), product of:
             0.3055338 = queryWeight, product of:
               1.8986747 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.022970323 = queryNorm
             0.94796485 = fieldWeight in 104, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.078125 = fieldNorm(doc=104)
         0.110033594 = weight(abstract_txt:applications in 104) [ClassicSimilarity], result of:
           0.110033594 = score(doc=104,freq=2.0), product of:
             0.21000805 = queryWeight, product of:
               1.9279002 = boost
               4.7422485 = idf(docFreq=1047, maxDocs=44218)
               0.022970323 = queryNorm
             0.5239494 = fieldWeight in 104, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7422485 = idf(docFreq=1047, maxDocs=44218)
               0.078125 = fieldNorm(doc=104)
       0.24 = coord(6/25)
   

4. Becker, C.; Bizer, C.: DBpedia Mobile : a location-aware Semantic Web client 0.15

   0.15083642 = sum of:
     0.15083642 = product of:
       0.6284851 = sum of:
         0.012892687 = weight(abstract_txt:with in 2478) [ClassicSimilarity], result of:
           0.012892687 = score(doc=2478,freq=2.0), product of:
             0.058351863 = queryWeight, product of:
               1.0162345 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.022970323 = queryNorm
             0.22094731 = fieldWeight in 2478, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.15643492 = weight(abstract_txt:tourist in 2478) [ClassicSimilarity], result of:
           0.15643492 = score(doc=2478,freq=1.0), product of:
             0.26916453 = queryWeight, product of:
               1.2601286 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.022970323 = queryNorm
             0.581187 = fieldWeight in 2478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.029170575 = weight(abstract_txt:user in 2478) [ClassicSimilarity], result of:
           0.029170575 = score(doc=2478,freq=1.0), product of:
             0.12670656 = queryWeight, product of:
               1.4974976 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.022970323 = queryNorm
             0.23022151 = fieldWeight in 2478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.013802304 = weight(abstract_txt:information in 2478) [ClassicSimilarity], result of:
           0.013802304 = score(doc=2478,freq=1.0), product of:
             0.09121923 = queryWeight, product of:
               1.640341 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022970323 = queryNorm
             0.15130915 = fieldWeight in 2478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.35394016 = weight(abstract_txt:mobile in 2478) [ClassicSimilarity], result of:
           0.35394016 = score(doc=2478,freq=7.0), product of:
             0.3055338 = queryWeight, product of:
               1.8986747 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.022970323 = queryNorm
             1.1584321 = fieldWeight in 2478, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
         0.0622444 = weight(abstract_txt:applications in 2478) [ClassicSimilarity], result of:
           0.0622444 = score(doc=2478,freq=1.0), product of:
             0.21000805 = queryWeight, product of:
               1.9279002 = boost
               4.7422485 = idf(docFreq=1047, maxDocs=44218)
               0.022970323 = queryNorm
             0.29639053 = fieldWeight in 2478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7422485 = idf(docFreq=1047, maxDocs=44218)
               0.0625 = fieldNorm(doc=2478)
       0.24 = coord(6/25)
   

5. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.15

   0.14706211 = sum of:
     0.14706211 = product of:
       0.5252218 = sum of:
         0.019737815 = weight(abstract_txt:with in 2021) [ClassicSimilarity], result of:
           0.019737815 = score(doc=2021,freq=3.0), product of:
             0.058351863 = queryWeight, product of:
               1.0162345 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.022970323 = queryNorm
             0.3382551 = fieldWeight in 2021, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.103519626 = weight(abstract_txt:centred in 2021) [ClassicSimilarity], result of:
           0.103519626 = score(doc=2021,freq=1.0), product of:
             0.17614506 = queryWeight, product of:
               1.0193919 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.022970323 = queryNorm
             0.5876953 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.075623564 = weight(abstract_txt:studies in 2021) [ClassicSimilarity], result of:
           0.075623564 = score(doc=2021,freq=4.0), product of:
             0.11340097 = queryWeight, product of:
               1.1567229 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.022970323 = queryNorm
             0.66686875 = fieldWeight in 2021, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.06315614 = weight(abstract_txt:user in 2021) [ClassicSimilarity], result of:
           0.06315614 = score(doc=2021,freq=3.0), product of:
             0.12670656 = queryWeight, product of:
               1.4974976 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.022970323 = queryNorm
             0.49844417 = fieldWeight in 2021, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.01725288 = weight(abstract_txt:information in 2021) [ClassicSimilarity], result of:
           0.01725288 = score(doc=2021,freq=1.0), product of:
             0.09121923 = queryWeight, product of:
               1.640341 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.022970323 = queryNorm
             0.18913643 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.059637204 = weight(abstract_txt:context in 2021) [ClassicSimilarity], result of:
           0.059637204 = score(doc=2021,freq=1.0), product of:
             0.17588978 = queryWeight, product of:
               1.7643586 = boost
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.022970323 = queryNorm
             0.3390601 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.339969 = idf(docFreq=1566, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.18629454 = weight(abstract_txt:evaluation in 2021) [ClassicSimilarity], result of:
           0.18629454 = score(doc=2021,freq=8.0), product of:
             0.18793133 = queryWeight, product of:
               1.8237536 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.022970323 = queryNorm
             0.9912905 = fieldWeight in 2021, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
       0.28 = coord(7/25)