Document (#43498)

Author

Tavakoli, L.
Zamani, H.
Scholer, F.
Croft, W.B.
Sanderson, M.

Title

Analyzing clarification in asynchronous information-seeking conversations

Source

Journal of the Association for Information Science and Technology. 73(2022) no.3, S.449-471

Year

2022

Abstract

This research analyzes human-generated clarification questions to provide insights into how they are used to disambiguate and provide a better understanding of information needs. A set of clarification questions is extracted from posts on the Stack Exchange platform. Novel taxonomy is defined for the annotation of the questions and their responses. We investigate the clarification questions in terms of whether they add any information to the post (the initial question posted by the asker) and the accepted answer, which is the answer chosen by the asker. After identifying, which clarification questions are more useful, we investigated the characteristics of these questions in terms of their types and patterns. Non-useful clarification questions are identified, and their patterns are compared with useful clarifications. Our analysis indicates that the most useful clarification questions have similar patterns, regardless of topic. This research contributes to an understanding of clarification in conversations and can provide insight for clarification dialogues in conversational search scenarios and for the possible system generation of clarification requests in information-seeking conversations.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24562.

Similar documents (author)

1. Sanderson, M.: ¬The Reuters test collection (1996) 0.97

   0.9712542 = sum of:
     0.9712542 = product of:
       2.9137626 = sum of:
         2.9137626 = weight(author_txt:sanderson in 6971) [ClassicSimilarity], result of:
           2.9137626 = score(doc=6971,freq=1.0), product of:
             0.54172724 = queryWeight, product of:
               1.0712681 = boost
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.058760975 = queryNorm
             5.3786526 = fieldWeight in 6971, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.625 = fieldNorm(doc=6971)
       0.33333334 = coord(1/3)
   

2. Sanderson, M.: Revisiting h measured on UK LIS and IR academics (2008) 0.97

   0.9712542 = sum of:
     0.9712542 = product of:
       2.9137626 = sum of:
         2.9137626 = weight(author_txt:sanderson in 1867) [ClassicSimilarity], result of:
           2.9137626 = score(doc=1867,freq=1.0), product of:
             0.54172724 = queryWeight, product of:
               1.0712681 = boost
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.058760975 = queryNorm
             5.3786526 = fieldWeight in 1867, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.625 = fieldNorm(doc=1867)
       0.33333334 = coord(1/3)
   

3. Scholer, F.; Williams, H.E.; Turpin, A.: Query association surrogates for Web search (2004) 0.85

   0.84771156 = sum of:
     0.84771156 = product of:
       2.5431347 = sum of:
         2.5431347 = weight(author_txt:scholer in 2236) [ClassicSimilarity], result of:
           2.5431347 = score(doc=2236,freq=1.0), product of:
             0.69548845 = queryWeight, product of:
               1.2138158 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.058760975 = queryNorm
             3.6566167 = fieldWeight in 2236, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.375 = fieldNorm(doc=2236)
       0.33333334 = coord(1/3)
   

4. Bando, L.L.; Scholer, F.; Turpin, A.: Query-biased summary generation assisted by query expansion : temporality (2015) 0.85

   0.84771156 = sum of:
     0.84771156 = product of:
       2.5431347 = sum of:
         2.5431347 = weight(author_txt:scholer in 1820) [ClassicSimilarity], result of:
           2.5431347 = score(doc=1820,freq=1.0), product of:
             0.69548845 = queryWeight, product of:
               1.2138158 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.058760975 = queryNorm
             3.6566167 = fieldWeight in 1820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.375 = fieldNorm(doc=1820)
       0.33333334 = coord(1/3)
   

5. Croft, W.B.: Approaches to intelligent information retrieval (1987) 0.79

   0.79002064 = sum of:
     0.79002064 = product of:
       2.3700619 = sum of:
         2.3700619 = weight(author_txt:croft in 1094) [ClassicSimilarity], result of:
           2.3700619 = score(doc=1094,freq=1.0), product of:
             0.47204602 = queryWeight, product of:
               8.033325 = idf(docFreq=38, maxDocs=44218)
               0.058760975 = queryNorm
             5.0208282 = fieldWeight in 1094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.033325 = idf(docFreq=38, maxDocs=44218)
               0.625 = fieldNorm(doc=1094)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Raskutti, B.; Zukerman, I.: Generating queries and replies during information-seeking interactions (1997) 0.22

   0.22418301 = sum of:
     0.22418301 = product of:
       0.93409586 = sum of:
         0.010632005 = weight(abstract_txt:they in 1662) [ClassicSimilarity], result of:
           0.010632005 = score(doc=1662,freq=1.0), product of:
             0.03627084 = queryWeight, product of:
               1.0925239 = boost
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.008848285 = queryNorm
             0.29312816 = fieldWeight in 1662, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.078125 = fieldNorm(doc=1662)
         0.0674794 = weight(abstract_txt:dialogues in 1662) [ClassicSimilarity], result of:
           0.0674794 = score(doc=1662,freq=1.0), product of:
             0.09868511 = queryWeight, product of:
               1.2742745 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.008848285 = queryNorm
             0.683785 = fieldWeight in 1662, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.078125 = fieldNorm(doc=1662)
         0.011424259 = weight(abstract_txt:information in 1662) [ClassicSimilarity], result of:
           0.011424259 = score(doc=1662,freq=4.0), product of:
             0.030201107 = queryWeight, product of:
               1.4098685 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.008848285 = queryNorm
             0.37827286 = fieldWeight in 1662, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=1662)
         0.026547682 = weight(abstract_txt:seeking in 1662) [ClassicSimilarity], result of:
           0.026547682 = score(doc=1662,freq=1.0), product of:
             0.06675727 = queryWeight, product of:
               1.4821817 = boost
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.008848285 = queryNorm
             0.39767477 = fieldWeight in 1662, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.078125 = fieldNorm(doc=1662)
         0.0416801 = weight(abstract_txt:answer in 1662) [ClassicSimilarity], result of:
           0.0416801 = score(doc=1662,freq=1.0), product of:
             0.09017788 = queryWeight, product of:
               1.7226703 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.008848285 = queryNorm
             0.46219873 = fieldWeight in 1662, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.078125 = fieldNorm(doc=1662)
         0.77633244 = weight(abstract_txt:clarification in 1662) [ClassicSimilarity], result of:
           0.77633244 = score(doc=1662,freq=2.0), product of:
             0.8599885 = queryWeight, product of:
               11.895521 = boost
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.008848285 = queryNorm
             0.9027242 = fieldWeight in 1662, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.078125 = fieldNorm(doc=1662)
       0.24 = coord(6/25)
   

2. Sowa, J.F.: Top-level ontological categories (1995) 0.15

   0.15063207 = sum of:
     0.15063207 = product of:
       0.9414505 = sum of:
         0.0133317355 = weight(abstract_txt:their in 4743) [ClassicSimilarity], result of:
           0.0133317355 = score(doc=4743,freq=1.0), product of:
             0.038578946 = queryWeight, product of:
               1.3799806 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.008848285 = queryNorm
             0.34557024 = fieldWeight in 4743, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.109375 = fieldNorm(doc=4743)
         0.027421648 = weight(abstract_txt:provide in 4743) [ClassicSimilarity], result of:
           0.027421648 = score(doc=4743,freq=1.0), product of:
             0.062395737 = queryWeight, product of:
               1.7549924 = boost
               4.0180984 = idf(docFreq=2161, maxDocs=44218)
               0.008848285 = queryNorm
             0.4394795 = fieldWeight in 4743, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0180984 = idf(docFreq=2161, maxDocs=44218)
               0.109375 = fieldNorm(doc=4743)
         0.13216719 = weight(abstract_txt:questions in 4743) [ClassicSimilarity], result of:
           0.13216719 = score(doc=4743,freq=1.0), product of:
             0.24688682 = queryWeight, product of:
               5.7007384 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.008848285 = queryNorm
             0.5353351 = fieldWeight in 4743, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.109375 = fieldNorm(doc=4743)
         0.7685299 = weight(abstract_txt:clarification in 4743) [ClassicSimilarity], result of:
           0.7685299 = score(doc=4743,freq=1.0), product of:
             0.8599885 = queryWeight, product of:
               11.895521 = boost
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.008848285 = queryNorm
             0.89365137 = fieldWeight in 4743, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.109375 = fieldNorm(doc=4743)
       0.16 = coord(4/25)
   

3. Solomon, P.: Conversation in information seeking contexts : a test of an analytical framework (1997) 0.13

   0.13325447 = sum of:
     0.13325447 = product of:
       0.555227 = sum of:
         0.058163922 = weight(abstract_txt:conversational in 503) [ClassicSimilarity], result of:
           0.058163922 = score(doc=503,freq=1.0), product of:
             0.08937992 = queryWeight, product of:
               1.2127105 = boost
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.008848285 = queryNorm
             0.6507493 = fieldWeight in 503, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.078125 = fieldNorm(doc=503)
         0.0674794 = weight(abstract_txt:dialogues in 503) [ClassicSimilarity], result of:
           0.0674794 = score(doc=503,freq=1.0), product of:
             0.09868511 = queryWeight, product of:
               1.2742745 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.008848285 = queryNorm
             0.683785 = fieldWeight in 503, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.078125 = fieldNorm(doc=503)
         0.009522668 = weight(abstract_txt:their in 503) [ClassicSimilarity], result of:
           0.009522668 = score(doc=503,freq=1.0), product of:
             0.038578946 = queryWeight, product of:
               1.3799806 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.008848285 = queryNorm
             0.24683589 = fieldWeight in 503, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.078125 = fieldNorm(doc=503)
         0.013991804 = weight(abstract_txt:information in 503) [ClassicSimilarity], result of:
           0.013991804 = score(doc=503,freq=6.0), product of:
             0.030201107 = queryWeight, product of:
               1.4098685 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.008848285 = queryNorm
             0.46328777 = fieldWeight in 503, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=503)
         0.059362423 = weight(abstract_txt:seeking in 503) [ClassicSimilarity], result of:
           0.059362423 = score(doc=503,freq=5.0), product of:
             0.06675727 = queryWeight, product of:
               1.4821817 = boost
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.008848285 = queryNorm
             0.88922787 = fieldWeight in 503, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.078125 = fieldNorm(doc=503)
         0.34670678 = weight(abstract_txt:conversations in 503) [ClassicSimilarity], result of:
           0.34670678 = score(doc=503,freq=5.0), product of:
             0.2478351 = queryWeight, product of:
               3.497673 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.008848285 = queryNorm
             1.3989414 = fieldWeight in 503, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.078125 = fieldNorm(doc=503)
       0.24 = coord(6/25)
   

4. Tunkelang, D.: Dynamic category sets : an approach for faceted search (2006) 0.13

   0.12853728 = sum of:
     0.12853728 = product of:
       0.64268637 = sum of:
         0.013310767 = weight(abstract_txt:terms in 3082) [ClassicSimilarity], result of:
           0.013310767 = score(doc=3082,freq=1.0), product of:
             0.0421324 = queryWeight, product of:
               1.1774982 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.008848285 = queryNorm
             0.3159271 = fieldWeight in 3082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.078125 = fieldNorm(doc=3082)
         0.06519091 = weight(abstract_txt:disambiguate in 3082) [ClassicSimilarity], result of:
           0.06519091 = score(doc=3082,freq=1.0), product of:
             0.096441105 = queryWeight, product of:
               1.2597033 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.008848285 = queryNorm
             0.675966 = fieldWeight in 3082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.078125 = fieldNorm(doc=3082)
         0.009522668 = weight(abstract_txt:their in 3082) [ClassicSimilarity], result of:
           0.009522668 = score(doc=3082,freq=1.0), product of:
             0.038578946 = queryWeight, product of:
               1.3799806 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.008848285 = queryNorm
             0.24683589 = fieldWeight in 3082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.078125 = fieldNorm(doc=3082)
         0.0057121296 = weight(abstract_txt:information in 3082) [ClassicSimilarity], result of:
           0.0057121296 = score(doc=3082,freq=1.0), product of:
             0.030201107 = queryWeight, product of:
               1.4098685 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.008848285 = queryNorm
             0.18913643 = fieldWeight in 3082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=3082)
         0.5489499 = weight(abstract_txt:clarification in 3082) [ClassicSimilarity], result of:
           0.5489499 = score(doc=3082,freq=1.0), product of:
             0.8599885 = queryWeight, product of:
               11.895521 = boost
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.008848285 = queryNorm
             0.63832235 = fieldWeight in 3082, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.078125 = fieldNorm(doc=3082)
       0.2 = coord(5/25)
   

5. Ponelis, S.; Fairer-Wessels, F.A.: Knowledge management : a literatur overview (1998) 0.11

   0.10950506 = sum of:
     0.10950506 = product of:
       0.91254216 = sum of:
         0.021297226 = weight(abstract_txt:terms in 2921) [ClassicSimilarity], result of:
           0.021297226 = score(doc=2921,freq=1.0), product of:
             0.0421324 = queryWeight, product of:
               1.1774982 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.008848285 = queryNorm
             0.5054833 = fieldWeight in 2921, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.125 = fieldNorm(doc=2921)
         0.012925074 = weight(abstract_txt:information in 2921) [ClassicSimilarity], result of:
           0.012925074 = score(doc=2921,freq=2.0), product of:
             0.030201107 = queryWeight, product of:
               1.4098685 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.008848285 = queryNorm
             0.4279669 = fieldWeight in 2921, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.125 = fieldNorm(doc=2921)
         0.87831986 = weight(abstract_txt:clarification in 2921) [ClassicSimilarity], result of:
           0.87831986 = score(doc=2921,freq=1.0), product of:
             0.8599885 = queryWeight, product of:
               11.895521 = boost
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.008848285 = queryNorm
             1.0213158 = fieldWeight in 2921, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.125 = fieldNorm(doc=2921)
       0.12 = coord(3/25)