Document (#43964)

Author

Belitz, C.
Ocumpaugh, J.
Ritter, S.
Baker, R.S.
Fancsali, S.E.
Bosch, N.

Title

Constructing categories : moving beyond protected classes in algorithmic fairness

Source

Journal of the Association for Information Science and Technology. 74(2023) no.6, S.663-668

Year

2023

Series

Opinion paper

Abstract

Automated, data-driven decision making is increasingly common in a variety of application domains. In educational software, for example, machine learning has been applied to tasks like selecting the next exercise for students to complete. Machine learning methods, however, are not always equally effective for all groups of students. Current approaches to designing fair algorithms tend to focus on statistical measures concerning a small subset of legally protected categories like race or gender. Focusing solely on legally protected categories, however, can limit our understanding of bias and unfairness by ignoring the complexities of identity. We propose an alternative approach to categorization, grounded in sociological techniques of measuring identity. By soliciting survey data and interviews from the population being studied, we can build context-specific categories from the bottom up. The emergent categories can then be combined with extant algorithmic fairness strategies to discover which identity groups are not well-served, and thus where algorithms should be improved or avoided altogether. We focus on educational applications but present arguments that this approach should be adopted more broadly for issues of algorithmic fairness across a variety of applications.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24643.

Similar documents (author)

1. Bosch, M.: Ontologies, different reasoning strategies, different logics, different kinds of knowledge representation : working together (2006) 1.15

   1.1494328 = sum of:
     1.1494328 = product of:
       3.4482982 = sum of:
         3.4482982 = weight(author_txt:bosch in 166) [ClassicSimilarity], result of:
           3.4482982 = score(doc=166,freq=1.0), product of:
             0.58730036 = queryWeight, product of:
               1.1080786 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.056418974 = queryNorm
             5.871439 = fieldWeight in 166, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.625 = fieldNorm(doc=166)
       0.33333334 = coord(1/3)
   

2. Ritter, M.; Eibl, M.: ¬Ein erweiterbares Tool zur Annotation von Videos (2010) 1.08

   1.0778546 = sum of:
     1.0778546 = product of:
       3.2335637 = sum of:
         3.2335637 = weight(author_txt:ritter in 4669) [ClassicSimilarity], result of:
           3.2335637 = score(doc=4669,freq=1.0), product of:
             0.652907 = queryWeight, product of:
               1.1683315 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.056418974 = queryNorm
             4.952564 = fieldWeight in 4669, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.5 = fieldNorm(doc=4669)
       0.33333334 = coord(1/3)
   

3. Nofsinger, M.M.; Bosch, A.W.: Roles of the head of reference : from the 1990s to the 21st century (1994) 0.92

   0.91954625 = sum of:
     0.91954625 = product of:
       2.7586386 = sum of:
         2.7586386 = weight(author_txt:bosch in 999) [ClassicSimilarity], result of:
           2.7586386 = score(doc=999,freq=1.0), product of:
             0.58730036 = queryWeight, product of:
               1.1080786 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.056418974 = queryNorm
             4.697151 = fieldWeight in 999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.5 = fieldNorm(doc=999)
       0.33333334 = coord(1/3)
   

4. Bosch-Sijtsema, P.: ¬The virtual organisation and knowledge development : a case of expectations (2004) 0.92

   0.91954625 = sum of:
     0.91954625 = product of:
       2.7586386 = sum of:
         2.7586386 = weight(author_txt:bosch in 3148) [ClassicSimilarity], result of:
           2.7586386 = score(doc=3148,freq=1.0), product of:
             0.58730036 = queryWeight, product of:
               1.1080786 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.056418974 = queryNorm
             4.697151 = fieldWeight in 3148, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.5 = fieldNorm(doc=3148)
       0.33333334 = coord(1/3)
   

5. Mazzocchi, F.; Bosch, M.: Hermeneutic approaches in knowledge organization : an analysis of their possible value (2008) 0.92

   0.91954625 = sum of:
     0.91954625 = product of:
       2.7586386 = sum of:
         2.7586386 = weight(author_txt:bosch in 2238) [ClassicSimilarity], result of:
           2.7586386 = score(doc=2238,freq=1.0), product of:
             0.58730036 = queryWeight, product of:
               1.1080786 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.056418974 = queryNorm
             4.697151 = fieldWeight in 2238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.5 = fieldNorm(doc=2238)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Rubel, A.; Castro, C.; Pham, A.: Algorithms and autonomy : the ethics of automated decision systems (2021) 0.19

   0.19485123 = sum of:
     0.19485123 = product of:
       0.97425616 = sum of:
         0.022582306 = weight(abstract_txt:however in 671) [ClassicSimilarity], result of:
           0.022582306 = score(doc=671,freq=1.0), product of:
             0.06855362 = queryWeight, product of:
               1.0747033 = boost
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.015128434 = queryNorm
             0.32941085 = fieldWeight in 671, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.078125 = fieldNorm(doc=671)
         0.044305928 = weight(abstract_txt:machine in 671) [ClassicSimilarity], result of:
           0.044305928 = score(doc=671,freq=1.0), product of:
             0.10743838 = queryWeight, product of:
               1.3454052 = boost
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.015128434 = queryNorm
             0.41238457 = fieldWeight in 671, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.078125 = fieldNorm(doc=671)
         0.09703319 = weight(abstract_txt:algorithms in 671) [ClassicSimilarity], result of:
           0.09703319 = score(doc=671,freq=3.0), product of:
             0.12562941 = queryWeight, product of:
               1.4548528 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.015128434 = queryNorm
             0.77237636 = fieldWeight in 671, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.078125 = fieldNorm(doc=671)
         0.34620264 = weight(abstract_txt:algorithmic in 671) [ClassicSimilarity], result of:
           0.34620264 = score(doc=671,freq=3.0), product of:
             0.3357854 = queryWeight, product of:
               2.9130633 = boost
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.015128434 = queryNorm
             1.0310235 = fieldWeight in 671, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.078125 = fieldNorm(doc=671)
         0.46413204 = weight(abstract_txt:fairness in 671) [ClassicSimilarity], result of:
           0.46413204 = score(doc=671,freq=2.0), product of:
             0.46734005 = queryWeight, product of:
               3.4366517 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.015128434 = queryNorm
             0.9931356 = fieldWeight in 671, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.078125 = fieldNorm(doc=671)
       0.2 = coord(5/25)
   

2. Sargent, S.: Jurgen Habermas and the ethics of gatekeeping (1993) 0.10

   0.09523534 = sum of:
     0.09523534 = product of:
       0.47617668 = sum of:
         0.022582306 = weight(abstract_txt:however in 551) [ClassicSimilarity], result of:
           0.022582306 = score(doc=551,freq=1.0), product of:
             0.06855362 = queryWeight, product of:
               1.0747033 = boost
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.015128434 = queryNorm
             0.32941085 = fieldWeight in 551, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.078125 = fieldNorm(doc=551)
         0.02624073 = weight(abstract_txt:should in 551) [ClassicSimilarity], result of:
           0.02624073 = score(doc=551,freq=1.0), product of:
             0.07577085 = queryWeight, product of:
               1.1298596 = boost
               4.432857 = idf(docFreq=1427, maxDocs=44218)
               0.015128434 = queryNorm
             0.34631696 = fieldWeight in 551, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.432857 = idf(docFreq=1427, maxDocs=44218)
               0.078125 = fieldNorm(doc=551)
         0.056504652 = weight(abstract_txt:groups in 551) [ClassicSimilarity], result of:
           0.056504652 = score(doc=551,freq=2.0), product of:
             0.10028386 = queryWeight, product of:
               1.299837 = boost
               5.0997415 = idf(docFreq=732, maxDocs=44218)
               0.015128434 = queryNorm
             0.5634471 = fieldWeight in 551, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0997415 = idf(docFreq=732, maxDocs=44218)
               0.078125 = fieldNorm(doc=551)
         0.04265805 = weight(abstract_txt:like in 551) [ClassicSimilarity], result of:
           0.04265805 = score(doc=551,freq=1.0), product of:
             0.10475761 = queryWeight, product of:
               1.3285141 = boost
               5.212252 = idf(docFreq=654, maxDocs=44218)
               0.015128434 = queryNorm
             0.4072072 = fieldWeight in 551, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.212252 = idf(docFreq=654, maxDocs=44218)
               0.078125 = fieldNorm(doc=551)
         0.32819092 = weight(abstract_txt:fairness in 551) [ClassicSimilarity], result of:
           0.32819092 = score(doc=551,freq=1.0), product of:
             0.46734005 = queryWeight, product of:
               3.4366517 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.015128434 = queryNorm
             0.7022529 = fieldWeight in 551, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.078125 = fieldNorm(doc=551)
       0.2 = coord(5/25)
   

3. Gorrell, G.; Bontcheva, K.: Classifying Twitter favorites : Like, bookmark, or Thanks? (2016) 0.07

   0.07428601 = sum of:
     0.07428601 = product of:
       0.26530716 = sum of:
         0.025702043 = weight(abstract_txt:applications in 2487) [ClassicSimilarity], result of:
           0.025702043 = score(doc=2487,freq=1.0), product of:
             0.086716816 = queryWeight, product of:
               1.2087182 = boost
               4.7422485 = idf(docFreq=1047, maxDocs=44218)
               0.015128434 = queryNorm
             0.29639053 = fieldWeight in 2487, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7422485 = idf(docFreq=1047, maxDocs=44218)
               0.0625 = fieldNorm(doc=2487)
         0.025842529 = weight(abstract_txt:learning in 2487) [ClassicSimilarity], result of:
           0.025842529 = score(doc=2487,freq=1.0), product of:
             0.08703252 = queryWeight, product of:
               1.2109164 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.015128434 = queryNorm
             0.29692957 = fieldWeight in 2487, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.0625 = fieldNorm(doc=2487)
         0.02763863 = weight(abstract_txt:focus in 2487) [ClassicSimilarity], result of:
           0.02763863 = score(doc=2487,freq=1.0), product of:
             0.0910198 = queryWeight, product of:
               1.2383441 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.015128434 = queryNorm
             0.30365512 = fieldWeight in 2487, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=2487)
         0.032920174 = weight(abstract_txt:variety in 2487) [ClassicSimilarity], result of:
           0.032920174 = score(doc=2487,freq=1.0), product of:
             0.102274254 = queryWeight, product of:
               1.312673 = boost
               5.1501017 = idf(docFreq=696, maxDocs=44218)
               0.015128434 = queryNorm
             0.32188135 = fieldWeight in 2487, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1501017 = idf(docFreq=696, maxDocs=44218)
               0.0625 = fieldNorm(doc=2487)
         0.034126442 = weight(abstract_txt:like in 2487) [ClassicSimilarity], result of:
           0.034126442 = score(doc=2487,freq=1.0), product of:
             0.10475761 = queryWeight, product of:
               1.3285141 = boost
               5.212252 = idf(docFreq=654, maxDocs=44218)
               0.015128434 = queryNorm
             0.32576576 = fieldWeight in 2487, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.212252 = idf(docFreq=654, maxDocs=44218)
               0.0625 = fieldNorm(doc=2487)
         0.035444744 = weight(abstract_txt:machine in 2487) [ClassicSimilarity], result of:
           0.035444744 = score(doc=2487,freq=1.0), product of:
             0.10743838 = queryWeight, product of:
               1.3454052 = boost
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.015128434 = queryNorm
             0.32990766 = fieldWeight in 2487, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.0625 = fieldNorm(doc=2487)
         0.08363258 = weight(abstract_txt:categories in 2487) [ClassicSimilarity], result of:
           0.08363258 = score(doc=2487,freq=1.0), product of:
             0.25843734 = queryWeight, product of:
               3.299294 = boost
               5.17774 = idf(docFreq=677, maxDocs=44218)
               0.015128434 = queryNorm
             0.32360876 = fieldWeight in 2487, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.17774 = idf(docFreq=677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2487)
       0.28 = coord(7/25)
   

4. Developments in applied artificial intelligence : proceedings / 16th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, IEA/AIE 2003, Loughborough, UK, June 23 - 26, 2003 (2003) 0.07

   0.07212738 = sum of:
     0.07212738 = product of:
       0.45079613 = sum of:
         0.044978574 = weight(abstract_txt:applications in 441) [ClassicSimilarity], result of:
           0.044978574 = score(doc=441,freq=1.0), product of:
             0.086716816 = queryWeight, product of:
               1.2087182 = boost
               4.7422485 = idf(docFreq=1047, maxDocs=44218)
               0.015128434 = queryNorm
             0.51868343 = fieldWeight in 441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7422485 = idf(docFreq=1047, maxDocs=44218)
               0.109375 = fieldNorm(doc=441)
         0.06395699 = weight(abstract_txt:learning in 441) [ClassicSimilarity], result of:
           0.06395699 = score(doc=441,freq=2.0), product of:
             0.08703252 = queryWeight, product of:
               1.2109164 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.015128434 = queryNorm
             0.73486316 = fieldWeight in 441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.109375 = fieldNorm(doc=441)
         0.0620283 = weight(abstract_txt:machine in 441) [ClassicSimilarity], result of:
           0.0620283 = score(doc=441,freq=1.0), product of:
             0.10743838 = queryWeight, product of:
               1.3454052 = boost
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.015128434 = queryNorm
             0.5773384 = fieldWeight in 441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.109375 = fieldNorm(doc=441)
         0.27983224 = weight(abstract_txt:algorithmic in 441) [ClassicSimilarity], result of:
           0.27983224 = score(doc=441,freq=1.0), product of:
             0.3357854 = queryWeight, product of:
               2.9130633 = boost
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.015128434 = queryNorm
             0.8333664 = fieldWeight in 441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.109375 = fieldNorm(doc=441)
       0.16 = coord(4/25)
   

5. Lloyd, A.: Chasing Frankenstein's monster : information literacy in the black box society (2019) 0.07

   0.0713699 = sum of:
     0.0713699 = product of:
       0.5947492 = sum of:
         0.07922726 = weight(abstract_txt:algorithms in 5476) [ClassicSimilarity], result of:
           0.07922726 = score(doc=5476,freq=2.0), product of:
             0.12562941 = queryWeight, product of:
               1.4548528 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.015128434 = queryNorm
             0.63064265 = fieldWeight in 5476, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.078125 = fieldNorm(doc=5476)
         0.06857627 = weight(abstract_txt:educational in 5476) [ClassicSimilarity], result of:
           0.06857627 = score(doc=5476,freq=1.0), product of:
             0.1437587 = queryWeight, product of:
               1.5562898 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.015128434 = queryNorm
             0.47702345 = fieldWeight in 5476, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.078125 = fieldNorm(doc=5476)
         0.44694567 = weight(abstract_txt:algorithmic in 5476) [ClassicSimilarity], result of:
           0.44694567 = score(doc=5476,freq=5.0), product of:
             0.3357854 = queryWeight, product of:
               2.9130633 = boost
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.015128434 = queryNorm
             1.3310456 = fieldWeight in 5476, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.078125 = fieldNorm(doc=5476)
       0.12 = coord(3/25)