Research Papers

Citation Concept Analysis (CCA) of concepts introduced by Pierre Bourdieu: Measuring their impact across fields and periods

  • Lutz Bornmann , 1, ,
  • Charles Crothers 2, * ,
  • Robin Haunschild 3
Expand
  • 1Science Policy and Strategy Department, Administrative Headquarters of the Max Planck Society, Hofgartenstr. 8, Munich 80539, Germany
  • 2School of Social Sciences, Auckland University of Technology, Auckland 1141, New Zealand
  • 3Max Planck Institute for Solid State Research, Heisenbergstraße 1, Stuttgart 70569, Germany
†Lutz Bornmann (Email: ).

*Charles Crothers passed away before the final version of the manuscript has been produced. He interpreted many of the results and contributed to an earlier draft of this manuscript.

Received date: 2024-10-07

  Revised date: 2024-11-25

  Accepted date: 2024-11-29

  Online published: 2025-01-21

Abstract

Purpose: Citations can be used in evaluative bibliometrics to measure the impact of papers. However, citation analysis can be extended by a multi-dimensional perspective on citation impact which is intended to receive more specific information about the kind of received impact.

Design/methodology/approach: Bornmann, Wray, and Haunschild (2019) introduced citation concept analysis (CCA) for capturing the importance and usefulness certain concepts have in subsequent research. The method is based on the analysis of citances - the contexts of citations in citing papers. This study applies the method by investigating the impact of various concepts introduced in the oeuvre of the world-leading French sociologist Pierre Bourdieu.

Findings: We found that the most cited concepts are ‘social capital’ (with about 34% of the citances in the citing papers), ‘cultural capital’, and ‘habitus’ (both with about 24%). On the other hand, the concepts ‘doxa’ and ‘reflexivity’ score only about 1% each.

Research limitations: The formulation of search terms for identifying the concepts in the data and the citation context coverage are the most important limitations of the study.

Practical implications: The results of this explorative study reflect the historical development of Bourdieu’s thought and its interface with different fields of study.

Originality/value: The study demonstrates the high explanatory power of the CCA method.

Cite this article

Lutz Bornmann , Charles Crothers , Robin Haunschild . Citation Concept Analysis (CCA) of concepts introduced by Pierre Bourdieu: Measuring their impact across fields and periods[J]. Journal of Data and Information Science, 2025 , 10(1) : 26 -46 . DOI: 10.2478/jdis-2025-0009

1 Introduction

Citations reflect that certain research matters to knowledgeable peers (Zuckerman, 2018). According to Cole (1992) citations might be interpreted, therefore, as “a valid indicator of the subjective assessment of quality by the scientific community”. From around the 1980s, citations have been used regularly as bibliometrics in research evaluation processes (van Raan, 2019): for the evaluation of (i) research groups, departments, institutions, and research proposals, (ii) the allocation of research funding, (iii) hiring of academic personnel, and (iv) ranking of universities such as the Leiden ranking (Aksnes et al., 2019). The results of Hammarfelt et al. (2020) show, for example, that citations and related indicators play an important role when biomedical researchers are compared and ranked in peer review processes.
However, bibliometrics based on citations are not without critique (MacRoberts & MacRoberts, 2017). Marí-Sáez and Ceballos-Castro (2019) believe, for example, that several citation practices such as pasting and cutting of citations undermine the use of citations as impact indicator. Papers introducing certain techniques of immediate use to many researchers receive more citations than breakthrough papers with key field-specific insights (Anon, 2009). Based on these and similar critical points, Aroeira and Castanho (2020) suggest that “assessment of scientific impact of research work should be based on identifying subsequent published papers that truly embed the methodologies, concepts, or hypothesis of the original paper (test set in this work) to build new knowledge and conclusions”.
To better ground understanding of impacts, Bornmann et al. (2019) introduced the citation concept analysis (CCA) method based on analyses of classic books. Concepts can be ground-breaking ideas, theories, explanations, or mechanisms. CCA combines the quantitative analysis of citations with a qualitative analysis of citances (Petrovich, 2018) that are single sentences in which citations are made (Small, 2018). An example for a citance including research by Pierre Bourdieu is: “The potential for power in these sequences rests on, in Bourdieu’s terms, the symbolic capital (Bourdieu, 1998) of linguistic competence”. Complex analyses of citances by CCA are possible in recent years through the “increasing availability of full text from scientific articles in machine readable electronic formats” (Boyack et al., 2018). CCA is a specific form of citation content analysis in which citations are analyzed “in relation to the meaning and structure of the text in which they are embedded” (Cronin, 1982). According to Liu (1993), citation content analysis tries to “characterise the cited work by analysing the semantic content of the citing papers”.
In this empirical study, we follow the approach of Bornmann et al. (2019) and undertake a CCA of the oeuvre of one of the most prominent sociologists today: the late Bourdieu. Although Bourdieu died in 2002, his unique approach of theoretical, empirical, methodological, and critical sociology has resonated very widely across most national sociologies (see, for example, several of contributions in Medvetz and Sallaz (2018)). We are interested in his concepts which were introduced in various publications and are cited in subsequent publications. We analyzed how often his concepts have been cited, i.e., how influential they were in various fields and periods. Additionally, Bornmann et al. (2019) applied an approach from Small (2018) and Small et al. (2019) to measure uncertainty associated with concepts based on the presence or absence of hedging words (e.g., “may”). We followed the approach in this study to measure uncertainty associated with Bourdieu’s concepts.
We would like to denote this study as an explorative study. The bibliometric method (CCA) which we used in our study have been introduced recently, and it is not clear whether they lead to valid results. We apply citation context analyses based on newly accessible data, and it is not clear whether the results of the analyses are reliable (i.e., similar to those obtained by analyses based on another data source). Our study can be a useful starting off point for further investigation into why particular terms - Bourdieu’s concepts - are taken up.

2 Citation content analyses - a short literature overview

CCA is a variant of citation content analysis. In citation content analysis, the semantic content of the text surrounding the citation within the citing publication is analyzed to characterize the cited publication. The CCA specifically focusses on concepts introduced in a cited publication and mentioned in the citation contexts of the citing publications to identify the most important introduced concepts.
Detailed summaries of previous citation content analyses can be found in literature overviews published by Bornmann and Daniel (2008) and Tahamtan and Bornmann (2019). Previous CCAs have been published by Bornmann et al. (2019) and Crothers et al. (2020). Bornmann et al. (2019) introduced the CCA method based on analyses of classic books published by Kuhn (1962) and Popper (1934, 1959, 1962). Bornmann et al. (2019) analyzed the citation impact of the various concepts (e.g., ‘paradigm’, ‘scientific revolution’, and ‘falsification’). For example, they found a much larger impact of the concept ‘paradigm’ than Kuhn’s other concepts, e.g., ‘scientific revolution’. With respect to Popper (1934, 1959, 1962), ‘falsification’ is the most used concept derived from his books. Crothers et al. (2020) investigated the citation impact of various concepts introduced in Merton (1949). They found that the most cited concepts are ‘self-fulfilling’ (especially in computer sciences and psychology) and ‘role’.
One limitation of current CCA is that it treats each concept as separate whereas indubitably the work of many authors forms something of a system: future studies should attempt to repair this defect.

3 Pierre Bourdieu’s career and oeuvre

3.1 Career

Pierre Bourdieu’s career was exceptional but relatively uncomplicated. Born in 1930 in a rural low-status background in South-West France, he succeeded brilliantly in the French educational system. His experiences growing up were important sources for his thinking as a sociologist. During his education, common in French education, Bourdieu was exposed to the thinking of many philosophers. Sent to Algeria as part of his compulsory service, Bourdieu served in the French army (latterly in a clerical capacity and then as a lecturer in the University of Algeria, Algiers). During this period, he began to detach himself from philosophy and carried out local ethnographic research on the Kabyle Berbers of northern Algeria and wrote up studies of Algerian colonial situation which contextualized the French occupation.
On his return to Paris, Bourdieu was mentored by Raymond Aron (a French philosopher and sociologist) and researched at the European Sociology Center (CSE, Centre de Sociologie Européenne, which he had founded), where he was involved in a flurry of surveys. These surveys particularly addressed the role of education in reproducing society. He explained the ‘social sorting’ role of education as arising from a mismatch between the middle class (mainly women) teachers and the various class subcultures from which students were drawn. Steadily rising through the ranks of the French academic hierarchy (including being appointed Professor at the College de France, Paris), Bourdieu spent much effort in the 1960s and subsequently examining various cultural capital fields (including art, novels, philosophy, TV, and journalism). Alongside these there was some consolidation of his theoretical writings.
In his final phase of work, Bourdieu turned particularly to the analysis of the state (which he saw as a providing the classificatory systems through which the social world was constructed) and also to analytical depiction of the ravages of neo-liberal capitalism. Although in the 1980s he had participated in ministerial inquiries, especially on education, in this later period he intervened in public discussions in France concerning the dispossessed. He died in 2002, but his work has continued to have an escalating impact on scholarship across the social sciences.
Bourdieu worked within a network of collaborators who reinforced and extended his work, especially in the 1960s. Some later left his team, some even becoming critics. A long-standing colleague and vigorous interpreter of Bourdieu is Loic Wacquant (a French sociologist and social anthropologist) who has written with and particularly on Bourdieu in many places.

3.2 Works

Bourdieu’s work includes some three dozen books (almost all quickly translated into English especially from the 1980s), but also many (some 300) journal articles, together with interviews and written-up teaching notes. He was also active in setting up and editing journals and book publication series. His best known book is ‘Distinction: A social critique of the judgment of taste’ (Bourdieu, 1984), although his later ‘Weight of the world’ (Bourdieu, 1999) is also particularly important. He has a difficult writing style with long often doubling-back sentences. For non-French readers, Bourdieu’s work has to be glimpsed through translations, which are considered good, although Bourdieu often complained that those reading him in other languages did not entirely grasp his concepts.
A very considerable secondary literature has developed providing further commentary and extension of Bourdieu’s work. In the London School of Economics library, renowned for its collection of social sciences books, just over 100 volumes with ‘Bourdieu’ in their title can be found. Beyond this there is a large journal literature. Bourdieu’s influence is immense, particularly in sociology but also across all fields of the social sciences and humanities, and across the world. At the turn of the century, in an International Sociological Association poll (see https://www.isa-sociology.org/en/about-isa/history-of-isa/books-of-the-xx-century/ranking-order) four of Bourdieu’s books were included in the top 100, and he scored highly with votes, being placed sixth. This volume of the secondary literature makes pinning down key material more difficult.
It is difficult to depict the ‘architecture’ Bourdieu’s set of concepts as they have been developed through engagement with various subject-matters, but also involve much doubling-back to re-examine older issues in the light of ongoing thinking. He resorts to a particularistic vocabulary, including some use of Latin terms. Bourdieu endeavors to overcome several of the fundamental dichotomies which challenge social theory: objective versus subjective, micro versus macro, static versus dynamic, and determinist versus agency driven. So, he is often tackling paradoxes. For Bourdieu, the development of conceptual analyses requires both consideration of available theory together with engagement with the subject-matter being investigated. Also, social analysis must always build itself into the picture, with the analyst analyzing their own social position, in order to achieve scientific objectivity.
It is widely held that the trio of Bourdieu’s key concepts are ‘field’, ‘capital’, and ‘habitus’. Wacquant (2005) lists an expanded set of seven concepts: ‘habitus’, ‘capital’, ‘social space’, ‘field’, ‘symbolic power’, ‘doxa’, and ‘epistemic reflexivity’. While particularly relating to an urban context, Wacquant (2017) argues that “the most potent and generative of the lot is indisputably ‘social space’. This is not only because it is anchored by a geographic metaphor, but because it is the ‘mother-category’ from which flow the more restricted concepts of ‘field’, ‘corps (body)’ and ‘apparatus’ as specific types of settings in which social action takes root and flows“. The key driver of the analytical apparatus is ‘symbolic power’ “the capacity for consequential categorization, the ability to make the world, to preserve or change it, by fashioning and diffusing symbolic frames, collective instruments of cognitive construction of reality” (Wacquant, 2017). Those people who are disadvantaged by social classifications - in the current era often perpetrated by the state - are seen as suffering ‘symbolic violence’.
Another treatment is that of Johan Heilbron who portrays Bourdieu as conceptualizing sociology as a science of social practices, concerned with partially structured regularities. In providing explanations of these practices: They “need to be understood as located in relatively autonomous social spaces (fields), which are defined by struggles over specific stakes between agents that are characterized by the volume and composition of their resources (capital), and by the dispositions by which they are inclined to use these resources (habitus). The indicated terms (practice, field, capital, habitus) are not the only concepts of Bourdieu’s approach; there are several others (domination, symbolic violence, illusion, doxa, strategy, homology, reproduction) but these can at least provisionally be seen as refinements of the basic model” (Heilbron, 2011). Heilbron goes to argue that Bourdieu’s approach differs from dominant paradigms which are centered on human action, rational choice, or social systems.
Some earlier-published classic treatments have been provided by Calhoun et al. (1993) and Swartz (1997) and an extensive literature, although given the ongoing development of Bourdieu’s work, let alone ever-advancing commentaries on it, it is not possible to rely solely on these. Grenfell (2014) is an edited volume focusing on particular concepts of Bourdieu. The concepts covered by chapters include: ‘theory of practice’, ‘habitus’, ‘field’, ‘social class’, ‘capital’, ‘doxa’, ‘hysteresis’, ‘interest’, ‘conatus’, ‘suffering/symbolic violence’, ‘reflexivity’, and ‘social space’. While most of the concepts covered in the book appear on the lists in this paper, several are not numerically significant and so were excluded.
Tracing the historical development of Bourdieu’s thought is not necessarily the best way of understanding its structure. For example, the concept of field was only elaborated in the middle and later years of Bourdieu’s work. It can be readily argued that Bourdieu’s scheme of analysis is founded on macro-level ‘field’ analysis - set within broader understandings - complemented by a closer look to social life as it is lived (micro) level that is shown to underpin this. The ‘fields’ Bourdieu has examined variously include the economy, politics, education, academia, science, art, media, and sociology itself. The wider social space is largely divided into various fields which operate with varying degrees of autonomy from the underlying ‘field of power’. In each field there are stakes (valued outcomes) which are the subject of struggle amongst the agents inhabiting the field, who are arrayed across a spectrum of positions in terms of their interests in the stake of the field, often taking the form of dominated fractions - with the former dominating the latter who nevertheless resist and attempt to change the stakes. Each field has various capitals produced in and circulated around the field. Actants possess varying volumes and compositions of capital with the dominating fraction having the largest accumulation. The participants and the groups in which they are placed are in an unending struggle as the field historically evolves.
Beneath the operation of each field lies the overall ‘field of power’ of the society (involving in particular the state, currently ‘neoliberal capitalism’ and also classes) which incorporates struggles between fields about the rates of exchange between particular forms of capital. Classes are particular configurations within the field of power - sharing common understandings and assumptions across a range of issues and situations, and whose strength is given by the volumes and types of capital they have access to. The social space in some smaller-scale societies is not divided into fields.
The more general capitals are: ‘economic’ (e.g., convertible into money), ‘cultural’ (e.g., educational qualifications), ‘social’ (e.g., connections, networks, titles), and ‘symbolic’ (e.g., social recognition/importance, social classifications). Capitals can take a variety of forms. For example, there are three forms of cultural capital: ‘embodied state’ (long lasting dispositions of the mind and body), ‘objectified state’ (pictures, books, dictionaries, instruments, machines, etc.), and ‘institutionalized state’ (e.g., educational qualifications) (Bourdieu, 1986). Capitals can change between different forms: It can be possible for different capitals to transform into another, according to socially set exchange rates.
The everyday social life presents itself as arrays of practices which are ‘natural’ and not much queried, and so presenting to actants and audiences as objectifications which need to be stripped away to reveal the underling discourses and operations. Groups form with spokespeople articulating their interests and views.
Operating within particular fields, actors implement strategies including a temporal aspect usually based on their interests and dispositions and shaped by their decision-making including their ‘body language’-helix much of which is unconsciously given by their habitus or usual decisions. The habitus is built up over many years of experience within earlier milieu, but which often slowly changes to incorporate the lessons of later experiences. The habitus provides a ‘feel for the game’ through which the individuals’ involvement in practices is largely driven by what seems to them appropriate given their position within the frame of the relevant field.
Having established an account of the architecture of Bourdieu’s work, this empirical study is directed towards obtaining a picture of the extent to which various concepts are in fact used, including endeavoring to pinpoint in terms of different disciplinary areas, etc. This aggregated picture is intended as a useful starting off point for further investigation into why particular terms are taken up. It is useful to sketch out some theoretical thoughts about why particular concepts might be taken. As a Bourdieu-aligned theory would signal such an (‘explanatory’) investigation of the use of concepts would depend on various characteristics of the problematic being explored - one example might be whether the issue being examined seems more to lie at micro, meso, or macro levels.

3.3 Prior citation studies

There are many chapters and even book-length studies of Bourdieu’s scholarly influence, some including him within a broader array of French theorists. Three of the more formal citation studies each concern the reception of Bourdieu within information or communication studies, with another relating to the engagement of Bourdieu’s work in management and organizational studies. Cronin and Meho (2009) provide a broad bibliometric mapping of the citation impact of 16 French theorists and their more impactful works over the course of the previous four decades. They found Bourdieu to have been third most cited, with “Distinction” (Bourdieu, 1984) the most cited of his works with this book amongst the top ten items of the theorists in the study. Lee and Sohn (2016) examined how communication scholars have incorporated the concept of ‘social capital’, analyzing citation patterns among 171 social capital-related journal articles, book chapters, and books extracted from Communication Abstracts. They compared the citing patterns of the pioneering social capital scholars Robert Putnam, Pierre Bourdieu, and James Coleman, finding the work of Putnam to be most cited. Although the conception of social capital held by these theorists is broadly similar, the very popularity of the term means that Bourdieu’s unique contribution may not be separately identified.
Sallaz and Zavisca (2007, 2008) and an edited volume on the reception of Bourdieu (Medvetz & Sallaz, 2018) investigated Bourdieu’s impact and reception. They sought to measure how Bourdieu’s work has been “utilized practically” in American sociology across 1980 to 2004, by measuring its influence upon empirical research published in major journals. Nearly 6% of articles in this ‘population’ cited Bourdieu at least once (n=235) and this was increasing with a five-fold increase over the past several decades. About half cite Bourdieu ceremoniously - that is, they mention him but briefly (typically only once, rarely in the text itself, and often in a string of related citations) while about a fifth involved a substantial engagement. Maares and Hanusch (2020) examined the use by journalists of Bourdieusien concepts in 249 English-language articles. The authors compared uses in relation to the methods used in the study, and whether it appears in abstracts and/or keywords, and whether the usage is in-depth or merely ‘overall’. They found that a minority of studies use ‘field theory’ on its own, and use of ‘capital’ on its own was even rarer. Sieweke (2014) conducted a citation context analysis of nine leading management and organizational studies journals to investigate how citations to Bourdieu’s work have developed over time, which content from Bourdieu’s work is cited, and how comprehensively researchers have so far engaged with Bourdieu. He found that the depth of use of Bourdieusien concepts had steadily increased over time.
While the earlier citation studies are useful, this explorative study of Bourdieu provides a much wider coverage.

4 Methods

4.1 Concepts used from the oeuvre

Working through some of Bourdieu’s books and also commentaries, a long list of potential concepts was drawn up with selection dependence on perceived theoretical importance. This list was edited to remove concepts which might be difficult to clearly identify. Possibilities of singular and plural forms were explored. In particular, some of Bourdieu’s concepts involve ‘paired terms’ which opens up the possibility of more generic concepts which remain, once shorn of their qualifiers.
The list of concepts deployed included:
· Capitals (economic capital, social capital, cultural capital, and symbolic capital): Capital in general is accumulated labor which can generate social energy. Economic capital is money (and/or assets convertible to money) and may be institutionalized in the form of property rights. Social capital enables a person to exert power drawing on social assets as education, intellect, style of speech, or style of dress. Cultural capital is the accumulated cultural knowledge conferring social status and power, based on socially valued material and symbolic goods available on the basis of honor, prestige, or recognition: the experiencing of the natural and social world as self-evident. Symbolic capital is the culturally-relevant resources available to an individual on the basis of honor, prestige, or recognition.
· Reproduction: the mechanisms through which existing cultural forms, values, practices, and shared understandings are transmitted from generation to generation, thereby sustaining the continuity of cultural experience across time.
· Reflexivity: Since social scientists are inherently laden with biases, it is only by becoming reflexively aware of those biases that they can free themselves from the biases and aspire to objective science.
· Distinction: Those with a high volume of cultural capital (non-financial social assets, such as education) are most likely to be able to determine what constitutes ‘taste’ or ‘distinction’ within any society.
· Habitus: Wacquant (2005) defines habitus as follows: “the way society becomes deposited in persons in the form of lasting dispositions, or trained capacities and structured propensities to think, feel and act in determinant ways, which then guide them”.
· Practice: the basic bodily, knowledge-based practices that interconnect to form more complex social entities like groups, lifestyles, social fields, or entire societies.
· Field: a system of social positions structured internally in terms of power relationships.
· Practical reason/Disposition: a sense of the game; a partly rational but partly intuitive understanding of fields and of social order in general, giving rise to opinions, tastes, tone of voice, typical body movements, and mannerisms.
· Illusio: It is the belief that the ‘game’ we collectively agree to play is worth playing, and that the fiction collectively held constitutes reality.
· Social space: relative positions occupied by individuals and groupings within it, broader than field.
· Hysteresis: dislocation of habitus by changing social conditions.
Upon examination of the distribution of the concepts some of the lower scoring concepts were not taken any further, since they are too infrequent to allow systematic comparisons.

4.2 Dataset

In this explorative study, we used citation context data from Microsoft Academic (MA, see https://aka.ms/msracad; Wang et al., 2020). Unfortunately, MA has been retired at the end of 2021, but MA snapshots are still available (see https://zenodo.org/records/6511057). However, it should still be current enough for our study. Previously, other CCA studies were performed using MA regarding Robert K. Merton’s book “Social Theory and Social Structure” (Crothers et al., 2020) and classic books by Thomas S. Kuhn and Karl R. Popper (Bornmann et al., 2019, 2020). A description of MA can be found in Haunschild et al. (2018), Hug and Brändle (2017), and Hug, Ochsner, and Brändle (2017).
We searched for author names in the author table of MA that fit Pierre Bourdieu. We found the following variants: ‘pierre bourdieu’, ‘pierr bourdieu’, ‘p bourdieu’, ‘plerre bourdieu’, ‘par pierre bourdieu’, ‘pierrebourdieu’, and ‘pierre auteur du texte bourdieu’. Only the papers with the name variant ‘pierre bourdieu’ has citances associated with them. After a check of randomly selected titles which confirmed that these publications were authored by Bourdieu, we used all of those publications with the author name variant ‘pierre bourdieu’ that are associated with citances (n=201). We found 8,951 papers that cited 201 of Bourdieu’s papers with 15,227 citances indexed in MA. Of those, for 8,934 citing papers and 15,197 citances, a level 0 (the highest hierarchical disciplinary level) field of study (FOS) is available. Overall, 884 publications from the author name variant ‘pierre bourdieu’ are indexed in MA. These were cited 133,397 times. The numbers show that for most citing papers, citation context information is missing in MA. Citation context information is available for only 11.4% of the citing papers.
We searched in the citances for selected concepts that are associated with Bourdieu (see also the previous section). Punctuation characters (‘,’, ‘.’, ‘;’, and ‘:’) were removed from the citances, and all citances were converted to lower case characters. The concepts and the corresponding search terms are shown in Table 1.
Table 1. Bourdieu’s concepts and corresponding search terms.
Concept Search term
cultural capital ‘cultural*capital*’ or ‘capital*cultural’
economic capital ‘economic*capital*’ or ‘capital*economic’
social capital ‘social*capital*’ or ‘capital*social’
symbolic capital ‘symbolic*capital*’ or ‘capital*symbolic’
symbolic violence ‘symbolic violence’
doxa ‘doxa’
reproduction ‘reproduction’
reflexivity ‘reflexivity’
distinction ‘distinction’
habitus ‘habitus’
practice ‘practice’
field ‘field’
social space ‘social space’

Note. The asterisk is a truncation symbol.

A general problem with quantitative data collection of terms is that to some degree terms can reflect different concepts and understandings, and terms are context-specific. The issue is to what extent this happens. To check the extent we randomly checked selected citances that were retrieved by the search terms in Table 1. We did not find retrieved citances that did not belong to the corresponding concept. Nevertheless, some terms picked up by this analysis may be incorrect in various ways as the meaning of terms can vary by context, and some instances will have different meanings. We are confident that the number of terms with different meaning is small and may be random in occurrence.
We also measured uncertainty associated with concepts. Certain hedging terms, e.g., ‘may’, were proposed by Small et al. (2019) to measure uncertainty which might be used in citances. The authors explained that “hedging does not assert that the paper is wrong, but only suggests that uncertainty surrounds some aspect of the ideas put forward” (Small et al., 2019). Hyland (1996) proposed to distinguish between content-motivated (e.g., ‘generally’, ‘almost’, ‘might’, and ‘probable’) and reader-motivated (e.g., ‘believe’, ‘suggest’, and ‘analogy’) hedging terms. However, we measured uncertainty in general without further differentiation.
We used the hedging terms from Bornmann et al. (2019) that are in turn based on the hedging terms from Small et al. (2019). Bornmann et al. (2019) checked in the citances of their dataset how frequently the terms occurred and how frequently they were used to express uncertainty. The final set with the most frequent terms they focused on is as follows: ‘may’, ‘could’, ‘questions’, ‘might’, ‘potential’, ‘seems’, ‘perhaps’, ‘likely’, and ‘sometimes’. We used this final set in the current study; Crothers et al. (2020) used the same set of terms.

4.3 Statistics

In this explorative study, we counted how often certain concepts (e.g., ‘social capital’) are mentioned in citances of citing publications. The statistical analyses considered the possibility that concepts are mentioned multiple times (i.e., more than one concept is frequently mentioned in a single citance). Since there is information in MA available about the FOS and publication year of publications, we analyzed differences between fields and periods in citing certain concepts: We analyzed the relationships between concepts and fields or concepts and publication years in contingency tables. In these tables, citations of concepts are dependent variables; fields and periods are independent variables.
We applied the Stata command mrtab (Jann, 2005) to analyze multiple mentions of concepts depending on publication year and FOS. In the interpretation of the results, we focused on two statistics: (1) As indications of effect sizes (Cumming & Calin-Jageman, 2016), we analyzed differences in percentages of concept mentions between different FOSs and publication years. (2) We calculated statistical significance tests in r x c tables. To investigate the overall relationship between concepts and FOSs (or publication years), we performed an overall chi-square test. In addition, we performed a series of separate chi-square tests for each concept. For these tests, the p values were adjusted to account for simultaneous calculations of many tests.

5 Results

In section 5.1, we report the findings on the citation impact received by the concepts - overall and in various FOSs and periods. In section 5.2, the results related to the perceived uncertainty of the concepts are presented.

5.1 First empirical part: citation impact received by concepts

Table 2 presents how frequently the concepts have been cited in various FOSs in absolute and relative numbers. The row ‘Total’ in the table shows the total numbers of concept mentions in the citing papers’ citances (broken down by FOS). Each citance contains at least one reference to Bourdieu’s oeuvre. The row ‘Cases’ in Table 2 shows the total numbers of the citing papers’ citances (broken down by FOS). For many citing papers of Bourdieu’s publications, citation context information is available; the citance, however, does not contain any mention of Bourdieu’s concepts. The table reports column percentages based on the number of all citing papers with citances in the FOS containing concept mentions or not. For example, the concept ‘social capital’ appeared in 111 citances of citing papers published in business. Thus, around 50% of the citing papers in business (n=223) include the ‘social capital’ concept in their citances. In total, 300 citances occur across all concepts; 111 citances are located in business.
Table 2. Citation concept analysis (CCA) of Bourdieu’s oeuvre. How frequently have concepts (the concepts are decreasingly sorted by the column “Total”) been cited in various FOSs?
FOS
Concept
Art Business Computer science Economics Engineering Geography History Mathematics Medicine Philosophy Political science Psychology Sociology Total
social n 6 111 101 328 45 59 9 11 108 7 506 468 965 2,735
capital % 7.79 49.78 37.00 50.08 26.95 30.41 15.79 30.56 40.15 22.58 42.59 35.32 27.13 33.86
cultural n 17 39 36 144 36 40 10 8 52 4 325 420 864 2,001
capital % 22.08 17.49 13.19 21.98 21.56 20.62 17.54 22.22 19.33 12.90 27.36 31.70 24.29 24.77
habitus n 13 27 40 97 46 54 17 9 69 10 234 339 964 1,927
% 16.88 12.11 14.65 14.81 27.54 27.84 29.82 25.00 25.65 32.26 19.70 25.58 27.10 23.85
field n 25 37 47 85 27 26 2 6 19 10 188 156 723 1,356
% 32.47 16.59 17.22 12.98 16.17 13.40 3.51 16.67 7.06 32.26 15.82 11.77 20.33 16.79
practice n 6 38 57 49 49 21 13 9 48 3 107 163 459 1,022
% 7.79 17.04 20.88 7.48 29.34 10.82 22.81 25.00 17.84 9.68 9.01 12.30 12.90 12.65
economic n 7 20 17 83 13 20 1 3 14 7 150 116 301 754
capital % 9.09 8.97 6.23 12.67 7.78 10.31 1.75 8.33 5.20 22.58 12.63 8.75 8.46 9.33
symbolic n 11 13 18 50 8 17 8 2 14 1 71 77 271 564
capital % 14.29 5.83 6.59 7.63 4.79 8.76 14.04 5.56 5.20 3.23 5.98 5.81 7.62 6.98
distinction n 6 7 10 28 6 12 6 2 9 0 22 36 200 347
% 7.79 3.14 3.66 4.27 3.59 6.19 10.53 5.56 3.35 0.00 1.85 2.72 5.62 4.30
reproduction n 2 2 3 15 9 3 6 2 8 1 67 59 153 331
% 2.60 0.90 1.10 2.29 5.39 1.55 10.53 5.56 2.97 3.23 5.64 4.45 4.30 4.10
symbolic n 0 3 3 3 1 9 1 0 11 0 19 19 109 178
violence % 0.00 1.35 1.10 0.46 0.60 4.64 1.75 0.00 4.09 0.00 1.60 1.43 3.06 2.20
social n 2 2 7 6 5 4 1 0 8 0 21 21 79 156
space % 2.60 0.90 2.56 0.92 2.99 2.06 1.75 0.00 2.97 0.00 1.77 1.58 2.22 1.93
doxa n 0 1 1 3 1 7 0 0 2 1 12 12 48 88
% 0.00 0.45 0.37 0.46 0.60 3.61 0.00 0.00 0.74 3.23 1.01 0.91 1.35 1.09
reflexivity n 0 0 1 4 2 1 0 1 4 0 6 18 48 85
% 0.00 0.00 0.37 0.61 1.20 0.52 0.00 2.78 1.49 0.00 0.51 1.36 1.35 1.05
Total n 95 300 341 895 248 273 74 53 366 44 1,728 1,904 5,184 11,544
% 123.38 134.53 124.91 136.64 148.50 140.72 129.82 147.22 136.06 141.94 145.45 143.70 142.91
Cases N 77 223 273 655 167 194 57 36 269 31 1,188 1,325 3,557 8,078

Notes. Results of chi-square tests for single concepts (rows): ‘social capital’: χ2=262.275, p=0.000; ‘cultural capital’: χ2=81.747, p=0.000; ‘habitus’: χ2=108.470, p=0.000; ‘field’: χ2=119.466, p=0.000; ‘practice’: χ2=116.277, p=0.000; ‘economic capital’: χ2=49.481, p=0.000; ‘symbolic capital’: χ2=31.115, p=0.169; ‘distinction’: χ2=69.584, p=0.000; ‘reproduction’: χ2=38.120, p=0.019; ‘symbolic violence’: χ2=45.114, p=0.002; ‘social space’: χ2=12.564, p=1; ‘doxa’: χ2=22.882, p=1; ‘reflexivity’: χ2=16.579, p=1. Result of the overall chi-square test: χ2=3500, p=0.000

As Table 2 shows nearly half of the citances were assigned to the FOS sociology as might be expected since this was Bourdieu’s primary disciplinary affiliation. The flanking fields of psychology and political science yielded solid contributions while economics contributed a further solid bloc of citances. Many of the other FOS represent a limited number of users of Bourdieu’s concepts. There were a few inputs of Bourdieu’s concepts in areas such as biology or physics which have been excised from Table 2.
Several of the ‘science-appearing’ FOS (e.g., computer science, engineering, mathematics, and medicine) may well represent cross-disciplinary elements of these disciplines where social researchers are engaged. The table suggests limited penetration into the humanities (art, history, and philosophy) despite claims of Bourdieu’s aficionados. The extent to which a field engages with Bourdieu’s concepts may be shaped by the timing of which the field took up such a vocabulary. However, there are few differences: Social capital is particularly well-used in business, economics, medicine, and political science.
The most cited concept in Table 2 is ‘social capital’. About 34% of the citances in citing papers are related to this concept. The concepts ‘cultural capital’ and ‘habitus’ follow with about 24%. The concepts ‘doxa’ and ‘reflexivity’ (about 1% each) are those with only a few occurrences (compared to the other concepts) in our dataset. The results of the chi-square tests for the single concepts reveal statistically significant results for most concepts. These concepts (e.g., ‘cultural capital’ and ‘habitus’) seem to be differently used in the various FOSs. Only the results for ‘symbolic capital’, ‘social space’, ‘doxa’, and ‘reflexivity’ are statistically not significant. The concept ‘social capital’ seems to be important especially in business (49.8%), political sciences (42.6%), and medicine (40.2%), considering the low case numbers in certain FOSs such as geology. For ‘cultural capital’, this seems to be the case in psychology (31.7%) and for ‘habitus’ in sociology (27.1%).
Table 3 shows the results for concept mentions depending on time (i.e., publication year periods). The results show scarcely any time-dependent patterns; the chi-square tests for all concepts except two are statistically not significant. The exceptions are ‘practice’ and ‘distinction’. ‘Practice’ has been decreasingly mentioned in citances over time; the trend for ‘distinction’ is unspecific.
Table 3. Citation concept analysis (CCA) of Bourdieu’s oeuvre: How frequently have concepts (the concepts are decreasingly sorted by the column ‘Total’) been cited in various periods (i.e., publication year periods)?
Publication year period
1975-2005 2006-2010 2011-2020 Total
social capital n 271 1,007 1,457 2,735
% 30.69 34.38 34.15 33.86
cultural capital n 212 743 1,046 2,001
% 24.01 25.37 24.52 24.77
habitus n 184 724 1,019 1,927
% 20.84 24.72 23.89 23.85
field n 126 476 754 1,356
% 14.27 16.25 17.67 16.79
practice n 134 406 482 1,022
% 15.18 13.86 11.30 12.65
economic capital n 61 281 412 754
% 6.91 9.59 9.66 9.33
symbolic capital n 56 226 282 564
% 6.34 7.72 6.61 6.98
distinction n 36 172 139 347
% 4.08 5.87 3.26 4.30
reproduction n 46 111 174 331
% 5.21 3.79 4.08 4.10
symbolic violence n 26 61 91 178
% 2.94 2.08 2.13 2.20
social space n 19 59 78 156
% 2.15 2.01 1.83 1.93
doxa n 10 29 49 88
% 1.13 0.99 1.15 1.09
reflexivity n 9 35 41 85
% 1.02 1.19 0.96 1.05
Total n 1,190 4,330 6,024 11,544
% 134.77 147.83 141.21 142.91
Cases N 883 2,929 4,266 8,078

Notes. Results of chi-square tests for single concepts (rows): ‘Social capital’: χ2=4.479, p=1; ‘Cultural capital’: χ2=0.978, p=1; ‘habitus’: χ2=5.629, p=0.779; ‘field’: χ2=7.014, p=0.390; ‘practice’: χ2=16.035, p=0.004; ‘economic capital’: χ2=6.901, p=0.412; ‘symbolic capital’: χ2=3.893, p=1; ‘distinction’: χ2=28.979, p=0.000; ‘reproduction’: χ2=3.489, p=1; ‘symbolic violence’: χ2=2.546, p=1; ‘social space’: χ2=0.572, p=1; ‘doxa’: χ2=0.422, p=1; ‘reflexivity’: χ2=0.923, p=1. Result of the overall chi-square test: χ2=541.24, p=0.000

Table 3 shows that there is a gradual growth in the ratio of concepts to cases, but the use of most concepts does not reveal an over-time pattern. Deployment of ‘social capital’, ‘habitus’, ‘field’, and ‘economic capital’ have increased over time, while ‘practice’, ‘distinction’, and several less frequently appearing concepts have declined over time.

5.2 Second empirical part: uncertainty associated with concepts

Uncertainty associated with concepts is related to truthfulness against the backdrop of current scientific knowledge. The epistemic status of concepts “may range from completely unknown to speculations and from hypotheses to facts” (Chen et al., 2018). To measure uncertainty with respect to concepts the existence of hedging terms such as ‘may’, ‘could’, or ‘might’ in citances can be studied. An overview of hedging terms can be found in Chen et al. (2018).
Table 4 focusses on the uncertainty which might be associated with Bourdieu’s concepts. The results reveal that ‘social capital’ seems to be the most ‘uncertain’ concept: 29% of the uncertainty responses account for this concept and 14.7% of the concept mentions reflect some kind of uncertainty.
Table 4. Number and percentage of citances - referring to the concepts in Bourdieu’s oeuvre - reflecting uncertainty (all FOSs together; the concepts are decreasingly sorted by the last column).
Concept Number of uncertainty mentions Percent of uncertainty mentions (n=1,386) Number of concept mentions Percent of concept mentions with uncertainty (n=11,544)
doxa 13 0.94 88 14.77
social capital 402 29.00 2,735 14.70
economic capital 97 7.00 754 12.86
cultural capital 250 18.04 2,001 12.49
distinction 43 3.10 347 12.39
field 164 11.83 1,356 12.09
symbolic capital 65 4.69 564 11.52
habitus 208 15.01 1,927 10.79
symbolic violence 19 1.37 178 10.67
reflexivity 8 0.58 85 9.41
reproduction 27 1.95 331 8.16
social space 12 0.87 156 7.69
practice 78 5.63 1,022 7.63
Total 1,386 100.00 11,544 12.01
Uncertainty mentions vary from a high of nearly 15% down to half that proportion. There is no apparent correlation with the number of concept mentions. There may be a pattern in which more general and abstract concepts (e.g., ‘social space’, ‘practise’, etc.) have low uncertainty whereas more focused terms which are deployable in detailed research have more uncertainty. In the close-in context of detailed reality, such concepts may be useful tools but their ability to grasp the contours of the realities confronting a researcher may be more wreathed in uncertainties and overwhelmed by complexities.

6 Discussion

Many citation analyses focus on the identification of highly cited publication that are defined by Garfield (1979) as follows: “A highly cited work is one that has been found useful by a relatively large number of people, or in a relatively large number of experiments”. Martin and Irvine (1983) see ‘impact’ as an important aspect of research quality (that can be measured by citations) and differentiate this aspect from two other research quality aspects namely importance and accuracy. One of the problems of conventional citation analysis is that one frequently does not know why a certain publication or author is influential or useful. Against the backdrop of this problem, Bornmann et al. (2019) proposed empirically conducting CCA - a method that can be used to investigate the impact of certain concepts that were introduced in a publication or by a researcher. In the first step of a CCA, it is necessary to identify a certain publication - a classic in literature - that introduced important concepts such as paradigm or social capital. In the second step, the most interesting concepts are derived from the publication (from the classic). In the third step, the selected concepts are searched in the citation context of the publications citing the classic. In the fourth step, the number of cited concepts in the citing publications are analyzed.
In this paper, we exemplarily applied the method by focussing on concepts proposed by Bourdieu in his oeuvre. Future studies (based on similar methods or data) might be undertaken to confirm or reject our empirical results.
Standing back to relate the results to expectations from reviewing the architecture of Bourdieu’s work, there is clearly a development pathway with some concepts emerging (especially social capital) as increasingly more important as Bourdieu’s conceptual apparatus has expanded and as his more empirically-orientated concepts have more vigorously been pressed into service. The three key concepts are the trio of social and cultural capital together with habitus, each of which comprises a large part of any researcher’s tool-kit of Bourdieu’s concepts. However, more central concepts which are the center of Bourdieu’s overall conceptual architecture, such as symbolic capital and symbolic violence, which provide the central dynamic of his approach, have been seldom cited, presumably being assumed to provide unproblematic conceptual foundations for more extensions of his work. As the Bourdieu conceptual apparatus expands, it eats up the conceptual foundations on which this expansion was built. It is more recent acquisitions to Bourdieu’s work which other researchers progressively turn to. ‘Reflexivity’ is a central pillar of Bourdieu’s work, especially during his later years. Its low utilization suggests, however, that it is Bourdieu’s more empirical writings rather than theoretical, critical, or even methodological writings that are more frequently being used.
The disciplinary spread is limited to sociology and immediately cognate disciplines, while deployment of his concepts across other social science disciplines let alone the humanities is sparse.
Bornmann et al. (2019) and Crothers et al. (2020) mentioned some limitations of CCA. Similar limitations apply to the current study:
(1) The selection of Bourdieu’s concepts might be biased. Two authors (LB and CC) of the current study are sociologists; one of these authors (CC) is a specialist in social theories. Other researchers might select other concepts, but most of the concepts will be identical to those that we selected. The search for (important) concepts in an oeuvre might be supported by the newly introduced page citation analysis (PCA). In ‘cited reference search’ of the Web of Science (WoS, Clarivate), page numbers are included from the citing authors (Hammarfelt, 2011). Frequent mentions of certain page numbers that result from PCA might point to important concepts introduced in a publication. It is an advantage of the cited reference search (and thus PCA) that it is not restricted to linked papers in WoS. We recommend therefore that future research try PCA in combination with CCA and compare the results with the original CCA.
(2) The formulation of search terms for identifying the concepts and for detecting uncertainty are clear limitations of the study. We hope that these processes can be better standardized in future studies, e.g., by developing a list of words that are definitely connected to the uncertainty of concepts.
(3) It is another limitation of CCA that the wording and span of citation contexts influence their proper assignment to concepts and uncertainty. The length of citation contexts is very different, and it is not clear what the reasons for the differences are. The longer the citation contexts are in the database, the higher the probability is that certain search terms can be found. Thus, standards should be developed in future studies for the ideal length of citation contexts for receiving reliable and valid CCA results.
(4) The non-transparent assignment of FOSs to publications in MA is another limitation. MA algorithmically assigns FOS to papers on the single paper basis. The quality of the algorithm and its function are unclear. There is the risk that algorithmic FOS assignments are not accurate. For example, the accuracy of another algorithm for assigning fields to publications that is based on direct citation relations has been questioned (Haunschild, Marx, French, & Bornmann, 2018; Haunschild, Schier, Marx, & Bornmann, 2018).
(5) The coverage of the employed database MA is not very well known. There are no known biases regarding language coverage. However, it is to be expected that MA had a bias to higher coverage of literature that is available on the internet. Since Microsoft decommissioned MA at the end of 2021, new databases should be made accessible for CCA. For example, some years ago, Clarivate started to capture citation contexts from publications that could be used in principle for CCA. However, Clarivate unfortunately still does not provide the citances.
(6) This method is weak on showing the relationships amongst the concepts used by an author and also the evolution of the author’s overall framework. Future studies may develop methods (e.g., network analysis) that can be used to analyze relationships and evolutions. These methods have been developed in bibliometric research (see, e.g., Milojević, 2014) and can be adapted to citation context analyses.
Despite these limitations, CCA is a promising method for enriching conventional citation analyses. Since the MA database is no longer maintained by Microsoft, it would be of great interest to use citation context data from other databases in future CCA and compare the results with those based on MA. Future studies using other databases may be able to present results in more detail. It would be interesting to know which citing authors use certain concepts, in which language, and with what purposes in mind. So, further quantitative and qualitative research should be undertaken to extend our line of inquiry further.

Author contributions

Lutz Bornmann (bornmann@gv.mpg.de): Conceptualization (Equal), Formal analysis (Equal), Investigation (Equal), Writing - original draft (Equal), Writing - review & editing (Equal);
Charles Crothers: Conceptualization (Equal), Formal analysis (Equal), Investigation (Equal), Writing - original draft (Equal);
Robin Haunschild (r.haunschild@fkf.mpg.de): Conceptualization (Equal), Data curation (Equal), Formal analysis (Equal), Investigation (Equal), Methodology (Equal), Writing - original draft (Equal), Writing - review & editing (Equal).
[1]
Aksnes D. W., Langfeldt L., & Wouters P. (2019). Citations, citation indicators, and research quality: An overview of basic concepts and theories. Sage Open, 9(1). https://doi.org/10.1177/2158244019829575

[2]
Anon. (2009). Experts still needed. Nature, 457(7225), 7-8.

[3]
Aroeira R. I., & Castanho M. A. R. B. (2020). Can citation metrics predict the true impact of scientific papers? FEBS Journal, 287(12), 2440-2448. https://doi.org/10.1111/febs.15255

DOI PMID

[4]
Bornmann L., & Hans-Dieter D. (2008). What do citation counts measure? A review of studies on citing behavior. Journal of Documentation, 64(1), 45-80. doi: 10.1108/00220410810844150.

[5]
Bornmann L., Wray K.B. & Haunschild R. (2019). Citation concept analysis (CCA): A new form of citation analysis revealing the usefulness of concepts for other researchers illustrated by two exemplary case studies including classic books by Thomas S. Kuhn and Karl R. Popper. Scientometrics, 122(1), 1051-1074.

[6]
Bornmann L., Wray K.B. & Haunschild R. (2020). Correction to: Citation concept analysis (CCA): A new form of citation analysis revealing the usefulness of concepts for other researchers illustrated by exemplary case studies including classic books by Thomas S. Kuhn and Karl R. Popper. Scientometrics, 124, 2737. https://doi.org/10.1007/s11192-020-03495-5

[7]
Bourdieu P. (1984) Distinction: A social critique of the judgement of taste. Harvard University Press.

[8]
Bourdieu P. (1986) The forms of capital. in John Richardson (Ed.), Handbook of theory and research for the sociology of education. Greenwood, 241-258.

[9]
Bourdieu P. (1999) The weight of the world: Social suffering in contemporary society. Stanford University Press.

[10]
Boyack K., van Eck N. J., Colavizza G., & Waltman L. (2018). Characterizing in-text citations in scientific articles: A large-scale analysis. Journal of Informetrics, 12(1), 59-73.

[11]
Calhoun C., Lipuma E., & Postone M. (Eds.). (1993). Bourdieu: Critical perspectives. University of Chicago Press.

[12]
Chen C., Song M., & Heo G. E. (2018). A scalable and adaptive method for finding semantically equivalent cue words of uncertainty. Journal of Informetrics, 12(1), 158-180. https://doi.org/10.1016/j.joi.2017.12.004

[13]
Cole S. (1992). Making science: Between nature and society. Harvard University Press.

[14]
Cronin B. (1982). Norms and functions in citation: The view of journal editors and referees in psychology. Social Science Information Studies, 2(2), 65-78.

[15]
Cronin B., & Meho L. (2009). Receiving the French: A bibliometric snapshot of the impact of ‘French theory’ on information studies. Journal of Information Science, 35(4), 398-413. https://doi.org/10.1177/0165551508100831

[16]
Charles C., Bornmann L., & Haunschild R. (2020). Citation concept analysis (CCA) of Robert K. Merton’s book Social Theory and Social Structure: How often are certain concepts from the book cited in subsequent publications? Quantitative Science Studies, 1(2), 675-690. https://doi.org/10.1162/qss_a_00029

[17]
Cumming G., & Calin-Jageman R. (2016). Introduction to the new statistics: Estimation, Open Science, and beyond. Taylor & Francis.

[18]
Garfield E. (1979). Citation indexing: Its theory and application in science, technology, and humanities. John Wiley & Sons.

[19]
Grenfell M. (Ed.). (2014). Pierre Bourdieu: Key concepts. Routledge.

[20]
Hammarfelt B. (2011). Citation analysis on the micro level: The example of Walter Benjamin’s Illuminations. Journal of the American Society for Information Science and Technology, 62(5), 819-830. https://doi.org/10.1002/asi.21504

[21]
Hammarfelt B., Rushforth A. D., & de Rijcke S. (2020). Temporality in academic evaluation: ‘Trajectoral thinking’ in the assessment of biomedical researchers. Valuation Studies, 7, 33. https://doi.org/10.3384/VS.2001-5992.2020.7.1.33

[22]
Haunschild R., Hug S. E., Brändle M. P., & Bornmann L. (2018). The number of linked references of publications in Microsoft Academic in comparison with the Web of Science. Scientometrics, 114(1), 367-370. https://doi.org/10.1007/s11192-017-2567-8

[23]
Haunschild R., Marx W., French B., & Bornmann L. (2018). Relationship between field-normalized indicators calculated with different approaches of field-categorization. Paper presented at the International Conference on Science and Technology Indicators (STI 2018), Leiden, The Netherlands. https://openaccess.leidenuniv.nl/handle/1887/65267

[24]
Haunschild R., Schier H., Marx W., & Bornmann L. (2018). Algorithmically generated subject categories based on citation relations: An empirical micro study using papers on overall water splitting. Journal of Informetrics, 12(2), 436-447. https://doi.org/10.1016/j.joi.2018.03.004

[25]
Heilbron J. (2011). Practical foundations of theorizing in sociology:The case of Pierre Bourdieu. In C. Camic, N. Gross, & M. Lamon (Eds.) Social knowledge in the making (pp. 181-205). Harvard University Press.

[26]
Hug S. E., & Brändle M. P. (2017). The coverage of Microsoft Academic: Analyzing the publication output of a university. Scientometrics, 113, 1551-1571. https://doi.org/10.1007/s11192-017-2535-3

[27]
Hug S. E., Ochsner M., & Brändle M. P. (2017). Citation analysis with Microsoft Academic. Scientometrics, 111, 371-378. https://doi.org/10.1007/s11192-017-2247-8

[28]
Hyland K. (1996). Talking to the academy: Forms of hedging in science research articles. Written Communication, 13(2), 251-281. https://doi.org/10.1177/0741088396013002004

[29]
Jann B. (2005). Tabulation of multiple response. The Stata Journal, 5(1), 92-122.

[30]
Kuhn T. S. (1962). The structure of scientific revolutions. University of Chicago Press.

[31]
Lee C.-J., & Sohn D. (2016). Mapping the social capital research in communication: A bibliometric analysis. Journalism & Mass Communication Quarterly, 93(4), 728-749. https://doi.org/10.1177/1077699015610074

[32]
Liu M. (1993). Progress in documentation - the complexities of citation practice: A review of citation studies. Journal of Documentation, 49, 370-408.

[33]
Maares P., & Hanusch F. (2020). Interpretations of the journalistic field: A systematic analysis of how journalism scholarship appropriates Bourdieusian thought. Journalism, 23(4), 736-754. https://doi.org/10.1177/1464884920959552

[34]
MacRoberts M. H., & MacRoberts B. R. (2017). The mismeasure of science: Citation analysis. Journal of the Association for Information Science and Technology, 69(3), 474-482. https://doi.org/10.1002/asi.23970

[35]
Marí-Sáez V.-M., & Ceballos-Castro G. (2019). Opening the black box of citations: A qualitative analysis on the basis of the taxonomy of Erikson and Erlandson. Communication Theory, 29(4), 463-481. https://doi.org/10.1093/ct/qty027

[36]
Martin B., & Irvine J. (1983). Assessing basic research: Some partial indicators of scientific progress in radio astronomy. Research Policy, 12(2), 61-90.

[37]
Medvetz T., & Sallaz J. J. (Eds.). (2018). The Oxford handbook of Pierre Bourdieu. Oxford University Press.

[38]
Merton R. K. (1949). Social theory and social structure: Toward the codification of theory and research. Free Press.

[39]
Milojević S. (2014). Network analysis and indicators. In Y. Ding, R. Rousseau, & D. Wolfram (Eds.), Measuring scholarly impact (pp. 57-82). Springer International Publishing.

[40]
Petrovich E. (2018). Citation analysis and the history of analytic philosophy. Journal of Interdisciplinary History of Ideas, 7(13), 11:11-11:21.

[41]
Popper K. (1934). Logik der Forschung: Zur Erkenntnistheorie der modernen Naturwissenschaft. Springer.

[42]
Popper K. (1959). The logic of scientific discovery (2nd ed.). Routledge.

[43]
Popper K. (1962). Conjectures and refutations: The growth of scientific knowledge. Basic Books.

[44]
Sallaz J., & Zavisca J. (2007). Bourdieu in American sociology, 1980-2004. Annual Review of Sociology, 33, 21-41.

[45]
Swartz D. (1997). Culture and power: The sociology of Pierre Bourdieu. University of Chicago Press.

[46]
Sieweke J. (2014). Pierre Bourdieu in management and organization studies: A citation context analysis and discussion of contributions. Scandinavian Journal of Management, 30(4), 532-543. https://doi.org/10.1016/j.scaman.2014.04.004

[47]
Small H. (2018). Characterizing highly cited method and non-method papers using citation contexts: The role of uncertainty. Journal of Informetrics, 12(2), 461-480. https://doi.org/10.1016/j.joi.2018.03.007

[48]
Small H., & Klavans R. (2019). Citations and certainty: A new interpretation of citation counts. Scientometrics, 118(3), 1079-1092. https://doi.org/10.1007/s11192-019-03016-z

DOI

[49]
Tahamtan I., & Bornmann L. (2019). What do citation counts measure? An updated review of studies on citations in scientific documents published between 2006 and 2018. Scientometrics, 121(3), 1635-1684. https://doi.org/10.1007/s11192-019-03243-4

DOI

[50]
van Raan A. F. J. (2019). Measuring science:Basic principles and application of advanced bibliometrics. In W. Glänzel, H. F. Moed, U. Schmoch, & M. Thelwall (Eds.) Springer handbook of science and technology indicators (pp. 237-280). Springer International Publishing.

[51]
Wacquant L. (2005). Habitus. In J. Becket & M. Zafirovski (Eds.), International encyclopedia of economic sociology (pp. 106-110). Routledge.

[52]
Wacquant L. (2017). Practice and symbolic power in Bourdieu: The view from Berkeley. Journal of Classical Sociology, 17(1), 55-69.

[53]
Wang K., Shen I., Huang C., Wu C.-H., Dong Y., & Kanakia A. (2020). Microsoft Academic Graph: When experts are not enough. Quantitative Science Studies, 1(1), 396-413. https://doi.org/10.1162/qss_a_00021

[54]
Zavisca J., & Sallaz J. (2008). From the margins to the mainstream: The curious convergence of Pierre Bourdieu and US sociology. Sociologica, 2.

[55]
Zuckerman H. (2018). The sociology of science and the Garfield effect: Happy accidents, unanticipated developments and unexploited potentials. Frontiers in Research Metrics and Analytics, 3(20). https://doi.org/10.3389/frma.2018.00020

Outlines

/

京ICP备05002861号-43

Copyright © 2023 All rights reserved Journal of Data and Information Science

E-mail: jdis@mail.las.ac.cn Add:No.33, Beisihuan Xilu, Haidian District, Beijing 100190, China

Support by Beijing Magtech Co.ltd E-mail: support@magtech.com.cn