Now showing items 1-10 of 10

    • Democracy Promotion and Electoral Quality: A Disaggregated Analysis 

      Steele, Carie A.; Pemstein, Daniel; Meserve, Stephen A. (2020-09)
      The international community spends significant sums of money on democracy promotion and support, focusing especially on producing competitive and transparent electoral environments in the developing world. In theory, this ...
    • Estimating Latent Traits from Expert Surveys: An Analysis of Sensitivity to Data Generating Process 

      Marquardt, Kyle L.; Pemstein, Daniel (2018)
      Models for converting expert-coded data to point estimates of latent concepts assume different data-generating processes. In this paper, we simulate ecologically-valid data according to different assumptions, and examine ...
    • Evaluating and Improving Item Response Theory Models for Cross-National Expert Surveys 

      Pemstein, Daniel; Tzelgov, Eitan; Wang, Yi-ting (University of Gothenburg, 2015)
      The data produced by the Varieties of Democracy (V-Dem) project contains ordinal ratings of a multitude of country-level indicators across space and time, with multiple experts providing judgments for each country-year ...
    • Experts, Coders, and Crowds: An analysis of substitutability 

      Marquardt, Kyle L.; Pemstein, Daniel; Sanhueza Petrarca, Constanza; Seim, Brigitte; Wilson, Steven Lloyd; Bernhard, Michael; Coppedge, Michael; Lindberg, Staffan I. (2017)
      Recent work suggests that crowd workers can replace experts and trained coders in common coding tasks. However, while many political science applications require coders to both and relevant information and provide judgment, ...
    • IRT models for expert-coded panel data 

      Marquardt, Kyle L.; Pemstein, Daniel (2017)
      Data sets quantifying phenomena of social-scientific interest often use multiple experts to code latent concepts. While it remains standard practice to report the average score across experts, experts likely vary in both ...
    • Strategies of Validation: Assessing the Varieties of Democracy Corruption Data 

      McMann, Kelly; Pemstein, Daniel; Seim, Brigitte; Teorell, Jan; Lindberg, Staffan I. (2016)
      Social scientists face the challenge of determining whether their data are valid, yet they lack prac- tical guidance about how to do so. Existing publications on data validation provide mostly abstract information for ...
    • The V-Dem Measurement Model: Latent Variable Analysis for Cross-National and Cross-Temporal Expert-Coded Data 

      Pemstein, Daniel; Marquardt, Kyle L.; Tzelgov, Eitan; Wang, Yi-ting; Miri, Farhad (2015)
      The Varieties of Democracy (V–Dem) project relies on country experts who code a host of ordinal variables, providing subjective ratings of latent—that is, not directly observable— regime characteristics over time. Sets of ...
    • The V-Dem Measurement Model: Latent Variable Analysis for Cross-National and Cross-Temporal Expert-Coded Data 

      Pemstein, Daniel; Marquardt, Kyle L.; Tzelgov, Eitan; Wang, Yi-ting; Medzihorsky, Juraj; Krusell, Joshua; Miri, Farhad; von Römer, Johannes (2020-03)
      The Varieties of Democracy (V-Dem) project relies on country experts who code a host of ordinal variables, providing subjective ratings of latent- that is, not directly observable- regime characteristics over time. Sets ...
    • The V–Dem Measurement Model: Latent Variable Analysis for Cross-National and Cross-Temporal Expert-Coded Data 

      Pemstein, Daniel; Marquardt, Kyle L.; Tzelgov, Eitan; Wang, Yi-ting; Medzihorsky, Juraj; Krusell, Joshua; Miri, Farhad; Römer, Johannes von (2022-03)
      The Varieties of Democracy (V–Dem) project relies on country experts who code a host of ordinal variables, providing subjective ratings of latent—that is, not directly observable—regime characteristics over time. Sets of ...
    • What Makes Experts Reliable? 

      Marquardt, Kyle L.; Pemstein, Daniel; Seim, Brigitte; Wang, Yi-ting (2018)
      Many datasets use experts to code latent quantities of interest. However, scholars have not explored either the factors affecting expert reliability or the degree to which these factors influence estimates of latent concepts. ...