A new method for analyzing public consultation data
2024-03-28
There has been a recent turn toward public participation in constitutional design (Choudhry and Tushnet 2020).
Citizen consultations produce voluminous textual data that are challenging to structure and analyze (Houlihan and Bisarya 2021).
The value of such consultations has been largely symbolic (Blount 2011; Ginsburg, Elkins, and Blount 2009)—until now.
Using data from Chile’s 2016 consultation process, we develop an approach that we call conceptual ecology.
Idea Representation: How do the ideas suggested by Chilean participants compare with the universe of ideas in the world’s constitutions?
Consultation Structure: What is the relationship between topics raised by participants and the administrative level at which consultations were conducted?
Residential Context: What is the relationship between topics raised by participants and the type of municipality where consultation participants live?
Reference ontology: 334 constitutional topics defined by the Comparative Constitutions Project (CCP) (Elkins and Ginsburg 2007).
National constitutions: 192 current constitutions transformed into 163,102 text segments.
Chilean consultation data: 264,800 consultation responses collected at three administrative levels (local, provincial, regional).
Google’s Universal Sentence Encoder (USE-3) encodes multilingual textual data, including Spanish, as vectors in a 512-dimension space.
The angular distance between two sentence-level embeddings provides a measure of the proximity and therefore semantic similarity of two sentences.
Semantic similarity scores are values between 0.0 (no shared meaning) and 1.0 (identical words and meaning).
Our threshold for identifying “significant” results is 0.7.
Our methodology:
Analyzes and translates valuable consultation data into something actionable by constitutional practitioners, researchers, and civil society.
Has the power to increase the reach and impact of public input into constitution-making, which is too often underutilized.
Can be applied to many other projects, such as ontology alignment.
If you have any questions, you can send me an email 📬 at mjmartin@utexas.edu.