Supplemental materials for "Two Empirical Studies on Audiovisual Semiotics of Uncertainty"

Version 1.0

Vriend, Sita; Hägele, David; Weiskopf, Daniel, 2025, "Supplemental materials for "Two Empirical Studies on Audiovisual Semiotics of Uncertainty"", https://doi.org/10.18419/DARUS-4137, DaRUS, V1, UNF:6:Zv5hIuIcj79NjLNQkI3uBw== [fileUNF]

Learn about Data Citation Standards.

Contact Owner

Dataset Metrics

5 Downloads

Description	We explored the potential of audiovisual semiotics, the use of audiovisual channels, to enhance users' intuitive perception of uncertainty by conducting two user studies. In the first experiment we assessed the intuitiveness of audio/visual pairs. In the second experiment, we investigated the intuitive audiovisual mappings of uncertainty. These supplemental materials contain the files for the experimental setup of the two user studies, experimental stimuli used in both experiments, the data collected from the two experiments and r scripts for analysis.
Subject	Computer and Information Science; Social Sciences
Keyword	Sonification, Uncertainty Visualization, Semiotics
Notes	Users interested in reproducing the results can follow the methodology as reported in the paper and use testbed.psyexp, study.html or testbed.py from the Files section. The analysis code as reported in the R scripts and the data are located the Files section. The testbed.psyexp file can be opened using the psychopy standalone application (https://www.psychopy.org/).
Data Generation	Analysis; Experiment
License/Data Use Agreement	Custom Dataset Terms

Change View

Table

Tree

	1 to 10 of 108 Files	Original Format Archival Format (.tab)
	SupplementalMaterial.pdf Adobe PDF - 921.3 KB Published May 9, 2025 4 Downloads MD5: 432052402c17155df4bb9df8e10fc7c8	Preview "SupplementalMaterial.pdf" Access File File Access Public Download Options Adobe PDF Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	av-sem-analysis.Rproj Analysis/Unknown - 218 B Published May 9, 2025 0 Downloads MD5: 584b2434d675b192dc1614bd62b5b93e	Access File File Access Public Download Options Original File Format Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	demographics.R Analysis/R Syntax - 2.8 KB Published May 9, 2025 0 Downloads MD5: 252c70fb7436d5afb1dc1681f33e1f41	Preview "Analysis/demographics.R" Access File File Access Public Download Options R Syntax Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	exp1.R Analysis/R Syntax - 21.5 KB Published May 9, 2025 0 Downloads MD5: 654f59fb90c8fa3f83dd6e90372f997f R script used to analyse experiment 1	Preview "Analysis/exp1.R" Access File File Access Public Download Options R Syntax Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	exp2.R Analysis/R Syntax - 26.2 KB Published May 9, 2025 0 Downloads MD5: d659eef417247cf1aa020f97fc34199e R script used to analyse experiment 2	Preview "Analysis/exp2.R" Access File File Access Public Download Options R Syntax Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	MappingStrat.R Analysis/R Syntax - 3.4 KB Published May 9, 2025 0 Downloads MD5: e8cd78f03a857a8f7150c977f6099d98	Preview "Analysis/MappingStrat.R" Access File File Access Public Download Options R Syntax Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	PowerAnalysis.R Analysis/R Syntax - 1.0 KB Published May 9, 2025 1 Download MD5: 29f97eb0ff76e54f341ecff6dcd52e74	Preview "Analysis/PowerAnalysis.R" Access File File Access Public Download Options R Syntax Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	ReadMe.txt Analysis/Plain Text - 7.0 KB Published May 9, 2025 0 Downloads MD5: 43798a81858163ddfad241a7bde60be3	Preview "Analysis/ReadMe.txt" Access File File Access Public Download Options Plain Text Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	sanity_check.R Analysis/R Syntax - 6.6 KB Published May 9, 2025 0 Downloads MD5: 4b4c2db155cf93807e66965e30dc8c86	Preview "Analysis/sanity_check.R" Access File File Access Public Download Options R Syntax Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	demographics_data.tab Analysis/Data/Tabular Data - 37.6 KB Published May 9, 2025 0 Downloads 17 Variables, 217 Observations UNF:6:5ChGUm3/ynkvKGu1DIw64Q==	Preview "Analysis/Data/demographics_data.tab" Access File File Access Public Download Options Comma Separated Values (Original File Format) Tab-Delimited RData Download Metadata DDI Codebook v2 Data File Citation Download EndNote XML Download RIS Download BibTeX

Citation Metadata

Persistent Identifier	doi:10.18419/DARUS-4137
Publication Date	2025-05-09
Title	Supplemental materials for "Two Empirical Studies on Audiovisual Semiotics of Uncertainty"
Author	https://ror.org/04vnq7t77https://orcid.org/0009-0008-8530-835X https://ror.org/04vnq7t77https://orcid.org/0000-0002-2679-6882 https://ror.org/04vnq7t77https://orcid.org/0000-0003-1174-1026
Point of Contact	Use email button above to contact. Vriend, Sita (Universität Stuttgart) Weiskopf, Daniel (Universität Stuttgart)
Description	We explored the potential of audiovisual semiotics, the use of audiovisual channels, to enhance users' intuitive perception of uncertainty by conducting two user studies. In the first experiment we assessed the intuitiveness of audio/visual pairs. In the second experiment, we investigated the intuitive audiovisual mappings of uncertainty. These supplemental materials contain the files for the experimental setup of the two user studies, experimental stimuli used in both experiments, the data collected from the two experiments and r scripts for analysis.
Subject	Computer and Information Science; Social Sciences
Keyword	Sonification http://www.wikidata.org/entity/Q1416058 (Wikidata) Uncertainty Visualization http://www.wikidata.org/entity/Q39669417 (Wikidata) Semiotics http://www.wikidata.org/entity/Q60195 (Wikidata)
Topic Classification	Uncertainty Visualization (Wikidata) http://www.wikidata.org/entity/Q39669417 Computer Science (DFGFO) https://w3id.org/dfgfo/2024/443 Social Sciences (DFGFO) https://w3id.org/dfgfo/2024/123
Notes	Users interested in reproducing the results can follow the methodology as reported in the paper and use testbed.psyexp, study.html or testbed.py from the Files section. The analysis code as reported in the R scripts and the data are located the Files section. The testbed.psyexp file can be opened using the psychopy standalone application (https://www.psychopy.org/).
Language	English
Producer	Vriend, Sita (University of Stuttgart)
Production Date	2023-12-06
Production Location	Prolific.com
Contributor	Data Collector: Vriend, Sita
Project	SFB/Transregio 161 Uncertainty Quantification and Analysis in Visualization
Funding Information	DFG: 251654672
Depositor	Vriend, Sita
Deposit Date	2024-04-05
Date of Collection	Start Date: 2023-11-23; End Date: 2023-12-06
Data Type	User performance data; Stimuli; Experimental setup
Software	R, Version: 4.2.2 Rstudio, Version: 2023.12.1 Build 402 Psychopy, Version: V2022.2.4
Other Reference	W. L. Morys-Carter. Screenscale, 2023. doi:10.17605/OSF.IO/8FHQK; J. Peirce, J. R. Gray, S. Simpson, M. MacAskill, R. Höchenberger, H. Sogo, E. Kastman, and J. K. Lindeløv. PsychoPy2: Experiments in behavior made easy. Behavior Research Methods, 51:195-203, 2019. doi:10.3758/s13428-018-01193-y

Process Metadata

Processing Methods

Participant Anonymisation (We replaced Prolific IDs with randomly generated IDs in order to anonymize participants.) ; Parameters: ID

Software

R Version: 4.2.2 (https://cran.r-project.org/) GNU AFFERO GENERAL PUBLIC LICENSE Version 3
Rstudio Version: 2023.12.1 Build 402 (https://posit.co/downloads/) AGPL v3
Psychopy Version: V2022.2.4 (https://www.psychopy.org/) GNU GENERAL PUBLIC LICENSE Version 3 (J. Peirce, J. R. Gray, S. Simpson, M. MacAskill, R. Höchenberger, H. Sogo, E. Kastman, and J. K. Lindeløv. PsychoPy2: Experiments in behavior made easy. Behavior Research Methods, 51:195-203, 2019. doi: 10.3758/s13428-018-01193-y)

Engineering Metadata

Data Generation	Analysis; Experiment
Measured Variables	Reaction time [milliseconds] Visual polarity preference [Binary choice] : positive, negative Probability polarity preference [Binary choice] : high probability, low probability Mapping strategies : Open question
Controlled Variables	Audio dimension : loudness, pulse, frequency Audio polarity : Positive, negative Visual dimension : fuzziness, saturation, brightness, size visual polarity : Positive, negative

Social Science and Humanities Metadata

Unit of Analysis	Individuals
Universe	All participants were fluent in English, had perfect or corrected vision, and had no hearing difficulties. The participants had diverse backgrounds of nationalities, genders, ages, and employment statuses. Their average age was 33 years, ranging from 18 to 76 years. 34.6% identified as female and 65.4% as male. While all participants spoke English, 45.9% spoke English as their mother tongue and the majority spoke English as their second language (54.1%). The participants held diverse nationalities. Most were British (35.6%) or Polish (21.5%). Other represented nationalities were Portugal, the United States, and Hungary.
Data Collector	Vriend, Sita
Sampling Procedure	Representative samples
Target Sample Size	237 We performed power analysis in R using pwrss.f.ancova(). Our intended power is 0.8 to detect a small effect size of 0.10 at an alpha of 0.05 for both experiments. For experiment 1, with design (3w4w), this would result in 130 participants. For experiment 2, with design (2w3w*4w), this would mean 131 participants. However, since participants complete the study at home, we cannot control for environmental conditions such as screen quality, headset quality, distractions, etc. This will result in bigger variations in the data as compared to a lab study. Thus we aim to recruit 50% more, which would result in 197. Additionally, we expect 20% of participants to either not complete the tasks or otherwise be excluded from analysis, which would result in 237 participants in total.
Collection Mode	Online, via prolific (https://www.prolific.com).
Type of Research Instrument	Online experiment
Characteristics of Data Collection Situation	Participants participated online, in an environment of their choosing. Participants used their own PCs and headphones.
Cleaning Operations	Consistency checking, Attention checks, Comprehension check, audio perception check, visual perception check
Other Forms of Data Appraisal	Direct messages from participants
Notes	Extra information Preregistration The preregistration of the experiment can be found on OSF: https://osf.io/ve7t8

Software Metadata (CodeMeta v2.0)

Application Category	Stimuli generation; Experimental setup; Analysis
Programming Language	R; Python; SuperCollider; JavaScript; HTML; PHP
Operating Systems	Windows 10 Enterprise
Software Requirements	SuperCollider 3.13.0 https://supercollider.github.io/ https://supercollider.github.io/downloads.html#windows Python v2024.4.1 https://www.python.org/ https://marketplace.visualstudio.com/items?itemName=ms-python.python PsychoPy v2022.2.4 https://www.psychopy.org/ https://www.psychopy.org/download.html R 4.2.2 https://www.r-project.org/ https://cran.r-project.org/mirrors.html RStudio 2023.12.1 Build 402 https://posit.co/products/open-source/rstudio/ https://posit.co/download/rstudio-desktop/

Privacy Metadata

Special Categories	no
Explicit Consent	yes
Terms of Consent	We will only use the data for research purposes. We might reuse the data for further research within the University of Stuttgart and with its external collaborative partners. The data might be uploaded to public repositories and redistributed from there. We can’t force others to stop redistributing the data or using it in other ways. Data processing might take place outside the European Union (EU), where data protection laws might not be comparable. This can mean potential restrictions of your rights with regards to the data.
Measures	We replaced participants´ Prolific IDs with randomized IDs

Dataset Terms

License/Data Use Agreement

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

Custom Dataset Terms — the following Custom Dataset Terms have been defined for this dataset.

The research data in this dataset is licensed under the CC BY-NC 4.0.
The research software (R; Python; SuperCollider; JavaScript; HTML; PHP files) in this dataset is licensed under the MIT License.
Please reference the dataset when using the data or software.

Dataset Version	Summary	Version Note	Contributors	Published on
No records found.

Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Access

Restricting limits access to published files. People who want to use the restricted files can request access by default. If you disable request access, you must add information about access to the Terms of Access field.

Learn about restricting files and dataset access in the User Guide.

Request Access

Enable access request

You must enable request access or add terms of access to restrict file access.

Terms of Access for Restricted Files

Save Changes

Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.

Edit Retention Period

The selected file or files have already been published. Contact an administrator to change the retention period date or reason of the file or files.

Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Continue

Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired or the files can only be transferred via Globus.

You may request access to any restricted file(s) by clicking the Request Access button.

Ineligible Files Selected

The selected file(s) may not be transferred because you have not been granted access or the file(s) have a retention period that has expired or the files are not Globus accessible.

You may request access to any restricted file(s) by clicking the Request Access button.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 1.9 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired.

Click Continue to download the files you have access to download.

Ineligible Files Selected

Some file(s) cannot be transferred. (They are restricted, embargoed, with an expired retention period, or not Globus accessible.)

Click Continue to transfer the elligible files.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Preview URL

Preview URL can only be used with unpublished versions of datasets.

Unpublished Dataset Preview URL

Are you sure you want to disable the Preview URL? If you have shared the Preview URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? This is permanent and the selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? This is permanent an it will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details

Version:
Last Updated:

Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

You need to Log In to request access.

Dataset Terms

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

This dataset is made available under the following terms. Please confirm and/or complete the information needed below in order to continue.

License/Data Use Agreement

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

Custom terms specific to this dataset Custom Dataset Terms — the following Custom Dataset Terms have been defined for this dataset.

Terms of Use The research data in this dataset is licensed under the CC BY-NC 4.0.
The research software (R; Python; SuperCollider; JavaScript; HTML; PHP files) in this dataset is licensed under the MIT License.
Please reference the dataset when using the data or software.

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Guestbook Name

Collected Data

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

Download URL

https://darus.uni-stuttgart.de/api/access/datafile/

Compute Batch

Clear Batch

Dataset	Persistent Identifier	Change Compute Batch

Compute Batch

Submit for Review

Please use the publication checklist for authors ( https://www.izus.uni-stuttgart.de/en/fokus/darus/publication/ ) to ensure publication readiness. You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

Select if this is a minor or major version update.

Minor Release (1.1)

Major Release (2.0)

Version Note

Publish Dataset

This dataset cannot be published until Visualisierungsinstitut der Universität Stuttgart is published by its administrator.

Publish Dataset

This dataset cannot be published until Visualisierungsinstitut der Universität Stuttgart and DaRUS are published.

Return to Author

Return this dataset to contributor for modification. The reason for return entered below will be sent by email to the author.

Add/Edit a Version Note

Enter the reason this version was created. To learn more about Version Notes, visit the Version Notes section of the User Guide.

Version Note

Styled Citation