Replication Code for: Meta-Uncertainty in Bayesian Model Comparison (doi:10.18419/darus-3514)

View:

Part 1: Document Description
Part 2: Study Description
Part 3: Data Files Description
Part 4: Variable Description
Part 5: Other Study-Related Materials
Entire Codebook

Replication Code for: Meta-Uncertainty in Bayesian Model Comparison

doi:10.18419/darus-3514

DaRUS

2023-05-25

1

Schmitt, Marvin, 2023, "Replication Code for: Meta-Uncertainty in Bayesian Model Comparison", https://doi.org/10.18419/darus-3514, DaRUS, V1, UNF:6:zUDr3KGdcaDCy+jFtcz8lA== [fileUNF]

Replication Code for: Meta-Uncertainty in Bayesian Model Comparison

doi:10.18419/darus-3514

Schmitt, Marvin (Universität Stuttgart)

R

Python

EXC-2075 - 390740016

EXC-2181 - 390900948

CyVy-RF2021-16

DaRUS

Schmitt, Marvin

Schmitt, Marvin

Schmitt, Marvin

2023-05-19

https://doi.org/10.18419/darus-3514

Computer and Information Science, Bayesian Inference, Machine Learning, Uncertainty Quantification, Model Comparison

Machine Learning

This dataverse contains the code for the paper Meta-Uncertainty in Bayesian Model Comparison: <a href="https://doi.org/10.48550/arXiv.2210.07278">https://doi.org/10.48550/arXiv.2210.07278</a> Note that the R code is structured as a package, thus requiring a local installation with subsequent loading via <code>library(MetaUncertaintyPaper)</code>. The experiments from the accompanying paper (see below) are implemented in the <code>experiments/</code> directory. All installation instructions can be found in the README.

Schmitt, M., Radev, S. T., Bürkner, P.-C. (2023). Meta-Uncertainty in Bayesian Model Comparison. Proceedings of The 26th International Conference on Artificial Intelligence and Statistics, PMLR 206:11-29, 2023.

Schmitt, M., Radev, S. T., Bürkner, P.-C. (2023). Meta-Uncertainty in Bayesian Model Comparison. Proceedings of The 26th International Conference on Artificial Intelligence and Statistics, PMLR 206:11-29, 2023.

• Number of cases: 1000

• No. of variables per record: 5

• Type of File: text/tab-separated-values

UNF:6:0S3zNKpiYSHYquMApi4R5A==

• Number of cases: 3

• No. of variables per record: 1

• Type of File: text/tab-separated-values

UNF:6:4MTZaR1bjnlGgBR28D2E6g==

• Number of cases: 200

• No. of variables per record: 6

• Type of File: text/tab-separated-values

UNF:6:2rnIGGUTBeVw/dNr/7gH8w==

• id - id
• true_model_idx - true_model_idx
• pmp1 - pmp1
• pmp2 - pmp2
• pmp3 - pmp3
• # Header - # Header
• id - id
• idx - idx
• true_model - true_model
• alpha_1 - alpha_1
• alpha_2 - alpha_2
• alpha_3 - alpha_3

f231155 Location:

Summary Statistics: Mean 499.5; StDev 288.8194360957494; Min. 0.0; Valid 1000.0; Max. 999.0

Variable Format: numeric

Notes: UNF:6:9/V5rT/9R8VP66r7LazxCA==

f231155 Location:

Summary Statistics: StDev 0.8140649247459946; Mean 1.9690000000000052; Max. 3.0; Min. 1.0; Valid 1000.0

Variable Format: numeric

Notes: UNF:6:hhLzpmLW+3n1JC3tjm9SLQ==

f231155 Location:

Summary Statistics: StDev 0.2830705641472487; Max. 0.99899742311984; Mean 0.3390763731155825; Valid 1000.0; Min. 0.014078361300794408

Variable Format: numeric

Notes: UNF:6:Du0aR2OBZDmNL64hKMd2PQ==

f231155 Location:

Summary Statistics: Valid 1000.0; StDev 0.1939329515266703; Max. 0.6063014640841559; Min. 0.0010025768801599979; Mean 0.33092663283296464

Variable Format: numeric

Notes: UNF:6:Jy3Dc9MjoPuauRjPKbVR5w==

f231155 Location:

Summary Statistics: Valid 1000.0; Mean 0.32999699405145294; Min. 1.0932622236027348E-27; Max. 0.9342135219048038; StDev 0.3660690539935352;

Variable Format: numeric

Notes: UNF:6:Fg810ei1htYqk5in+qew8g==

f231097 Location:

Summary Statistics: Min. 1.0; Mean 1.34159; Valid 3.0; Max. 1.83133; StDev 0.43501575730081316;

Variable Format: numeric

Notes: UNF:6:4MTZaR1bjnlGgBR28D2E6g==

f231156 Location:

Summary Statistics: StDev 57.879184513951124; Max. 199.0; Valid 200.0; Mean 99.5; Min. 0.0

Variable Format: numeric

Notes: UNF:6:XPk0VoKmg41XD/1Kqw1cHw==

f231156 Location:

Summary Statistics: Mean 100.5; Valid 200.0; Max. 200.0; Min. 1.0; StDev 57.879184513951124

Variable Format: numeric

Notes: UNF:6:BC04f2O1V2LPMCc9+o3yaw==

f231156 Location:

Summary Statistics: Max. 3.0; Valid 200.0; Mean 1.9449999999999998; StDev 0.790632975857041; Min. 1.0;

Variable Format: numeric

Notes: UNF:6:BOFXEIyyz+48OEqntpWLVA==

f231156 Location:

Summary Statistics: StDev 4.557066367332951; Min. 1.0; Valid 200.0; Mean 3.892997818; Max. 14.088361;

Variable Format: numeric

Notes: UNF:6:L75nTSHTBV7Y/jyhxcBm7g==

f231156 Location:

Summary Statistics: StDev 7.4992119826165125; Valid 200.0; Max. 31.692003; Min. 1.0025028; Mean 7.032073868

Variable Format: numeric

Notes: UNF:6:J/h0oWuc8PIT7jkJGOIntw==

f231156 Location:

Summary Statistics: Mean 7.9289673469999995; StDev 9.729342842369165; Min. 1.0004036; Max. 68.53303; Valid 200.0;

Variable Format: numeric

Notes: UNF:6:TnI2wy8/amsdc7Q6VtqfDQ==

Label:

.gitignore

application/octet-stream

Label:

.Rbuildignore

application/octet-stream

Label:

.Rprofile

application/octet-stream

Label:

DESCRIPTION

text/plain; charset=UTF-8

Label:

MetaUncertaintyPaper.Rproj

application/octet-stream

Label:

NAMESPACE

text/plain; charset=US-ASCII

Label:

README.md

text/markdown

Label:

README.Rmd

text/x-r-notebook

Label:

renv.lock

application/octet-stream

Label:

requirements.txt

text/plain

Label:

experiment_1.R

type/x-r-syntax

Label:

experiment_2.R

type/x-r-syntax

Label:

experiment_3.R

type/x-r-syntax

Label:

M_1.stan

application/octet-stream

Label:

M_2.stan

application/octet-stream

Label:

M_3.stan

application/octet-stream

Label:

meta-uncertainty-banner.png

image/png

Label:

meta-uncertainty-figure-1.png

image/png

Label:

meta_uncertainty_illustration.pptx

application/vnd.openxmlformats-officedocument.presentationml.presentation

Label:

apply_color_map.Rd

application/octet-stream

Label:

calculate_ml_bayesian_linear_regression.Rd

application/octet-stream

Label:

continuity_correction.Rd

application/octet-stream

Label:

dummy_function.Rd

application/octet-stream

Label:

flat_lower_triag_to_symmetric.Rd

application/octet-stream

Label:

get_meta_model_posteriors.Rd

application/octet-stream

Label:

get_prep.Rd

application/octet-stream

Label:

logistic_normal_mixture.Rd

application/octet-stream

Label:

log_mean_exp.Rd

application/octet-stream

Label:

log_sum_exp.Rd

application/octet-stream

Label:

plot_simplex_scatter.Rd

application/octet-stream

Label:

SEIR.Rd

application/octet-stream

Label:

simulate_data_and_pmps.Rd

application/octet-stream

Label:

simulate_data_bayesian_linear_regression.Rd

application/octet-stream

Label:

SIR.Rd

application/octet-stream

Label:

blank.txt

text/plain

Label:

experiment-2-df_wide.RData

application/x-rlang-transport

Label:

experiment-2-M.RData

application/gzip

Label:

experiment-2-simulated_data_matrix.RData

application/x-rlang-transport

Label:

experiment_1_meta_model_posteriors.RData

application/x-rlang-transport

Label:

experiment_3_meta_model_posteriors.RData

application/x-rlang-transport

Label:

blank.txt

text/plain

Label:

BetaBinomial.ipynb

application/x-ipynb+json

Label:

experiment_3_python.ipynb

application/x-ipynb+json

Label:

checkpoint

text/plain; charset=US-ASCII

Label:

ckpt-25.data-00000-of-00001

application/octet-stream

Label:

ckpt-25.index

application/octet-stream

Label:

bayesian_linear_regression.R

type/x-r-syntax

Label:

brms_helper.R

type/x-r-syntax

Label:

computational_helpers.R

type/x-r-syntax

Label:

get_color_map.R

type/x-r-syntax

Label:

get_meta_model_posteriors.R

type/x-r-syntax

Label:

logistic_normal_mixture.R

type/x-r-syntax

Label:

misc.R

type/x-r-syntax

Label:

plot_simplex_scatter.R

type/x-r-syntax

Label:

seir_simulator.R

type/x-r-syntax

Label:

simulate_data_and_pmps.R

type/x-r-syntax

Label:

sir_simulator.R

type/x-r-syntax

Label:

.gitignore

application/octet-stream

Label:

activate.R

type/x-r-syntax

Label:

settings.dcf

application/octet-stream

Label:

testthat.R

type/x-r-syntax

Label:

test-log_sum_exp.R

type/x-r-syntax