environment file: multivalue.yml (also used for analysis)

make_transformed_datasets.py

environment file: eval_harness.yml

Eval-Harness prompts and files can be found at https://github.com/peridotleaves/lm-evaluation-harness/tree/ed5ca052abdc6c02cdc0c46aff7611767919dda5

under lm_eval/tasks/[dataset_name]

All statistical analysis performed in grammar_rule_effects.ipynb. Necessary eval-harness files are expected in default folder path.

perplexity.py

regression.py

process_qa_datasets.ipynb