Skip to content

A LLM trained only on data from certain time periods to reduce modern bias

Python

Organized files into london_1800_1850_v0 folder

Hayk Grigorian65f776c81785
diff --git a/.DS_Store b/.DS_Store
new file mode 100644
index 0000000..1115441
Binary files /dev/null and b/.DS_Store differ
diff --git a/configurator.py b/london_1800_1850_v0/configurator.py
similarity index 100%
rename from configurator.py
rename to london_1800_1850_v0/configurator.py
diff --git a/merges.txt b/london_1800_1850_v0/merges.txt
similarity index 100%
rename from merges.txt
rename to london_1800_1850_v0/merges.txt
diff --git a/metadata_london.csv b/london_1800_1850_v0/metadata_london.csv
similarity index 100%
rename from metadata_london.csv
rename to london_1800_1850_v0/metadata_london.csv
diff --git a/model.py b/london_1800_1850_v0/model.py
similarity index 100%
rename from model.py
rename to london_1800_1850_v0/model.py
diff --git a/prepare_dataset.py b/london_1800_1850_v0/prepare_dataset.py
similarity index 100%
rename from prepare_dataset.py
rename to london_1800_1850_v0/prepare_dataset.py
diff --git a/sample.py b/london_1800_1850_v0/sample.py
similarity index 100%
rename from sample.py
rename to london_1800_1850_v0/sample.py
diff --git a/train.py b/london_1800_1850_v0/train.py
similarity index 100%
rename from train.py
rename to london_1800_1850_v0/train.py
diff --git a/train_london.py b/london_1800_1850_v0/train_london.py
similarity index 100%
rename from train_london.py
rename to london_1800_1850_v0/train_london.py
diff --git a/train_tokenizer.py b/london_1800_1850_v0/train_tokenizer.py
similarity index 100%
rename from train_tokenizer.py
rename to london_1800_1850_v0/train_tokenizer.py
diff --git a/train_tokenizer_hf.py b/london_1800_1850_v0/train_tokenizer_hf.py
similarity index 100%
rename from train_tokenizer_hf.py
rename to london_1800_1850_v0/train_tokenizer_hf.py
diff --git a/vocab.json b/london_1800_1850_v0/vocab.json
similarity index 100%
rename from vocab.json
rename to london_1800_1850_v0/vocab.json