Skip to content

A LLM trained only on data from certain time periods to reduce modern bias

Python

Update README.md

Hayk Grigorian8f0f538756e4
diff --git a/README.md b/README.md
index 4537714..63a6c3f 100644
--- a/README.md
+++ b/README.md
@@ -98,6 +98,7 @@ Corrected:
- 90GB of 1800-1875 London texts
- 136,344 documents
+- The full 90GB is not avalaible yet as it hasn't been tokenized but you can find a 15GG sample here: https://huggingface.co/datasets/haykgrigorian/TimeCapsuleLLM-London-1800-1875-v2-15GB
### Bias Stats
![Pronoun bias](https://github.com/haykgrigo3/TimeCapsuleLLM/blob/main/london_1800_1875_v2mini_eval1/pronoun_bias.png)
@@ -195,5 +196,6 @@ GPU: A100 SXM rented
+