Skip to content

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

output dev set score

Yizhou Chidf7a04dd1993
diff --git a/expo/data/custom_task.py b/expo/data/custom_task.py
index fe366d7ea..c4dd0012c 100644
--- a/expo/data/custom_task.py
+++ b/expo/data/custom_task.py
@@ -24,6 +24,7 @@ COMPETITION INSTRUCTIONS
- output_dir: {output_dir}
- Besides `submission.csv`, you should also save your output in the output directory.
- You should split the training data into train and dev set.
+- You should use the dev set to improve your model. Print the final dev set score after training.
- Save the prediction results of BOTH the dev set and test set in `dev_predictions.csv` and `test_predictions.csv` respectively in the output directory. They should be in the same format as the `submission.csv`.
- Perform data analysis, data preprocessing, feature engineering, and modeling to predict the target. {special_instruction}
**Do not make any plots or visualizations.**