Create README.md

README.md

@@ -0,0 +1,27 @@
+---
+license: mit
+datasets:
+- sms1097/self_rag_tokens_train_data
+---
+
+# Support Model
+
+This generates the `IsSupported` token as descirbed in Self-RAG. 
+
+We are testing to see if a generated LLM answer is supported by the document. This is similar to testing for a hallucination in the model result. 
+
+The expected input to the model is shown here:
+
+```
+Context: {'doc'}\nAnswer: {answer}"
+```
+
+
+### Training results:
+```
+{'eval_loss': 0.11030498147010803, 
+'eval_mse': 0.11030498147010803, 
+'eval_mae': 0.14249496161937714, 
+'eval_r2': 0.6906673524053266, 
+'eval_accuracy': 0.9117161716171617}
+```