second_constantine/ai-benchmark
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: update test format documentation in README

Browse Source 
Update documentation to reflect new TXT format with separator for summarization tests instead of JSON format. Clarify that expected field may be empty if summary generation fails.

feat: change test generation to TXT format with separator

Change test generation from JSON to TXT format with TEST_SEPARATOR. Add filename sanitization function to handle MongoDB record IDs. Update output path and file naming logic. Add attempt to generate expected summary through LLM with fallback to empty string.
This commit is contained in:
second_constantine
2026-01-22 20:40:41 +03:00
parent 2466f1253a
commit 2a04e6c089
21 changed files with 96 additions and 104 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
tests/translation/test1.txt
View File

@@ -1,3 +1,3 @@
Translate the following English text to Russian: 'Hello, how are you today?'
Hello, how are you today?
==============
Привет, как дела сегодня?
Привет, как дела сегодня?

4
tests/translation/test2.txt
View File

@@ -1,3 +1,3 @@
Translate the following Russian text to English: 'Как ваши дела?'
The weather is beautiful today. The sun is shining brightly in the clear blue sky.
==============
How are you?
Сегодня прекрасная погода. Солнце ярко светит на чистом голубом небе.

4
tests/translation/test3.txt
View File

@@ -1,3 +1,3 @@
Translate the following English text to Russian: 'What time is it right now?'
I would like to order a pizza with mushrooms and olives. Could you please bring it to my table?
==============
Который сейчас час?
Я бы хотел заказать пиццу с грибами и оливами. Не могли бы вы принести ее к моему столу?

4
tests/translation/test4.txt
View File

@@ -1,3 +1,3 @@
Translate the following English text to Russian: 'What time is it right now?'
This project requires attention to detail and good communication skills. Teamwork is essential for success.
==============
Который сейчас час?
Этот проект требует внимания к деталям и хороших навыков общения. Командная работа необходима для успеха.

4
tests/translation/test5.txt
View File

@@ -1,3 +1,3 @@
Translate the following English text to Russian: '"The sun is shining brightly."'
Thank you for your help. I really appreciate it.
==============
Солнце светит ярко.
Спасибо за вашу помощь. Я действительно ценю это.