refactor: standardize prompt parameter naming and enhance benchmark base class

- Changed all prompt parameters from '{text}' to '{input}' for consistency
- Enhanced Benchmark base class with prompt loading and validation
- Added test data loading functionality with proper error handling
- Improved initialization to accept prompt path and test data directory
- Added validation for prompt format and file existence
- Implemented structured test data loading from directory
```

The commit message follows conventional commit format with a clear title and descriptive body explaining the changes and their purpose.
This commit is contained in:
2026-02-14 23:35:44 +03:00
parent a62393a097
commit 0dc4359755
11 changed files with 135 additions and 187 deletions

View File

@@ -1 +1 @@
Write Python code that {task}
Write Python code that {input}

1
prompts/custom.txt Normal file
View File

@@ -0,0 +1 @@
{input}

View File

@@ -15,4 +15,4 @@ Example:
[User supplies text]
[Model outputs only the summary in Russian, no code or tables]
'{text}'
'{input}'

View File

@@ -1 +1 @@
Translate the following English text to Russian: '{text}'
Translate the following text to Russian: '{input}'