Update documentation to reflect new TXT format with separator for summarization tests instead of JSON format. Clarify that expected field may be empty if summary generation fails.
feat: change test generation to TXT format with separator
Change test generation from JSON to TXT format with TEST_SEPARATOR. Add filename sanitization function to handle MongoDB record IDs. Update output path and file naming logic. Add attempt to generate expected summary through LLM with fallback to empty string.
Previously, report filenames included a timestamp (e.g., `benchmark_20231015_143022.md`), which caused issues when regenerating reports as it would create duplicate files. The timestamp is no longer included in the filenames to ensure consistent naming and avoid overwriting conflicts. This change affects both benchmark and summary report generation in `src/utils/report.py`.
- Added pymongo==3.13.0 to requirements.txt for MongoDB connectivity
- Implemented generate_summarization_from_mongo.py script to generate summarization tests from MongoDB
- Updated run.sh to support 'gen-mongo' command for MongoDB test generation
- Enhanced scripts/README.md with documentation for new MongoDB functionality
- Improved help text in run.sh to clarify available commands and usage examples
```
This commit adds MongoDB integration for test generation and updates the documentation and scripts accordingly.
Added documentation for test generation through Ollama, including new command-line arguments for `generate_tests.py` and updated `run.sh` script. Also added a new `gen` command to `run.sh` for generating tests via Ollama. This improves usability by providing clear instructions and automation for test generation.
Added **/__pycache__/ to .gitignore to prevent Python cache directories from being tracked across all directories. This improves repository cleanliness and reduces unnecessary files in version control.
- Added run.sh script with init, upd, run, and clean commands
- Updated README.md to document run.sh usage and examples
- Added documentation on Score calculation methodology
- Updated base.py to include score calculation logic
```
This commit message follows the conventional commit format with a short title and a detailed description of the changes made. It explains what was changed and why, making it clear and informative.
