Create Testing Framework

.gitignore

@@ -205,3 +205,6 @@ cython_debug/
 marimo/_static/
 marimo/_lsp/
 __marimo__/
+
+# Custom ignores
+.ig-*

README.md

@@ -9,6 +9,10 @@ and sanitization functions to limit data exposure, and ensures least-privilege a
 traditional information flow control systems, ShardGuard avoids complex labeling and taint tracking, offering a more
 practical yet effective path to safe LLM-driven automation.
 
+SGTest - ShardGuard Testing framework is a simple script to feed a YAML file, run test-cases and capture relevant output.
+Mainly helps bulk-run ShardGuard with multiple prompts and capture metrics including time taken per-run, average run-time,
+success Rate, verbose errors and warnings. Can be easily extended to capture further required metrics.
+
 > **⚠️ Note**: This is a basic prototype of [a MCP security system](https://docs.google.com/document/d/1fB_DedbmW5E7MQSgXd98iNj9aQfXtajNKSEtAGUzLYI/edit?tab=t.0).
 > Don't use it for anything production. We're still testing things to see if this is a good approach!
 
@@ -70,6 +74,12 @@ practical yet effective path to safe LLM-driven automation.
    poetry run shardguard plan "Send an email to john@example.com about the meeting"
    ```
 
+4. **Run SGTest**:
+
+   ```bash
+   poetry run sgtest test_cases.yaml -v --output test_report.json
+   ```
+
 #### Using Google Gemini (Remote Models)
 
 1. **Get a Gemini API key**:

pyproject.toml

@@ -25,6 +25,7 @@ dependencies = [
 
 [project.scripts]
 shardguard = "shardguard.cli:app"
+sgtest = "shardguard.test_framework:main"
 
 [project.optional-dependencies]
 dev = [