57 lines
No EOL
2.3 KiB
Text
57 lines
No EOL
2.3 KiB
Text
TASK VALIDATION
|
|
|
|
TASK OBJECTIVE: 'Complete the user's main business objective as specified in their request.'
|
|
EXPECTED DATA TYPE: unknown
|
|
EXPECTED FORMATS: ['pdf', 'docx', 'xlsx', 'txt', 'json', 'csv', 'html', 'md']
|
|
SUCCESS CRITERIA (2 items): ["The task fully addresses the user's main objective", "The deliverable meets the user's expectations and requirements"]
|
|
ACTION THAT CREATED DOCUMENTS: ai.generateDocument
|
|
|
|
VALIDATION RULES:
|
|
IMPORTANT: You only have document METADATA (filename, format, size, mimeType) - NOT document content.
|
|
Validate based on metadata only:
|
|
1. Check if filenames are APPROXIMATELY meaningful (generic names like "generated.docx" are acceptable if format matches)
|
|
2. Check if delivered formats are compatible with expected format
|
|
3. Check if document sizes are reasonable for the task objective
|
|
4. Assess if filename and size combination suggests correct data type
|
|
5. Rate overall quality (0.0-1.0) based on metadata indicators, with format matching being the most important
|
|
6. Identify specific gaps based on what the user requested (infer from filename, size, format - NOT content)
|
|
|
|
OUTPUT FORMAT - JSON ONLY (no prose):
|
|
{
|
|
"overallSuccess": false,
|
|
"qualityScore": 0.0,
|
|
"dataTypeMatch": false,
|
|
"formatMatch": false,
|
|
"documentCount": 2,
|
|
"successCriteriaMet": [false][false],
|
|
"gapAnalysis": "Describe what is missing or incorrect based on filename, size, format metadata",
|
|
"improvementSuggestions": ["General action to improve overall result"],
|
|
"validationDetails": [
|
|
{
|
|
"documentName": "document.ext",
|
|
"issues": ["Issue inferred from metadata (e.g., filename doesn't match task, size too small for objective)"],
|
|
"suggestions": ["Specific fix based on metadata analysis"]
|
|
}
|
|
]
|
|
}
|
|
|
|
Field explanations:
|
|
- "improvementSuggestions": Overall actions to improve the entire result (general, high-level)
|
|
- "validationDetails[].suggestions": Specific fixes for each document's individual issues (document-specific, detailed)
|
|
- Do NOT use prefixes like "NEXT STEP:" - describe actions directly
|
|
|
|
DELIVERED DOCUMENTS (2 items):
|
|
[
|
|
{
|
|
"name": "test_document_memo.docx",
|
|
"mimeType": "application/vnd.openxmlformats-officedocument.wordprocessingml.document",
|
|
"format": "docx",
|
|
"size": "48.1 KB"
|
|
},
|
|
{
|
|
"name": "structured_content.json",
|
|
"mimeType": "application/json",
|
|
"format": "json",
|
|
"size": "1.5 KB"
|
|
}
|
|
] |