Commit graph

8 commits

Author SHA1 Message Date
teknium
6eb76c7c1a Enhance batch processing and image generation tools
- Updated batch processing to include robust resume functionality by scanning completed prompts based on content rather than indices, improving recovery from failures.
- Implemented retry logic for image downloads with exponential backoff to handle transient failures effectively.
- Refined image generation tool to utilize the FLUX 2 Pro model, updating descriptions and parameters for clarity and consistency.
- Added new configuration scripts for GLM 4.7 and Imagen tasks, enhancing usability and logging capabilities.
- Removed outdated scripts and test files to streamline the codebase.
2026-01-18 10:11:59 +00:00
teknium
0e2e69a71d Add batch processing capabilities with checkpointing and statistics tracking, along with toolset distribution management. Update README and add test scripts for validation. 2025-10-06 03:17:58 +00:00
teknium
c42d9055ed Move test run back to repo root. weirdness occurred 2025-10-02 20:05:09 +00:00
teknium
a7ff4d49e9 A bit of restructuring for simplicity and organization 2025-10-01 23:29:25 +00:00
Teknium
17608c1142 Update to use toolsets and make them easy to create and configure 2025-09-10 00:43:55 -07:00
Teknium
c7fa4447b8 cleanup 2025-09-06 22:07:38 -07:00
Teknium
cde7e64418 add vision model tool, cli updates for exclusive and inclusive toolsets 2025-08-04 00:14:16 -07:00
Teknium
bf4223f381 implement first pass of scrape/crawl content compression 2025-07-31 10:11:27 -07:00