Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama

The author shares notes on the challenges they faced while migrating 35KB pre-prompts from Opus to a self-hosted Ollama, highlighting the need to handle large requests and complex prompt processing. They discuss the importance of chunking requests, handling errors, and implementing retry logic. The author also touches on the limitations of their current implementation and the need for further optimization.