v2.17.0

What's Changed

• Add system prompt and vary temp and new tokens by @bkb2135 in #545
• Peak at First Chunk before Streaming it Back by @bkb2135 in #544
• HOTFIX: Fixing non-streaming timeout by @Hollyqui in #548
• Update miner.py by @bkb2135 in #550
• Sn1 369 autoupdate scripts for validators by @richwardle in #538
• Refresh API Key Store on API Key Creation by @richwardle in #549
• Features/forward-responses-for-scoring by @bkb2135 in #547
• Set AWQ version to 2.7.3.post3 by @dbobrenko in #553
• Revert "Set AWQ version to 2.7.3.post3" by @bkb2135 in #555
• Add workers to API, set default to 4; add stress API test script by @dbobrenko in #552
• SN1-373: Test Time Inference Token Endpoint by @Hollyqui in #534
• SN1-386: Add miner availability for inference queries by @Hollyqui in #557
• Hotfix/restore awq version by @bkb2135 in #556
• Change Create Branch To Stash Changes by @richwardle in #561
• Defaulting verify=False by @Hollyqui in #562
• Hackathon/add time penalty by @richwardle in #554
• Hackathon/improve web retrieval by @bkb2135 in #551
• Bump Version Number by @bkb2135 in #564
• v2.17.0 by @Hollyqui in #563

Full Changelog: v2.16.2...v2.17.0