Skip to content

[MOSH-2320]: Update API docs for worker number exposure#240

Open
jli-together wants to merge 1 commit intomainfrom
jli/eval-worker
Open

[MOSH-2320]: Update API docs for worker number exposure#240
jli-together wants to merge 1 commit intomainfrom
jli/eval-worker

Conversation

@jli-together
Copy link
Copy Markdown
Contributor

@jli-together jli-together commented Apr 9, 2026

@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 9, 2026

✱ Stainless preview builds

This PR will update the togetherai SDKs with the following commit messages.

go

feat(api): add num_workers parameter to eval evaluation parameters

openapi

feat(api): add num_workers field to evaluation models

python

feat(api): add num_workers parameter to eval create parameters

terraform

chore(internal): regenerate SDK with no functional changes

typescript

feat(api): add num_workers parameter to evals model/judge requests

Edit this comment to update them. They will appear in their respective SDK's changelogs.

togetherai-terraform studio · code · diff

Your SDK build had at least one "note" diagnostic, but this did not represent a regression.
generate ✅lint ✅test ✅

togetherai-openapi studio · code · diff

Your SDK build had at least one "note" diagnostic, but this did not represent a regression.
generate ✅

togetherai-typescript studio · code · diff

Your SDK build had at least one "warning" diagnostic, but this did not represent a regression.
generate ⚠️build ✅lint ✅test ✅

npm install https://pkg.stainless.com/s/togetherai-typescript/9a6b70cf8bd09808c88fdb22a9966b286f05b4cd/dist.tar.gz
togetherai-python studio · code · diff

Your SDK build had at least one "warning" diagnostic, but this did not represent a regression.
generate ⚠️build ✅lint ❗test ⏭️

pip install https://pkg.stainless.com/s/togetherai-python/6d254c7f4d81a0295ce47fed275f628a7f6045f6/together-2.7.0-py3-none-any.whl
togetherai-go studio · code · diff

Your SDK build had at least one "note" diagnostic, but this did not represent a regression.
generate ✅build ✅lint ✅test ✅

go get github.com/stainless-sdks/togetherai-go@df6f2dfbe7a3d485f46c7dcb7e0669983e431283

This comment is auto-generated by GitHub Actions and is automatically kept up to date as you push.
If you push custom code to the preview branch, re-run this workflow to update the comment.
Last updated: 2026-04-09 21:22:01 UTC

type: integer
minimum: 1
description: "Number of concurrent workers for inference requests. Overrides the default concurrency for this model. Useful for tuning throughput when using proxy endpoints (e.g. OpenRouter) or rate-limited external APIs."
example: 9
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the examples are a bit weird, maybe we can just say 5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants