Skip to content

[WIP] Ray Data batch inference tutorial #3761

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
crypdick wants to merge 30 commits into from
Closed

[WIP] Ray Data batch inference tutorial #3761

Show file tree
Hide file tree
Changes from 19 commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
ed5bce6
initial draft
Feb 3, 2026
0990b56
2nd pass
Feb 4, 2026
0b60c82
add stats example
Feb 4, 2026
d95ffc9
increase bs, increase dset size, consolidate section
Feb 4, 2026
371e64d
lint
Feb 4, 2026
83e49af
lint
Feb 4, 2026
6c48115
another pass
Feb 4, 2026
2cd1d0e
checkpoint
Feb 5, 2026
467af14
edit pass
Feb 5, 2026
e144d79
Merge branch 'main' into ray-data-batch-embeddings
crypdick Feb 5, 2026
a4ca298
add tutorial to docs index; use GPU in CI; add ray data logo
Feb 5, 2026
2fe457b
add tiktoken to deps
Feb 10, 2026
dd116b9
rm 4xlarge machine requirement for batch inference tutorial
Feb 10, 2026
8cea2fe
add batch inference tutorial to ecosystem.rst
Feb 10, 2026
7146475
Reduce Ray Data verbosity
Feb 10, 2026
2866abe
minor edits; try to fix text codefence
Feb 10, 2026
5200079
test plt.imshow() for displaying imgs
Feb 11, 2026
a4a3664
test if log_to_driver=False fixes KeyboardInterrupt
Feb 11, 2026
4f9685b
Merge branch 'main' into ray-data-batch-embeddings
svekars Feb 12, 2026
b1523af
Merge branch 'main' into ray-data-batch-embeddings
sekyondaMeta Feb 17, 2026
09d7753
Merge branch 'main' into ray-data-batch-embeddings
sekyondaMeta Feb 17, 2026
5ab1e0d
Merge branch 'main' into ray-data-batch-embeddings
svekars Feb 17, 2026
c897218
revert tiktoken addition
Feb 23, 2026
5ff48b7
fix clobbered code fence
Feb 23, 2026
0f2ca72
fix plot display
Feb 23, 2026
d88889a
Merge branch 'main' into ray-data-batch-embeddings
svekars Feb 23, 2026
7df5b7d
Merge branch 'main' into ray-data-batch-embeddings
crypdick Feb 25, 2026
27a32dd
remove FIXMEs
Feb 25, 2026
c4ae111
Update beginner_source/batch_inference_tutorial.py
crypdick Feb 25, 2026
0fac6c4
Merge branch 'main' into ray-data-batch-embeddings
sekyondaMeta Mar 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .ci/docker/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ ray[tune]==2.52.1
tensorboard
jinja2==3.1.3
pytorch-lightning
tiktoken
torchx
torchrl==0.10.1
tensordict==0.10.0
Expand Down
1 change: 1 addition & 0 deletions .devcontainer/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ pandas
scikit-image
pillow==10.3.0
wget
tiktoken
Comment thread
crypdick marked this conversation as resolved.

# for codespaces env
pylint
Binary file added _static/img/ray-data.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading