Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[OpenXLA] Add openxla.md #5507

Merged
merged 10 commits into from
Aug 30, 2023
Merged

[OpenXLA] Add openxla.md #5507

Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
b8e0c1f
Create openxla.md
ManfeiBai Aug 26, 2023
faa392f
Update openxla.md
ManfeiBai Aug 28, 2023
df52fb4
Update openxla.md
ManfeiBai Aug 28, 2023
7188db1
Update openxla.md
ManfeiBai Aug 28, 2023
27bef8c
Update openxla.md
ManfeiBai Aug 28, 2023
abd32e0
Update openxla.md
ManfeiBai Aug 28, 2023
4ebc7a4
Update openxla.md
ManfeiBai Aug 28, 2023
f04aa81
Update openxla.md
ManfeiBai Aug 28, 2023
ab61ea2
Update openxla.md
ManfeiBai Aug 28, 2023
897d696
Update openxla.md
ManfeiBai Aug 28, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions docs/openxla.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# OpenXLA

As of June 28th, 2023, PyTorch/XLA now pulls XLA from OpenXLA.
OpenXLA is an [open source machine learning compiler XLA for GPUs, CPUs, and ML accelerators](https://github.com/openxla/xla).

Previous to OpenXLA, PyTorch/XLA pulled XLA directly from [TensorFlow](https://github.com/tensorflow/tensorflow/tree/master/tensorflow/compiler/xla). With our [XLA to OpenXLA migration](https://github.com/pytorch/xla/pull/5202), PyTorch/XLA now pulls XLA from [OpenXLA](https://github.com/openxla/xla).

# How to use OpenXLA

For [PJRT runtime](https://github.com/pytorch/xla/blob/master/docs/pjrt.md) users, there is no change with this migration. For XRT runtime users, there is a separate [XRT branch of PyTorch/XLA](https://github.com/pytorch/xla/tree/xrt) since OpenXLA doesn't support XRT.


# Performance
Below is a performance visual comparison of throughput for ResNet50 pre and post the migration on different TPU hardwares.

| | resnet50-pjrt-v2-8 | resnet50-pjrt-v4-8 | resnet50-pjrt-v4-32 |
| :------------ | :------------ | :------------ | :------------ |
| Pre Migration | 18.59 | 20.06 | 27.92 |
| Post Migration | 18.63 | 19.94 | 27.14 |