Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[original author: mrnikwaws] Neuron glu operator support #5466

Closed
wants to merge 11 commits into from

Conversation

aws-kingrj
Copy link
Collaborator

  • Adding glu operator support and cpp test
  • original author mrnikaws
  • tested internally with AWS Neuron


return xla::ShapeUtil::MakeShape(input_shape.element_type(), output_sizes);
}

xla::Shape GtScalarOutputShape(const torch::lazy::Value& self,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a cpp test similar to

TEST_F(AtenXlaTensorTest, TestGelu) {
?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There should be a cpp test already added or another one?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you should add another one similar to Gelu.

Copy link
Contributor

@mrnikwaws mrnikwaws Aug 18, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @JackCaoG can you help me understand what is missing?

The test in https://github.com/pytorch/xla/pull/5466/files#diff-0c11cc2fbeb0cfbc8fe223f9ac3df0904dcbb1277946a55a56cb102642f4faefR1322-R1342 was intended to be similar to the Gelu one, it tests a variety of input permutations across both input variables and uses the same checks.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can build it with BUILD_CPP_TESTS=1 and run CPP test with ./test/cpp/run_test.sh

@JackCaoG
Copy link
Collaborator

JackCaoG commented Aug 21, 2023

@aws-kingrj can you rebase this pr? I should have fixed the build timeout.

@aws-kingrj aws-kingrj closed this Aug 21, 2023
@aws-kingrj aws-kingrj deleted the neuron_operator_support branch August 21, 2023 17:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants