-
Notifications
You must be signed in to change notification settings - Fork 1.1k
src: cpu: aarch64: Enable matmul and convolution static quantisation through ACL. #2198
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
efad4f6 to
d728790
Compare
Radu2k
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
| } | ||
|
|
||
| status_t acl_lowp_matmul_sq_t::execute(const exec_ctx_t &ctx) const { | ||
| std::lock_guard<std::mutex> _lock {this->mtx}; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe add a comment on which part below is not thread safe. That would help remove the lock later in time.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For some reason, I do not see any new comments. Did you forget to push your changes?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I removed the code from src/common/convolution_pd.hpp as you requested. Now the bias is set to f32 from inside src/cpu/aarch64/acl_gemm_convolution.cpp, and consequently, the types match and so the #ifdef inside convolution_pd.hpp is not needed anymore. The change is there, but it is mostly about removing the previous one!
25271ff to
91524da
Compare
|
@mgouicem Can we please close this? |
|
@renato-arantes you have put in a merge commit. You need to squash and rebase. |
9c53fdc to
360a144
Compare
|
@mgouicem, I have addressed all the comments. |
|
@theComputeKid, @renato-arantes, Looks like this PR passed benchdnn Full log is here. |
|
As the result I had to disable all required checks for AArch64 to avoid blocking promotion of PRs for other platforms. |
|
Thought I was doing a good deed by expanding CI but alas no good deed goes unpunished. @Sqvid do you know why we didn't catch this internally? We need to fix this ASAP so we can get our public CI working again. |
Change-Id: Ifaecea0c53d270e7dd3e4c38b4261456e40c7418 Signed-off-by: Renato Arantes <[email protected]> Reviewed-on: https://eu-gerrit-1.euhpc.arm.com/c/oncpuml/oneDNN/+/706947 Tested-by: svc_mongoosetron <[email protected]> Reviewed-by: Radu Salavat <[email protected]> IP-Review: Hamza Butt <[email protected]>
Description
This is to enable
matmulandconvstatic quantization operations through ACL. Currently, the supported data type combinations ares8:s8:s8andu8:s8:u8.Checklist
General
make testandmake test_benchdnn_*) pass locally for each commit?