You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Tensorize has been used in several places throughout the project but not very clearly documented, we will need one or a few tutorials in demonstrating what it is and how can be use it to run micro kernels etc.
I think it'd be a good idea to incorporate an ARM example with a bit-serial tensor kernel.
We can also use a VTA tensorization example, but the tutorial will be less straightforward. @cowanmeg - do you think we can put one together with your ARM bit-serial kernel, including the definition of the tensor intrinsic?
The only issue I see at the moment is that this tutorial will have to execute on ARM, so it's not quite straightforward to just deploy on any test setup.
I have some time this week too. My example is for adding an ARM microkernel, but it would be great if you have an x86 example so that people can run it.
Activity
tqchen commentedon Jul 4, 2018
cc @cowanmeg @merrymercy @tmoreau89
tmoreau89 commentedon Jul 4, 2018
I think it'd be a good idea to incorporate an ARM example with a bit-serial tensor kernel.
We can also use a VTA tensorization example, but the tutorial will be less straightforward. @cowanmeg - do you think we can put one together with your ARM bit-serial kernel, including the definition of the tensor intrinsic?
The only issue I see at the moment is that this tutorial will have to execute on ARM, so it's not quite straightforward to just deploy on any test setup.
yzhliu commentedon Jul 5, 2018
I feel tutorial on cpu is also good enough for demonstrating. I can help with that.
tmoreau89 commentedon Jul 13, 2018
Did we agree on who would get started on the CPU tensorization tutorial @yzhliu @cowanmeg ?
cowanmeg commentedon Jul 13, 2018
Yes, sounds good!
yzhliu commentedon Jul 17, 2018
@cowanmeg would you like to contribute the tutorial? or I can start to work on it from this weekend.
cowanmeg commentedon Jul 18, 2018
I have some time this week too. My example is for adding an ARM microkernel, but it would be great if you have an x86 example so that people can run it.
tqchen commentedon Aug 8, 2018
@cowanmeg @yzhliu any updates?
yzhliu commentedon Aug 8, 2018
not yet from my side ...
tqchen commentedon Sep 15, 2018
I would like to revive this thread @cowanmeg @yzhliu ,please follow up on this
yzhliu commentedon Sep 15, 2018
I'm writing and investigating the problem I mentioned in int8 PR #1680 - I feel it is a bug.
yzhliu commentedon Sep 26, 2018
PR: #1774
tqchen commentedon Oct 4, 2018
#1774 get merged