b-shi
|
15fbddaf9b
|
ASAN fixes for AVX512 GEMM/TRSM
|
2023-04-04 15:54:24 -07:00 |
|
Rasmus Munk Larsen
|
df1049ddf4
|
Small packet math cleanup.
|
2023-04-04 16:14:32 +00:00 |
|
Rasmus Munk Larsen
|
c730290fa0
|
Use the correct truncating intrinsic for double->int casting.
|
2023-04-03 13:56:41 -07:00 |
|
Rasmus Munk Larsen
|
1a5dfd7c0f
|
Fix incorrect casting in AVX512DQ path.
|
2023-03-27 09:28:06 -07:00 |
|
Rasmus Munk Larsen
|
b8b8a26145
|
Add more missing vectorized casts for int on x86, and remove redundant unit tests
|
2023-03-24 16:02:00 +00:00 |
|
Rasmus Munk Larsen
|
d57a79e512
|
Optimize float->bool cast for AVX2, based on Charles Schlosser's comments.
|
2023-03-21 20:59:25 -07:00 |
|
Rasmus Munk Larsen
|
a5ae832773
|
Fix reversal of arguments to _mm256_set_m128() in pcast<Packet4d, Packet8f>.
|
2023-03-22 03:21:44 +00:00 |
|
Rasmus Munk Larsen
|
09945f2cc1
|
Optimize casting for x86_64.
|
2023-03-21 18:24:16 +00:00 |
|
Antonio Sánchez
|
2c8011c2dd
|
Fix arm builds.
|
2023-03-20 16:59:38 +00:00 |
|
Rasmus Munk Larsen
|
0488b708b4
|
Vectorize tensor.isnan() by using typed predicates.
|
2023-03-16 04:04:22 +00:00 |
|
Chip Kerchner
|
d71ac6a755
|
Fix recent PowerPC warnings and clang warning
|
2023-03-15 16:50:46 +00:00 |
|
Chip Kerchner
|
23e1541863
|
Put deadcode checks back in from previous change.
|
2023-03-14 00:57:16 +00:00 |
|
Chip Kerchner
|
6c58f0fe1f
|
Revert changes that made BF16 GEMM to cause bad register spillage for LLVM (Power)
|
2023-03-13 23:36:06 +00:00 |
|
Chip Kerchner
|
9d72412385
|
Add MMA to BF16 GEMV - 5.0-6.3X faster (for Power)
|
2023-03-13 19:37:13 +00:00 |
|
Rasmus Munk Larsen
|
ee0ff0ab3a
|
Fix typo in MathFunctions.h
|
2023-03-13 15:50:40 +00:00 |
|
Rasmus Munk Larsen
|
21c49e8f8e
|
Delete mystery character from Eigen/src/Core/arch/NEON/MathFunctions.h
|
2023-03-10 23:27:24 +00:00 |
|
Antonio Sánchez
|
394aabb0a3
|
Fix failing MSVC tests due to compiler bugs.
|
2023-03-10 22:36:57 +00:00 |
|
Rasmus Munk Larsen
|
d6235d76db
|
Clean up generic packetmath specializations for various backends with the help of a macro.
|
2023-03-10 22:02:23 +00:00 |
|
Chip Kerchner
|
2b513ca2a0
|
Added partial linear access for LHS & Output - 30% faster for bfloat16 GEMM MMA (Power)
|
2023-03-02 19:22:43 +00:00 |
|
Antonio Sánchez
|
62d5cfe835
|
Fix ODR issues with Intel's AVX512 TRSM kernels.
|
2023-02-27 07:54:52 +00:00 |
|
Chip Kerchner
|
e4598fedbe
|
Fix compiler versions for certain instructions on Power.
|
2023-02-23 23:24:41 +00:00 |
|
Rasmus Munk Larsen
|
1c0a6cf228
|
Get rid of EIGEN_HAS_AVX512_MATH workaround.
|
2023-02-23 23:16:41 +00:00 |
|
Rasmus Munk Larsen
|
6bcd941ee3
|
Use pmsub in twoprod. This speeds up pow() on Skylake by ~1%.
|
2023-02-21 20:09:29 +00:00 |
|
Rasmus Munk Larsen
|
ce62177b5b
|
Vectorize atanh & add a missing definition and unit test for atan.
|
2023-02-21 03:14:05 +00:00 |
|
Charles Schlosser
|
049a144798
|
Add typed logicals
|
2023-02-18 01:23:47 +00:00 |
|
Chip Kerchner
|
e797974689
|
Add and enable Packet int divide for Power10.
|
2023-02-17 19:04:18 +00:00 |
|
Antonio Sánchez
|
a16fb889dd
|
Guard complex sqrt on old MSVC compilers.
|
2023-02-16 19:47:00 +00:00 |
|
Charles Schlosser
|
71a8e60a7a
|
Tweak pasin_float, fix psqrt_complex
|
2023-02-15 01:01:14 +00:00 |
|
Antonio Sánchez
|
384269937f
|
More NEON packetmath fixes.
|
2023-02-14 21:45:25 +00:00 |
|
Antonio Sánchez
|
2dfbf1b251
|
Fix NEON make_packet2f.
|
2023-02-14 16:52:07 +00:00 |
|
Chip Kerchner
|
4a03409569
|
Fix problem with array conversions BF16->F32 in Power.
|
2023-02-13 21:30:45 +00:00 |
|
Chip Kerchner
|
0ecae61568
|
Disable array BF16 to F32 conversions in Power
|
2023-02-10 20:06:58 +00:00 |
|
Chip Kerchner
|
fba12e02b3
|
Fold extra column calculations into an extra MMA accumulator and other bfloat16 MMA GEMM improvements
|
2023-02-10 17:32:06 +00:00 |
|
Chip Kerchner
|
79cfc74f4d
|
Revert ODR changes and make gemm_extra_cols and gemm_complex_extra_cols EIGEN_ALWAYS_INLINE to avoid external functions.
|
2023-02-10 17:05:07 +00:00 |
|
Alexander Grund
|
f9659d91f1
|
Fix ODR violation with gemm_extra_cols on PPC
|
2023-02-09 22:16:06 +00:00 |
|
Charles Schlosser
|
325e3063d9
|
Optimize psign
|
2023-02-09 22:15:26 +00:00 |
|
Antonio Sánchez
|
0a5392d606
|
Fix MSVC arm build.
|
2023-02-08 21:46:37 +00:00 |
|
Chip Kerchner
|
e71f88abce
|
Change in Power eigen_asserts to eigen_internal_asserts since it is putting unnecessary error checking and assertions without NDEBUG.
|
2023-02-08 00:57:30 +00:00 |
|
Antonio Sánchez
|
f6cc359e10
|
More EIGEN_DEVICE_FUNC fixes for CUDA 10/11/12.
|
2023-02-03 19:18:45 +00:00 |
|
Chip Kerchner
|
4a58f30aa0
|
Fix pre-POWER8_VECTOR bugs in pcmp_lt and pnegate and reactivate psqrt.
|
2023-01-31 19:40:24 +00:00 |
|
Rasmus Munk Larsen
|
12ad99ce60
|
Remove unused variables from GenericPacketMathFunctions.h
|
2023-01-29 18:10:28 +00:00 |
|
Charles Schlosser
|
0471e61b4c
|
Optimize various mathematical packet ops
|
2023-01-28 01:34:26 +00:00 |
|
Chip Kerchner
|
ab8725d947
|
Turn off vectorize version of rsqrt - doesn't match generic version
|
2023-01-27 18:28:54 +00:00 |
|
Chip Kerchner
|
6fc9de7d93
|
Fix slowdown in bfloat16 MMA when rows is not a multiple of 8 or columns is not a multiple of 4.
|
2023-01-25 18:22:20 +00:00 |
|
Sean McBride
|
d70b4864d9
|
issue #2581: review and cleanup of compiler version checks
|
2023-01-17 18:58:34 +00:00 |
|
Mehdi Goli
|
b523120687
|
[SYCL-2020 Support] Enabling Intel DPCPP Compiler support to Eigen
|
2023-01-16 07:04:08 +00:00 |
|
Sergey Fedorov
|
4d05765345
|
Altivec fixes for Darwin: do not use unsupported VSX insns
|
2023-01-12 16:33:33 +00:00 |
|
Martin Burchell
|
c54785b071
|
Fix error: unused parameter 'tmp' [-Werror,-Wunused-parameter] on clang/32-bit arm
|
2023-01-10 21:15:28 +00:00 |
|
Chip Kerchner
|
d20fe21ae4
|
Improve performance for Power10 MMA bfloat16 GEMM
|
2023-01-06 23:08:37 +00:00 |
|
Ryan Senanayake
|
fe7f527787
|
Fix guard macros for emulated FP16 operators on GPU
|
2023-01-06 22:02:51 +00:00 |
|