diff options
author | Jakub Jelinek <jakub@redhat.com> | 2019-06-17 23:20:00 +0200 |
---|---|---|
committer | Jakub Jelinek <jakub@gcc.gnu.org> | 2019-06-17 23:20:00 +0200 |
commit | 0356aab806921fe5d766d3fc74cf49dffc271d18 (patch) | |
tree | 4dbb450a132e4d4c5cadbc107b5997460457aecc /gcc/tree-vect-loop.c | |
parent | a064fd4c7385442dd4f9f3a1b538aef2fdac5209 (diff) | |
download | gcc-0356aab806921fe5d766d3fc74cf49dffc271d18.zip gcc-0356aab806921fe5d766d3fc74cf49dffc271d18.tar.gz gcc-0356aab806921fe5d766d3fc74cf49dffc271d18.tar.bz2 |
omp-low.c (struct omp_context): Add scan_inclusive field.
* omp-low.c (struct omp_context): Add scan_inclusive field.
(scan_omp_1_stmt) <case GIMPLE_OMP_SCAN>: Set ctx->scan_inclusive
if inclusive scan.
(struct omplow_simd_context): Add lastlane member.
(lower_rec_simd_input_clauses): Add rvar argument, handle inscan
reductions. Build 2 or 3 argument .GOMP_SIMD_LANE calls rather than
1 or 2 argument.
(lower_rec_input_clauses): Handle inscan reductions in simd contexts.
(lower_lastprivate_clauses): Set TREE_THIS_NOTRAP on the ARRAY_REF.
(lower_omp_scan): New function.
(lower_omp_1) <case GIMPLE_OMP_SCAN>: Use lower_omp_scan.
* tree-ssa-dce.c (eliminate_unnecessary_stmts): For IFN_GOMP_SIMD_LANE
check 3rd argument if present rather than 2nd.
* tree-vectorizer.h (struct _loop_vec_info): Add scan_map member.
(struct _stmt_vec_info): Change simd_lane_access_p from bool into
2-bit bitfield.
* tree-vect-loop.c (_loop_vec_info::_loop_vec_info): Initialize
scan_map. For IFN_GOMP_SIMD_LANE check 3rd argument if present rather
than 2nd.
(_loop_vec_info::~_loop_vec_info): Delete scan_map.
* tree-vect-data-refs.c (vect_analyze_data_ref_accesses): Allow two
different STMT_VINFO_SIMD_LANE_ACCESS_P refs if they have the same
init.
(vect_find_stmt_data_reference): Encode in ->aux the 2nd
IFN_GOMP_SIMD_LANE argument.
(vect_analyze_data_refs): Set STMT_VINFO_SIMD_LANE_ACCESS_P from the
encoded ->aux value.
* tree-vect-stmts.c: Include attribs.h.
(vectorizable_call): Adjust comment about IFN_GOMP_SIMD_LANE.
(scan_operand_equal_p, check_scan_store, vectorizable_scan_store): New
functions.
(vectorizable_load): For STMT_VINFO_SIMD_LANE_ACCESS_P tests use != 0.
(vectorizable_store): Handle STMT_VINFO_SIMD_LANE_ACCESS_P > 1.
cp/
* semantics.c (finish_omp_clauses): For OMP_CLAUSE_REDUCTION_INSCAN
set need_copy_assignment.
testsuite/
* gcc.dg/vect/vect-simd-8.c: New test.
* gcc.dg/vect/vect-simd-9.c: New test.
* g++.dg/vect/simd-2.cc: New test.
* g++.dg/gomp/scan-1.C: New test.
From-SVN: r272399
Diffstat (limited to 'gcc/tree-vect-loop.c')
-rw-r--r-- | gcc/tree-vect-loop.c | 10 |
1 files changed, 6 insertions, 4 deletions
diff --git a/gcc/tree-vect-loop.c b/gcc/tree-vect-loop.c index 671ef2f..92a7c29 100644 --- a/gcc/tree-vect-loop.c +++ b/gcc/tree-vect-loop.c @@ -824,6 +824,7 @@ _loop_vec_info::_loop_vec_info (struct loop *loop_in, vec_info_shared *shared) peeling_for_alignment (0), ptr_mask (0), ivexpr_map (NULL), + scan_map (NULL), slp_unrolling_factor (1), single_scalar_iteration_cost (0), vectorizable (false), @@ -863,8 +864,8 @@ _loop_vec_info::_loop_vec_info (struct loop *loop_in, vec_info_shared *shared) gimple *stmt = gsi_stmt (si); gimple_set_uid (stmt, 0); add_stmt (stmt); - /* If .GOMP_SIMD_LANE call for the current loop has 2 arguments, the - second argument is the #pragma omp simd if (x) condition, when 0, + /* If .GOMP_SIMD_LANE call for the current loop has 3 arguments, the + third argument is the #pragma omp simd if (x) condition, when 0, loop shouldn't be vectorized, when non-zero constant, it should be vectorized normally, otherwise versioned with vectorized loop done if the condition is non-zero at runtime. */ @@ -872,12 +873,12 @@ _loop_vec_info::_loop_vec_info (struct loop *loop_in, vec_info_shared *shared) && is_gimple_call (stmt) && gimple_call_internal_p (stmt) && gimple_call_internal_fn (stmt) == IFN_GOMP_SIMD_LANE - && gimple_call_num_args (stmt) >= 2 + && gimple_call_num_args (stmt) >= 3 && TREE_CODE (gimple_call_arg (stmt, 0)) == SSA_NAME && (loop_in->simduid == SSA_NAME_VAR (gimple_call_arg (stmt, 0)))) { - tree arg = gimple_call_arg (stmt, 1); + tree arg = gimple_call_arg (stmt, 2); if (integer_zerop (arg) || TREE_CODE (arg) == SSA_NAME) simd_if_cond = arg; else @@ -959,6 +960,7 @@ _loop_vec_info::~_loop_vec_info () release_vec_loop_masks (&masks); delete ivexpr_map; + delete scan_map; loop->aux = NULL; } |