Skip to content

[improvement](nereids) support extract from disjunction in join on condition - #38479

Merged
morrySnow merged 5 commits into
apache:masterfrom
feiniaofeiafei:extract_from_disjunction_in_join_on_condition
Aug 16, 2024
Merged

[improvement](nereids) support extract from disjunction in join on condition#38479
morrySnow merged 5 commits into
apache:masterfrom
feiniaofeiafei:extract_from_disjunction_in_join_on_condition

Conversation

@feiniaofeiafei

@feiniaofeiafei feiniaofeiafei commented Jul 29, 2024

Copy link
Copy Markdown
Collaborator 
select * from test_like1 t1 inner join test_like2 t2 on t1.a=t2.a and (t2.a=10 && t1.a=8 || t1.a=9);

support extract t1.a in (8,9) from t1.a=t2.a and (t2.a=10 && t1.a=8 || t1.a=9), and push to scan.

@doris-robot

doris-robot commented Jul 29, 2024

Copy link
Copy Markdown

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@feiniaofeiafei

feiniaofeiafei commented Jul 29, 2024

Copy link
Copy Markdown
Collaborator Author

run buildall

@doris-robot

doris-robot commented Jul 29, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 41589 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8df7bf78e34e7240689a9b89918ea96683b0977b, data reload: false

------ Round 1 ----------------------------------
q1	18412	4284	4132	4132
q2	2022	205	207	205
q3	10445	1325	1327	1325
q4	10168	858	908	858
q5	7593	2947	2956	2947
q6	216	136	137	136
q7	1034	611	605	605
q8	9451	1924	1943	1924
q9	8449	6583	6617	6583
q10	8713	3832	3870	3832
q11	423	252	256	252
q12	407	231	224	224
q13	17759	2952	2944	2944
q14	271	242	245	242
q15	528	477	484	477
q16	480	403	387	387
q17	966	878	852	852
q18	7994	7228	7258	7228
q19	1391	1215	1213	1213
q20	568	329	331	329
q21	5271	4666	4611	4611
q22	352	283	293	283
Total cold run time: 112913 ms
Total hot run time: 41589 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4100	4038	4027	4027
q2	339	237	222	222
q3	2973	2989	2990	2989
q4	1870	1848	1829	1829
q5	5250	5214	5207	5207
q6	216	133	131	131
q7	2071	1664	1708	1664
q8	3246	3317	3305	3305
q9	8323	8259	8246	8246
q10	3756	3804	3833	3804
q11	559	457	457	457
q12	722	610	533	533
q13	16767	2967	2964	2964
q14	283	258	259	258
q15	517	485	484	484
q16	431	396	405	396
q17	1719	1662	1670	1662
q18	7857	7264	7157	7157
q19	1675	1664	1674	1664
q20	1971	1777	1739	1739
q21	5483	5329	5273	5273
q22	538	471	492	471
Total cold run time: 70666 ms
Total hot run time: 54482 ms

@doris-robot

doris-robot commented Jul 29, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 169008 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8df7bf78e34e7240689a9b89918ea96683b0977b, data reload: false

query1	925	383	372	372
query2	6489	1738	1738	1738
query3	6656	212	230	212
query4	19921	17460	17380	17380
query5	4301	507	530	507
query6	281	174	163	163
query7	4605	302	296	296
query8	251	203	185	185
query9	8523	2391	2359	2359
query10	427	285	266	266
query11	10364	10002	9899	9899
query12	142	84	82	82
query13	1650	379	366	366
query14	9756	7034	8002	7034
query15	202	161	166	161
query16	7065	477	419	419
query17	960	575	558	558
query18	1906	281	280	280
query19	191	149	142	142
query20	90	84	87	84
query21	201	98	98	98
query22	4056	3970	3818	3818
query23	33608	32926	33222	32926
query24	10263	3036	3048	3036
query25	681	390	391	390
query26	1740	152	163	152
query27	2986	282	279	279
query28	6946	1974	1986	1974
query29	1235	418	424	418
query30	291	149	150	149
query31	922	743	748	743
query32	100	54	58	54
query33	718	324	317	317
query34	913	476	495	476
query35	857	724	721	721
query36	994	864	865	864
query37	169	80	81	80
query38	2858	2795	2794	2794
query39	862	808	814	808
query40	286	120	120	120
query41	49	47	48	47
query42	129	106	106	106
query43	466	451	447	447
query44	1200	729	735	729
query45	207	180	183	180
query46	1079	807	788	788
query47	1765	1674	1721	1674
query48	364	325	291	291
query49	1165	441	419	419
query50	916	437	444	437
query51	6794	6764	6615	6615
query52	102	86	89	86
query53	258	181	185	181
query54	674	462	455	455
query55	76	76	75	75
query56	285	274	271	271
query57	1163	1016	1014	1014
query58	272	278	286	278
query59	2594	2395	2410	2395
query60	293	274	283	274
query61	132	94	98	94
query62	906	662	663	662
query63	206	189	188	188
query64	5978	1925	1879	1879
query65	3192	3079	3076	3076
query66	1455	354	348	348
query67	15287	14765	14931	14765
query68	4429	592	594	592
query69	470	304	313	304
query70	1084	1093	1144	1093
query71	363	283	282	282
query72	7144	2698	2564	2564
query73	751	334	330	330
query74	5939	5653	5621	5621
query75	3381	2767	2765	2765
query76	2283	1329	1401	1329
query77	491	324	323	323
query78	9427	8924	8866	8866
query79	1937	554	539	539
query80	1140	526	518	518
query81	569	227	225	225
query82	1083	135	130	130
query83	248	176	166	166
query84	281	80	85	80
query85	1341	321	305	305
query86	528	326	296	296
query87	3312	3098	3120	3098
query88	3026	2496	2466	2466
query89	388	294	290	290
query90	1818	199	196	196
query91	133	104	104	104
query92	64	51	51	51
query93	1884	652	623	623
query94	922	297	290	290
query95	396	285	284	284
query96	606	286	284	284
query97	3252	3067	3042	3042
query98	218	200	192	192
query99	1645	1266	1291	1266
Total cold run time: 262951 ms
Total hot run time: 169008 ms

@doris-robot

doris-robot commented Jul 29, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.09 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8df7bf78e34e7240689a9b89918ea96683b0977b, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.06
query4	1.67	0.08	0.08
query5	0.50	0.47	0.49
query6	1.15	0.72	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.58	0.51	0.51
query10	0.57	0.56	0.56
query11	0.15	0.11	0.12
query12	0.15	0.13	0.12
query13	0.60	0.60	0.59
query14	0.78	0.79	0.84
query15	0.90	0.87	0.85
query16	0.35	0.35	0.35
query17	0.98	1.02	0.97
query18	0.23	0.21	0.22
query19	1.88	1.74	1.78
query20	0.01	0.02	0.01
query21	15.43	0.78	0.66
query22	4.00	7.83	1.22
query23	17.80	1.35	1.32
query24	2.25	0.23	0.22
query25	0.20	0.08	0.09
query26	0.31	0.22	0.22
query27	0.46	0.25	0.24
query28	13.18	1.01	0.99
query29	12.53	3.34	3.32
query30	0.25	0.06	0.05
query31	2.89	0.40	0.41
query32	3.22	0.50	0.48
query33	2.95	3.01	3.02
query34	15.42	4.26	4.26
query35	4.26	4.28	4.30
query36	0.68	0.47	0.48
query37	0.19	0.16	0.16
query38	0.17	0.16	0.15
query39	0.05	0.04	0.04
query40	0.16	0.14	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.05
Total cold run time: 107.52 s
Total hot run time: 30.09 s

@feiniaofeiafei
feiniaofeiafei force-pushed the extract_from_disjunction_in_join_on_condition branch 2 times, most recently from 5658a1f to eaa6cef Compare July 30, 2024 08:55
@feiniaofeiafei

feiniaofeiafei commented Jul 30, 2024

Copy link
Copy Markdown
Collaborator Author

run buildall

@doris-robot

doris-robot commented Jul 30, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 41772 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit eaa6cef33457cd7a5ac71b244bfbc4b30b336ce8, data reload: false

------ Round 1 ----------------------------------
q1	18175	4233	4203	4203
q2	2763	221	218	218
q3	11308	1291	1396	1291
q4	10663	828	929	828
q5	8371	3065	3026	3026
q6	230	140	137	137
q7	1040	618	623	618
q8	9431	1824	1949	1824
q9	8437	6596	6622	6596
q10	8696	3830	3830	3830
q11	445	259	253	253
q12	414	238	228	228
q13	17742	2933	2930	2930
q14	270	244	240	240
q15	522	481	506	481
q16	493	388	384	384
q17	954	899	902	899
q18	7967	7477	7311	7311
q19	1389	1220	1221	1220
q20	559	323	338	323
q21	5293	4659	4828	4659
q22	361	289	273	273
Total cold run time: 115523 ms
Total hot run time: 41772 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4048	4029	4009	4009
q2	331	227	223	223
q3	3007	3032	3013	3013
q4	1854	1850	1868	1850
q5	5219	5221	5241	5221
q6	218	130	131	130
q7	2047	1683	1703	1683
q8	3222	3278	3294	3278
q9	8257	8290	8279	8279
q10	3778	3854	3834	3834
q11	552	459	456	456
q12	744	543	538	538
q13	11903	2951	2957	2951
q14	284	259	254	254
q15	516	476	476	476
q16	451	400	399	399
q17	1725	1699	1688	1688
q18	7785	7345	7172	7172
q19	1665	1691	1678	1678
q20	1949	1755	1768	1755
q21	5430	5356	5174	5174
q22	526	449	451	449
Total cold run time: 65511 ms
Total hot run time: 54510 ms

@doris-robot

doris-robot commented Jul 30, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 169850 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit eaa6cef33457cd7a5ac71b244bfbc4b30b336ce8, data reload: false

query1	913	367	364	364
query2	6479	1781	1801	1781
query3	6662	222	224	222
query4	19552	17606	17472	17472
query5	4313	517	527	517
query6	287	173	170	170
query7	4604	307	297	297
query8	250	207	205	205
query9	8526	2381	2371	2371
query10	473	309	268	268
query11	10533	9951	10049	9951
query12	137	88	85	85
query13	1642	396	376	376
query14	8994	7089	8582	7089
query15	200	166	168	166
query16	7124	463	487	463
query17	958	561	564	561
query18	1916	295	299	295
query19	202	153	148	148
query20	95	93	93	93
query21	210	108	106	106
query22	4168	3979	4046	3979
query23	33698	33154	33149	33149
query24	10353	3107	3091	3091
query25	709	415	416	415
query26	1804	149	151	149
query27	3007	269	271	269
query28	7084	1972	1969	1969
query29	1389	442	433	433
query30	282	149	150	149
query31	928	736	752	736
query32	104	57	58	57
query33	728	322	324	322
query34	911	481	486	481
query35	849	723	730	723
query36	985	883	874	874
query37	304	78	81	78
query38	2881	2799	2788	2788
query39	854	808	797	797
query40	290	113	114	113
query41	51	49	49	49
query42	122	107	107	107
query43	501	436	440	436
query44	1215	729	728	728
query45	210	183	178	178
query46	1082	804	782	782
query47	1831	1726	1726	1726
query48	371	296	300	296
query49	1204	448	435	435
query50	892	430	439	430
query51	6771	6700	6716	6700
query52	109	91	94	91
query53	254	188	183	183
query54	683	458	468	458
query55	79	79	80	79
query56	297	277	366	277
query57	1146	1041	1063	1041
query58	264	286	273	273
query59	2827	2518	2552	2518
query60	304	280	274	274
query61	99	99	110	99
query62	933	667	661	661
query63	228	185	187	185
query64	5945	1944	1884	1884
query65	3150	3056	3097	3056
query66	1448	353	366	353
query67	15564	14754	14729	14729
query68	5540	561	555	555
query69	736	371	307	307
query70	1141	1108	1043	1043
query71	492	270	276	270
query72	8104	2693	2549	2549
query73	912	324	324	324
query74	6002	5642	5606	5606
query75	4106	2716	2745	2716
query76	3523	1396	1392	1392
query77	692	325	319	319
query78	9427	9026	8883	8883
query79	2966	517	523	517
query80	1395	508	501	501
query81	565	223	231	223
query82	1478	135	132	132
query83	307	184	179	179
query84	271	81	81	81
query85	1640	345	303	303
query86	500	305	292	292
query87	3297	3121	3113	3113
query88	3697	2389	2410	2389
query89	403	295	292	292
query90	1922	188	190	188
query91	134	102	106	102
query92	61	50	50	50
query93	3509	620	605	605
query94	947	287	260	260
query95	384	268	303	268
query96	614	281	279	279
query97	3208	3024	3048	3024
query98	215	201	190	190
query99	1593	1340	1298	1298
Total cold run time: 272759 ms
Total hot run time: 169850 ms

@doris-robot

doris-robot commented Jul 30, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 30.34 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit eaa6cef33457cd7a5ac71b244bfbc4b30b336ce8, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.07	0.07
query5	0.49	0.48	0.50
query6	1.14	0.71	0.71
query7	0.02	0.01	0.01
query8	0.05	0.05	0.04
query9	0.58	0.50	0.51
query10	0.57	0.57	0.56
query11	0.16	0.12	0.12
query12	0.16	0.13	0.13
query13	0.62	0.60	0.60
query14	0.78	0.80	0.79
query15	0.88	0.85	0.86
query16	0.35	0.36	0.35
query17	0.99	1.01	0.98
query18	0.22	0.21	0.21
query19	1.86	1.72	1.70
query20	0.01	0.00	0.01
query21	15.40	0.76	0.64
query22	3.92	7.71	1.75
query23	18.36	1.24	1.24
query24	2.26	0.23	0.21
query25	0.19	0.07	0.08
query26	0.32	0.22	0.21
query27	0.46	0.24	0.23
query28	13.16	1.00	0.97
query29	12.52	3.35	3.35
query30	0.25	0.06	0.05
query31	2.87	0.42	0.41
query32	3.24	0.49	0.49
query33	2.94	2.91	2.92
query34	15.43	4.26	4.25
query35	4.27	4.26	4.29
query36	0.69	0.48	0.47
query37	0.20	0.17	0.16
query38	0.16	0.16	0.15
query39	0.04	0.04	0.03
query40	0.17	0.12	0.14
query41	0.10	0.05	0.06
query42	0.06	0.05	0.06
query43	0.04	0.04	0.04
Total cold run time: 107.95 s
Total hot run time: 30.34 s

@feiniaofeiafei

feiniaofeiafei commented Jul 30, 2024

Copy link
Copy Markdown
Collaborator Author

run external

@feiniaofeiafei

feiniaofeiafei commented Jul 30, 2024

Copy link
Copy Markdown
Collaborator Author

run p1

@feiniaofeiafei

feiniaofeiafei commented Aug 2, 2024

Copy link
Copy Markdown
Collaborator Author

run p0

@feiniaofeiafei feiniaofeiafei changed the title [Feat](nereids) support extract from disjunction in join on condition [improvement](nereids) support extract from disjunction in join on condition Aug 2, 2024
924060929
924060929 previously approved these changes Aug 2, 2024
View reviewed changes
@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Aug 2, 2024
@github-actions

github-actions Bot commented Aug 2, 2024

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actions Bot commented Aug 2, 2024

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@feiniaofeiafei
feiniaofeiafei force-pushed the extract_from_disjunction_in_join_on_condition branch from 2f861fc to c78b599 Compare August 9, 2024 04:37
@feiniaofeiafei

feiniaofeiafei commented Aug 9, 2024

Copy link
Copy Markdown
Collaborator Author

run buildall

@github-actions

github-actions Bot commented Aug 9, 2024

Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@feiniaofeiafei
feiniaofeiafei force-pushed the extract_from_disjunction_in_join_on_condition branch from c78b599 to a788b54 Compare August 9, 2024 06:10
@github-actions github-actions Bot removed the approved Indicates a PR has been approved by one committer. label Aug 12, 2024
@feiniaofeiafei
feiniaofeiafei force-pushed the extract_from_disjunction_in_join_on_condition branch from a788b54 to 2d526bd Compare August 14, 2024 04:27
@feiniaofeiafei

feiniaofeiafei commented Aug 14, 2024

Copy link
Copy Markdown
Collaborator Author

run buildall

@doris-robot

doris-robot commented Aug 14, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 40157 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2d526bdaccc2f49e04c184c7ad7e1ed2c81ddbf2, data reload: false

------ Round 1 ----------------------------------
q1	17707	4473	4400	4400
q2	2672	182	185	182
q3	10731	1223	1090	1090
q4	10226	765	760	760
q5	8018	2860	2847	2847
q6	228	145	143	143
q7	975	606	614	606
q8	9584	2074	2056	2056
q9	9094	6518	6567	6518
q10	7062	2162	2232	2162
q11	454	251	258	251
q12	391	226	224	224
q13	18778	2978	2928	2928
q14	274	237	230	230
q15	526	483	485	483
q16	492	386	376	376
q17	974	669	687	669
q18	8023	7552	7448	7448
q19	1842	949	979	949
q20	693	333	326	326
q21	5268	4504	4623	4504
q22	1113	1043	1005	1005
Total cold run time: 115125 ms
Total hot run time: 40157 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4405	4282	4231	4231
q2	373	267	264	264
q3	2811	2600	2820	2600
q4	2059	1614	1675	1614
q5	5557	5662	5619	5619
q6	229	137	136	136
q7	2193	1720	1756	1720
q8	3231	3426	3370	3370
q9	8789	8740	8760	8740
q10	3527	3298	3291	3291
q11	617	514	495	495
q12	816	635	635	635
q13	16601	3154	3249	3154
q14	328	275	278	275
q15	521	497	476	476
q16	463	415	430	415
q17	1770	1493	1489	1489
q18	7919	7845	7698	7698
q19	4823	1488	1589	1488
q20	2224	1879	1884	1879
q21	5628	5321	5216	5216
q22	1145	1028	1086	1028
Total cold run time: 76029 ms
Total hot run time: 55833 ms

@feiniaofeiafei
feiniaofeiafei force-pushed the extract_from_disjunction_in_join_on_condition branch from 2d526bd to d4da9b8 Compare August 14, 2024 06:10
@feiniaofeiafei

feiniaofeiafei commented Aug 14, 2024

Copy link
Copy Markdown
Collaborator Author

run buildall

@doris-robot

doris-robot commented Aug 14, 2024

Copy link
Copy Markdown
TPC-H: Total hot run time: 37972 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d4da9b8744c048477395e396af2525d0189acd3c, data reload: false

------ Round 1 ----------------------------------
q1	17626	4427	4330	4330
q2	2018	180	185	180
q3	11591	1090	1141	1090
q4	10505	749	811	749
q5	7743	2835	2822	2822
q6	224	137	139	137
q7	960	586	595	586
q8	9539	2072	2098	2072
q9	8627	6560	6567	6560
q10	7029	2220	2193	2193
q11	471	244	245	244
q12	391	221	214	214
q13	17771	3018	3035	3018
q14	280	260	236	236
q15	520	492	490	490
q16	490	408	377	377
q17	985	718	776	718
q18	7509	6755	6852	6755
q19	5727	1102	969	969
q20	670	327	324	324
q21	3877	2976	2918	2918
q22	1098	990	1011	990
Total cold run time: 115651 ms
Total hot run time: 37972 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4449	4266	4229	4229
q2	373	272	270	270
q3	2872	2663	2666	2663
q4	1918	1669	1672	1669
q5	5702	5761	5644	5644
q6	230	140	134	134
q7	2136	1742	1713	1713
q8	3289	3499	3471	3471
q9	8831	8800	8791	8791
q10	3569	3279	3250	3250
q11	618	509	514	509
q12	869	621	587	587
q13	15753	3072	3131	3072
q14	313	298	290	290
q15	533	501	483	483
q16	486	438	451	438
q17	1847	1572	1555	1555
q18	8167	8017	7928	7928
q19	2191	1599	1584	1584
q20	2183	1904	1870	1870
q21	8399	5325	5342	5325
q22	1195	1046	1040	1040
Total cold run time: 75923 ms
Total hot run time: 56515 ms

@doris-robot

doris-robot commented Aug 14, 2024

Copy link
Copy Markdown
TPC-DS: Total hot run time: 189667 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d4da9b8744c048477395e396af2525d0189acd3c, data reload: false

query1	1267	887	848	848
query2	6474	1951	1898	1898
query3	10624	3779	3641	3641
query4	59378	24778	23248	23248
query5	5939	487	474	474
query6	498	158	167	158
query7	6522	292	294	292
query8	306	224	210	210
query9	9016	2454	2443	2443
query10	504	268	259	259
query11	18659	15035	15320	15035
query12	170	99	109	99
query13	1599	393	407	393
query14	12146	6621	6914	6621
query15	241	172	176	172
query16	7671	510	512	510
query17	1147	589	570	570
query18	1980	294	305	294
query19	287	159	157	157
query20	131	115	109	109
query21	220	108	113	108
query22	4608	4444	4274	4274
query23	34416	33360	33184	33184
query24	5593	2919	2884	2884
query25	552	401	409	401
query26	696	160	160	160
query27	1792	271	274	271
query28	3781	2048	2081	2048
query29	702	423	423	423
query30	242	155	148	148
query31	941	734	778	734
query32	97	54	55	54
query33	491	298	292	292
query34	859	467	469	467
query35	814	727	717	717
query36	1056	926	930	926
query37	131	89	81	81
query38	3930	3825	3859	3825
query39	1451	1391	1399	1391
query40	195	120	115	115
query41	47	43	42	42
query42	122	96	97	96
query43	500	469	478	469
query44	1081	742	761	742
query45	195	164	167	164
query46	1099	758	736	736
query47	1825	1780	1768	1768
query48	371	291	294	291
query49	763	425	435	425
query50	798	411	412	411
query51	6883	6752	6727	6727
query52	106	88	95	88
query53	259	189	185	185
query54	582	566	444	444
query55	75	74	76	74
query56	269	242	240	240
query57	1124	1093	1074	1074
query58	224	241	229	229
query59	2925	2791	2732	2732
query60	303	266	289	266
query61	97	98	96	96
query62	753	651	649	649
query63	206	187	185	185
query64	4403	2272	1769	1769
query65	3223	3173	3126	3126
query66	664	325	326	325
query67	15551	15054	14930	14930
query68	6871	547	544	544
query69	674	367	285	285
query70	1214	1120	1071	1071
query71	550	276	268	268
query72	7053	2289	2051	2051
query73	792	317	318	317
query74	9298	8792	8770	8770
query75	4353	2704	2765	2704
query76	4297	1033	1018	1018
query77	776	328	357	328
query78	9901	8967	8974	8967
query79	8425	535	530	530
query80	2238	489	495	489
query81	565	226	219	219
query82	1032	135	134	134
query83	302	148	143	143
query84	262	78	74	74
query85	1480	279	309	279
query86	375	296	293	293
query87	4417	4219	4264	4219
query88	5160	2306	2297	2297
query89	540	287	284	284
query90	1987	196	191	191
query91	124	96	95	95
query92	66	50	52	50
query93	6237	545	536	536
query94	716	287	293	287
query95	345	257	265	257
query96	622	266	265	265
query97	3231	3024	3047	3024
query98	223	207	203	203
query99	1518	1278	1258	1258
Total cold run time: 337218 ms
Total hot run time: 189667 ms

@doris-robot

doris-robot commented Aug 14, 2024

Copy link
Copy Markdown
ClickBench: Total hot run time: 31.09 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d4da9b8744c048477395e396af2525d0189acd3c, data reload: false

query1	0.04	0.04	0.04
query2	0.10	0.05	0.04
query3	0.22	0.05	0.06
query4	1.97	0.08	0.08
query5	0.51	0.50	0.49
query6	1.28	0.74	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.48	0.48
query10	0.54	0.54	0.54
query11	0.16	0.11	0.12
query12	0.15	0.13	0.12
query13	0.60	0.58	0.58
query14	0.77	0.77	0.78
query15	0.86	0.82	0.82
query16	0.37	0.37	0.37
query17	0.99	1.06	1.02
query18	0.23	0.21	0.22
query19	1.79	1.81	1.79
query20	0.01	0.01	0.01
query21	15.39	0.74	0.65
query22	3.72	7.73	2.01
query23	18.29	1.38	1.39
query24	2.07	0.22	0.23
query25	0.16	0.07	0.08
query26	0.30	0.20	0.21
query27	0.46	0.24	0.23
query28	13.23	1.02	1.00
query29	12.65	3.34	3.31
query30	0.24	0.05	0.04
query31	2.90	0.39	0.39
query32	3.26	0.49	0.48
query33	2.93	3.01	2.98
query34	16.93	4.35	4.33
query35	4.46	4.42	4.47
query36	0.65	0.50	0.48
query37	0.20	0.16	0.16
query38	0.16	0.15	0.15
query39	0.04	0.04	0.04
query40	0.15	0.12	0.13
query41	0.09	0.06	0.04
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.6 s
Total hot run time: 31.09 s

@feiniaofeiafei

feiniaofeiafei commented Aug 14, 2024

Copy link
Copy Markdown
Collaborator Author

run cloud_p0

@github-actions

github-actions Bot commented Aug 15, 2024

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Aug 15, 2024
@morrySnow
morrySnow merged commit 721f57b into apache:master Aug 16, 2024
dataroaring pushed a commit that referenced this pull request Aug 17, 2024
@feiniaofeiafei @dataroaring
[improvement](nereids) support extract from disjunction in join on co…
05a6b86 
…ndition (#38479)

select * from test_like1 t1 inner join test_like2 t2 on t1.a=t2.a and (t2.a=10 && t1.a=8 || t1.a=9);

support extract t1.a in (8,9) from t1.a=t2.a and (t2.a=10 && t1.a=8 || t1.a=9), and push to scan.
feiniaofeiafei added a commit to feiniaofeiafei/doris that referenced this pull request Nov 12, 2024
@feiniaofeiafei
[improvement](nereids) support extract from disjunction in join on co…
dae1aa5 
…ndition (apache#38479)

select * from test_like1 t1 inner join test_like2 t2 on t1.a=t2.a and (t2.a=10 && t1.a=8 || t1.a=9);

support extract t1.a in (8,9) from t1.a=t2.a and (t2.a=10 && t1.a=8 || t1.a=9), and push to scan.
@feiniaofeiafei feiniaofeiafei mentioned this pull request Nov 12, 2024
Merged
yiguolei pushed a commit that referenced this pull request Nov 16, 2024
@feiniaofeiafei
[improvement](nereids) support extract from disjunction in join on co…
8fcce4f 
…ndition (#38479) (#43670)

cherry-pick #38479 to branch-2.1
@yiguolei yiguolei mentioned this pull request Jan 19, 2025
Closed
GoGoWen pushed a commit to GoGoWen/incubator-doris that referenced this pull request Sep 26, 2025
caiconghui1
improvement(nereids): support extract from disjunction in join on con…
502f5bd 
…dition (apache#38479) (apache#43670)
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
@feiniaofeiafei @HappenLee
[improvement](nereids) support extract from disjunction in join on co…
561ce79 
…ndition (apache#38479)

select * from test_like1 t1 inner join test_like2 t2 on t1.a=t2.a and (t2.a=10 && t1.a=8 || t1.a=9);

support extract t1.a in (8,9) from t1.a=t2.a and (t2.a=10 && t1.a=8 || t1.a=9), and push to scan.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morrySnow morrySnow morrySnow approved these changes
@xzj7019 xzj7019 xzj7019 approved these changes
@CalvinKirs CalvinKirs Awaiting requested review from CalvinKirs
@morningman morningman Awaiting requested review from morningman
@dataroaring dataroaring Awaiting requested review from dataroaring
@924060929 924060929 Awaiting requested review from 924060929 924060929 is a code owner

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.8-merged dev/3.0.2-merged meta-change reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@feiniaofeiafei @doris-robot @924060929 @morrySnow @xzj7019 @yiguolei @dataroaring