您的位置:首页 > 其它

(3)聚簇因子(CLUSTERING_FACTOR )——上

2013-02-04 17:41 399 查看
大家知道数据表中的数据都是无序的存在库中,当我们在对数据进行检索的时候,查找起来很是耗费资源,于是我们就需要为表创建索引,索引的作用就是把表中的数据按照一定的顺序排列保存起来,于是就出现了一个问题,有的表中的数据和索引想要排列的顺序很是相近,而另一些表中的数据和索引想要排列的顺序相距甚远,聚簇因子的作用就是用来标示这个的,聚簇因子越小,相似度越高,聚簇因子越大,相似度越低。

1、列顺序

当计算有效索引选择率时,在基于区间的谓词之后的所有基于列的谓词都将被忽略——但是计算有效表选择率的时候还会使用他们——这样就导致oracle计算得出该索引的成本高得离谱。这就建议我们重新调整某些索引的结构,将对应于区间谓词的列调整到索引定义的末尾。这种调整可能会改变clustering_factor的值。

SQL> create table t1
2  pctfree 90
3  pctused 10
4  as
5  select
6    trunc((rownum-1)/ 100)  clustered,
7    mod(rownum - 1, 100)  scattered,
8    lpad(rownum,10)    small_vc
9  from
10    all_objects
11  where
12    rownum <= 10000
13  ;

表已创建。

SQL> create index t1_i1_good on t1(clustered, scattered);

索引已创建。

SQL> create index t1_i2_bad  on t1(scattered, clustered);

索引已创建。

SQL> begin
2    dbms_stats.gather_table_stats(
3      user,
4      't1',
5      cascade => true,
6      estimate_percent => null,
7      method_opt => 'for all columns size 1'
8    );
9  end;
10  /

PL/SQL 过程已成功完成。

SQL> select i.index_name,i.blevel,i.leaf_blocks,i.clustering_factor from user_indexes i;

INDEX_NAME                         BLEVEL LEAF_BLOCKS CLUSTERING_FACTOR
------------------------------ ---------- ----------- -----------------
T1_I1_GOOD                              1          24               278
T1_I2_BAD                               1          24             10000

SQL> set autotrace trace exp;
SQL> select count(small_vc)
2    from t1
3   where scattered = 50
4     and clustered between 1 and 5;

执行计划
----------------------------------------------------------
Plan hash value: 2833503776

-------------------------------------------------------------------------------------------
| Id  | Operation                    | Name       | Rows  | Bytes | Cost (%CPU)| Time     |
-------------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT             |            |     1 |    17 |     4   (0)| 00:00:01 |
|   1 |  SORT AGGREGATE              |            |     1 |    17 |            |          |
|   2 |   TABLE ACCESS BY INDEX ROWID| T1         |     6 |   102 |     4   (0)| 00:00:01 |
|*  3 |    INDEX RANGE SCAN          | T1_I1_GOOD |     6 |       |     3   (0)| 00:00:01 |
-------------------------------------------------------------------------------------------

Predicate Information (identified by operation id):
---------------------------------------------------

3 - access("CLUSTERED">=1 AND "SCATTERED"=50 AND "CLUSTERED"<=5)
filter("SCATTERED"=50)

SQL> select
2  /*+ index(t1 t1_i2_bad) */
3   count(small_vc)
4    from t1
5   where scattered = 50
6     and clustered between 1 and 5;

执行计划
----------------------------------------------------------
Plan hash value: 2223336776

------------------------------------------------------------------------------------------
| Id  | Operation                    | Name      | Rows  | Bytes | Cost (%CPU)| Time     |
------------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT             |           |     1 |    17 |     9   (0)| 00:00:01 |
|   1 |  SORT AGGREGATE              |           |     1 |    17 |            |          |
|   2 |   TABLE ACCESS BY INDEX ROWID| T1        |     6 |   102 |     9   (0)| 00:00:01 |
|*  3 |    INDEX RANGE SCAN          | T1_I2_BAD |     6 |       |     2   (0)| 00:00:01 |
------------------------------------------------------------------------------------------

Predicate Information (identified by operation id):
---------------------------------------------------

3 - access("SCATTERED"=50 AND "CLUSTERED">=1 AND "CLUSTERED"<=5)

在第一个执行计划中,尽管存在一个索引(T1_I2_BAD)能很好的满足以上查询的要求,其第一列是scattered(使用相等谓词),第二列是clustered(使用基于区间的谓词),优化器还是选择了t1_i1_good索引。

在第二个执行计划中,添加了一个提示来强制oracle使用我们认为更能满足查询要求的那个索引(t1_i2_bad),但是由此带来的成本将是优化器的默认选择的成本的两倍还要多(由4变为9)。

这就突出了优化器利用clustering_factor来计算索引访问路劲成本的缺陷。不管这个示例中用的是哪一个索引,访问表的数目是完全相同的——但是访问顺序会存在差异,这也足以导致优化器成本的计算结果产生巨大的差异。

SQL> select s.table_name,
2         s.column_name,
3         s.num_distinct,
4         s.density,
5         s.num_nulls,
6         s.avg_col_len
7    from user_tab_col_statistics s
8   where table_name = 'T1';

TABLE_NAME                     COLUMN_NAME                    NUM_DISTINCT    DENSITY  NUM_NULLS AVG_COL_LEN
------------------------------ ------------------------------ ------------ ---------- ---------- -----------
T1                             CLUSTERED                               100        .01          0           3
T1                             SCATTERED                               100        .01          0           3
T1                             SMALL_VC                              10000      .0001          0          11

scattered = 50 的选择率: 1/100

clustered between 1 and 5 的选择率:(5-1)/(99-0)+2/100

联合选择率:1/100 * (5-1)/(99-0)+2/100

SQL> --cost(t1_il_good)
SQL> select
2         1 +
3         ceil(24 * ((5-1)/(99-0)+2/100)) +
4         ceil(278 * (1/100 * ((5-1)/(99-0)+2/100)))
5  from dual;

1+CEIL(24*((5-1)/(99-0)+2/100))+CEIL(278*(1/100*((5-1)/(99-0)+2/100)))
-----------------------------------------------------------------------
4

SQL> --cost(t1_il_bad)
SQL> select
2         1 +
3         ceil(24 * (1/100 * ((5-1)/(99-0)+2/100))) +
4         ceil(10000 * (1/100 * ((5-1)/(99-0)+2/100)))
5  from dual;

1+CEIL(24*(1/100*((5-1)/(99-0)+2/100)))+CEIL(10000*(1/100*((5-1)/(99-0)+2/100)))
---------------------------------------------------------------------------------
9


2、额外的列

为索引添加一个或者两个列。也会导致clustering_factor出现剧烈的变化。

SQL> create table t1
2  as
3  select
4  sysdate + trunc((rownum-1) / 500)movement_date,
5  trunc(dbms_random.value(1,60.999))product_id,
6  trunc(dbms_random.value(1,10.000))qty,
7  lpad(rownum,10)small_vc,
8  rpad('x',100)padding
9  from
10  all_objects
11  where
12  rownum <= 10000
13  ;

表已创建。

SQL> create index t1_i1 on t1(movement_date);
begin
dbms_stats.gather_table_stats(
user,
't1',
cascade => true,
estimate_percent => null,

索引已创建。

method_opt => 'for all columns size 1'
8    );
9  end;
10  /

PL/SQL 过程已成功完成。

SQL> create index t1_i2 on t1(movement_date, product_id);
begin
dbms_stats.gather_table_stats(
user,
't1',
cascade => true,

索引已创建。

SQL>   2    3    4    5    6  estimate_percent => null,
7  method_opt => 'for all columns size 1'
8  );
9  end;
10  /

PL/SQL 过程已成功完成。

SQL> select i.index_name,i.blevel,i.leaf_blocks,i.clustering_factor from user_indexes i;

INDEX_NAME                         BLEVEL LEAF_BLOCKS CLUSTERING_FACTOR
------------------------------ ---------- ----------- -----------------
T1_I1                                   1          27               184
T1_I2                                   1          31              6664

虽然索引的大小只有一点点增加(这也可以通过叶块的数目提现出来),但是,clustering_factor的值再次出现了严重的变化。

SQL> select /*+ index(t1 t1_i1) */
2   sum(qty)
3    from t1
4   where movement_date = trunc(sysdate) + 7
5     and product_id = 44;

执行计划
----------------------------------------------------------
Plan hash value: 269862921

--------------------------------------------------------------------------------------
| Id  | Operation                    | Name  | Rows  | Bytes | Cost (%CPU)| Time     |
--------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT             |       |     1 |    14 |    12   (0)| 00:00:01 |
|   1 |  SORT AGGREGATE              |       |     1 |    14 |            |          |
|*  2 |   TABLE ACCESS BY INDEX ROWID| T1    |     8 |   112 |    12   (0)| 00:00:01 |
|*  3 |    INDEX RANGE SCAN          | T1_I1 |   500 |       |     2   (0)| 00:00:01 |
--------------------------------------------------------------------------------------

Predicate Information (identified by operation id):
---------------------------------------------------

2 - filter("PRODUCT_ID"=44)
3 - access("MOVEMENT_DATE"=TRUNC(SYSDATE@!)+7)

SQL> select /*+ index(t1 t1_i2) */
2   sum(qty)
3    from t1
4   where movement_date = trunc(sysdate) + 7
5     and product_id = 44;

执行计划
----------------------------------------------------------
Plan hash value: 2003103559

--------------------------------------------------------------------------------------
| Id  | Operation                    | Name  | Rows  | Bytes | Cost (%CPU)| Time     |
--------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT             |       |     1 |    14 |     7   (0)| 00:00:01 |
|   1 |  SORT AGGREGATE              |       |     1 |    14 |            |          |
|   2 |   TABLE ACCESS BY INDEX ROWID| T1    |     8 |   112 |     7   (0)| 00:00:01 |
|*  3 |    INDEX RANGE SCAN          | T1_I2 |     8 |       |     1   (0)| 00:00:01 |
--------------------------------------------------------------------------------------

Predicate Information (identified by operation id):
---------------------------------------------------

3 - access("MOVEMENT_DATE"=TRUNC(SYSDATE@!)+7 AND "PRODUCT_ID"=44)

这个查询就是那种鼓励我们为索引添加额外列的查询类型。可以看见使用复合索引查询成本确实降低了。

SQL> select /*+ index(t1 t1_i1) */
2   product_id, max(small_vc)
3    from t1
4   where movement_date = trunc(sysdate) + 7
5   group by product_id;

执行计划
----------------------------------------------------------
Plan hash value: 2629508439

--------------------------------------------------------------------------------------
| Id  | Operation                    | Name  | Rows  | Bytes | Cost (%CPU)| Time     |
--------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT             |       |    60 |  1320 |    13   (8)| 00:00:01 |
|   1 |  HASH GROUP BY               |       |    60 |  1320 |    13   (8)| 00:00:01 |
|   2 |   TABLE ACCESS BY INDEX ROWID| T1    |   500 | 11000 |    12   (0)| 00:00:01 |
|*  3 |    INDEX RANGE SCAN          | T1_I1 |   500 |       |     2   (0)| 00:00:01 |
--------------------------------------------------------------------------------------

Predicate Information (identified by operation id):
---------------------------------------------------

3 - access("MOVEMENT_DATE"=TRUNC(SYSDATE@!)+7)

SQL> select /*+ index(t1 t1_i2) */
2   product_id, max(small_vc)
3    from t1
4   where movement_date = trunc(sysdate) + 7
5   group by product_id;

执行计划
----------------------------------------------------------
Plan hash value: 878233575

--------------------------------------------------------------------------------------
| Id  | Operation                    | Name  | Rows  | Bytes | Cost (%CPU)| Time     |
--------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT             |       |    60 |  1320 |   337   (0)| 00:00:05 |
|   1 |  SORT GROUP BY NOSORT        |       |    60 |  1320 |   337   (0)| 00:00:05 |
|   2 |   TABLE ACCESS BY INDEX ROWID| T1    |   500 | 11000 |   337   (0)| 00:00:05 |
|*  3 |    INDEX RANGE SCAN          | T1_I2 |   500 |       |     3   (0)| 00:00:01 |
--------------------------------------------------------------------------------------

Predicate Information (identified by operation id):
---------------------------------------------------

3 - access("MOVEMENT_DATE"=TRUNC(SYSDATE@!)+7)

这个查询额外列的存在改变了行访问的顺序(即clustering_factor的值所描述的内容),因此成本也发生了变化。
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: