LogMiner的使用

前端之家收集整理的这篇文章主要介绍了LogMiner的使用前端之家小编觉得挺不错的,现在分享给大家,也给大家做个参考。

http://www.cnblogs.com/jyzhao/p/7087877.html

LogMiner是用于Oracle日志挖掘的利器。
百科解释:

LogMiner 是Oracle公司从产品8i以后提供的一个实际非常有用的分析工具,使用该工具可以轻松获得Oracle 重做日志文件(归档日志文件)中的具体内容,LogMiner分析工具实际上是由一组PL/sql包和一些动态视图组成,它作为Oracle数据库的一部分来发布,是oracle公司提供的一个完全免费的工具。

本文主要演示LogMiner的使用,直观展示LogMiner的作用。

环境:Oracle 11.2.0.4 RAC

1.查询当前日志组

使用sys用户查询Oracle数据库的当前日志组:

  1. --1.current log
  2. sql> select * from v$log;
  3.  
  4. GROUP# THREAD# SEQUENCE# BYTES BLOCKSIZE MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIME NEXT_CHANGE# NEXT_TIME
  5. ---------- ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ------------ ------------ ------------
  6. 1 1 29 52428800 512 2 YES INACTIVE 1547838 25-JUN-17 1547840 25-JUN-17
  7. 2 1 30 52428800 512 2 NO CURRENT 1567897 27-JUN-17 2.8147E+14 27-JUN-17
  8. 3 2 25 52428800 512 2 NO CURRENT 1567902 27-JUN-17 2.8147E+14
  9. 4 2 24 52428800 512 2 YES INACTIVE 1567900 27-JUN-17 1567902 27-JUN-17

这里当前日志(current)是:
thread 1 sequence 30
thread 2 sequence 25

2.业务用户插入操作

模拟业务用户jingyu插入T2表数据:

  1. --2.业务用户插入操作
  2. sqlplus jingyu/jingyu@jyzhao
  3. sql> select count(1) from t2;
  4.  
  5. COUNT(1)
  6. ----------
  7. 0
  8.  
  9. sql> insert into t2 select rownum,rownum,dbms_random.string('b',50) from dual connect by level <= 100000 order by dbms_random.random;
  10. commit;
  11.  
  12. 100000 rows created.
  13.  
  14. sql>
  15. Commit complete.
  16. sql> from t2;
  17.  
  18. COUNT(1)
  19. ----------
  20. 100000

3.归档日志切换

为了区分每个日志的不同操作,这里对数据库进行手工归档切换,模拟现实中实际的归档切换。

  1. --3.模拟归档日志切换
  2. sql> alter system archive log current;
  3.  
  4. System altered.
  5.  
  6. sql> STATUS FIRST_CHANGE# FIRST_TIME NEXT_CHANGE# NEXT_TIME
  7. ---------- ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ------------ ------------ ------------
  8. 1 1 31 52428800 512 2 NO CURRENT 1572517 27-JUN-17 2.8147E+14
  9. 2 1 30 52428800 512 2 YES ACTIVE 1567897 27-JUN-17 1572517 27-JUN-17
  10. 3 2 25 52428800 512 2 YES ACTIVE 1567902 27-JUN-17 1572521 27-JUN-17
  11. 4 2 26 52428800 512 2 NO CURRENT 1572521 27-JUN-17 2.8147E+14

4.业务用户插入操作

模拟业务用户jingyu删除T2表部分数据:

  1. --4.业务用户删除操作
  2.  
  3. sql> delete from t2 where id < 10000;
  4.  
  5. 9999 rows deleted.
  6.  
  7. sql> commit;
  8.  
  9. Commit complete.
  10.  
  11. sql> from t2;
  12.  
  13. COUNT(1)
  14. ----------
  15. 90001

5.归档日志切换

为了区分每个日志的不同操作,这里对数据库进行手工归档切换,模拟现实中实际的归档切换。

  1. --5.模拟归档日志切换
  2. sql> alter system archive log current;
  3.  
  4. System altered.
  5.  
  6. sql> STATUS FIRST_CHANGE# FIRST_TIME NEXT_CHANGE# NEXT_TIME
  7. ---------- ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ------------ ------------ ------------
  8. 1 1 31 52428800 512 2 YES ACTIVE 1572517 27-JUN-17 1574293 27-JUN-17
  9. 2 1 32 52428800 512 2 NO CURRENT 1574293 27-JUN-17 2.8147E+14
  10. 3 2 27 52428800 512 2 NO CURRENT 1574296 27-JUN-17 2.8147E+14
  11. 4 2 26 52428800 512 2 YES ACTIVE 1572521 27-JUN-17 1574296 27-JUN-17

6.业务用户更新操作

模拟业务用户jingyu更新T2表部分数据:

  1. --6.业务用户更新操作
  2. sql> update T2 SET contents = 'xxx' where id > 99998;
  3.  
  4. 2 rows updated.
  5.  
  6. sql> commit;
  7.  
  8. Commit complete.

7.归档日志切换

为了区分每个日志的不同操作,这里对数据库进行手工归档切换,模拟现实中实际的归档切换。

  1. --7.模拟归档日志切换
  2. sql> alter system archive STATUS FIRST_CHANGE# FIRST_TIME NEXT_CHANGE# NEXT_TIME
  3. ---------- ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ------------ ------------ ------------
  4. 1 1 33 52428800 512 2 NO CURRENT 1575480 27-JUN-17 2.8147E+14
  5. 2 1 32 52428800 512 2 YES ACTIVE 1574293 27-JUN-17 1575480 27-JUN-17
  6. 3 2 27 52428800 512 2 YES ACTIVE 1574296 27-JUN-17 1575458 27-JUN-17
  7. 4 2 28 52428800 512 2 NO CURRENT 1575458 27-JUN-17 2.8147E+14

8.确认需要分析的日志

确认之后需要使用LogMiner分析的日志:

  1. --8.确认需要分析的日志
  2. thread# 1 sequence# 30
  3. thread# 2 sequence# 25
  4. 这部分日志肯定是有记录插入操作
  5.  
  6. thread# 1 sequence# 31
  7. thread# 2 sequence# 26
  8. 这部分日志肯定是有记录删除操作
  9.  
  10. thread# 1 sequence# 32
  11. thread# 2 sequence# 27
  12. 这部分日志肯定是有记录更新操作

9.备份归档日志

将相关的归档都copy备份出来:

  1. --9. 将相关的归档都copy备份出来
  2. RUN {
  3. allocate channel dev1 device type disk format '/tmp/backup/arc_%h_%e_%t';
  4.  
  5. backup as copy archivelog sequence 30 thread 1;
  6. backup as copy archivelog sequence 31 thread 1;
  7. backup as copy archivelog sequence 32 thread 1;
  8. backup as copy archivelog sequence 25 thread 2;
  9. backup as copy archivelog sequence 26 thread 2;
  10. backup as copy archivelog sequence 27 thread 2;
  11.  
  12. release channel dev1;
  13. }

备份出来的归档日志文件如下:

  1. [oracle@jyrac1 backup]$ ls -lrth
  2. total 17M
  3. -rw-r----- 1 oracle asmadmin 2.3M Jun 27 21:50 arc_1_30_947800247
  4. -rw-r----- 1 oracle asmadmin 591K Jun 27 21:50 arc_1_31_947800249
  5. -rw-r----- 1 oracle asmadmin 143K Jun 27 21:50 arc_1_32_947800250
  6. -rw-r----- 1 oracle asmadmin 9.5M Jun 27 21:50 arc_2_25_947800251
  7. -rw-r----- 1 oracle asmadmin 3.6M Jun 27 21:50 arc_2_26_947800253
  8. -rw-r----- 1 oracle asmadmin 77K Jun 27 21:50 arc_2_27_947800254

10.使用LogMiner分析

使用LogMiner分析归档日志:

  1. --使用LogMiner分析归档日志
  2. --应该有插入操作的日志
  3. begin
  4. dbms_logmnr.add_logfile('/tmp/backup/arc_1_30_947800247');
  5. dbms_logmnr.add_logfile('/tmp/backup/arc_2_25_947800251'); dbms_logmnr.start_logmnr(Options=>dbms_logmnr.dict_from_online_catalog); end; / --应该有删除操作的日志 begin dbms_logmnr.add_logfile('/tmp/backup/arc_1_31_947800249'); dbms_logmnr.add_logfile('/tmp/backup/arc_2_26_947800253'); dbms_logmnr.start_logmnr(Options=>dbms_logmnr.dict_from_online_catalog); end; / --应该有更新操作的日志 begin dbms_logmnr.add_logfile('/tmp/backup/arc_1_32_947800250backup/arc_2_27_947800254'); dbms_logmnr.start_logmnr(Options=>dbms_logmnr.dict_from_online_catalog); end; /

查询v$logmnr_contents

  1. set lines 180 pages 500
  2. col username format a8
  3. col sql_redo format a50
  4. select username,scn,255)">timestamp,sql_redo from v$logmnr_contents where table_name='T2';
  5. where username='JINGYU';
  6.  
  7. where sql_redo like '%JINGYU%';
  8.  
  9. 'insert%JINGYU%';
  10. 'delete%JINGYU%';
  11. 'update%JINGYU%';

实验发现,以username为条件无法查询到相关记录,最终确认username都是unknown而不是真正执行语句的业务用户jingyu。
而挖掘出的日志sql_redo这个字段是完整的sql,可以采用like的方式查询,比如我分析更新操作的日志,就可以得到下面这样的结果:

  1. sql> --应该有更新操作的日志
  2. sql> begin
  3. 2 dbms_logmnr.add_logfile('/tmp/backup/arc_1_32_947800250');
  4. 3 dbms_logmnr.add_logfile('/tmp/backup/arc_2_27_947800254');
  5. 4 dbms_logmnr.start_logmnr(Options=>dbms_logmnr.dict_from_online_catalog);
  6. 5 end;
  7. 6 /
  8.  
  9. PL/sql procedure successfully completed.
  10.  
  11. sql> select count(1) from v$logmnr_contents;
  12.  
  13. COUNT(1)
  14. ----------
  15. 388
  16.  
  17. sql> sql_redo from v$logmnr_contents where username=no rows selected
  18. sql> sql_redo from v$logmnr_contents where sql_redo like '%JINGYU%';
  19. USERNAME SCN TIMESTAMP
  20. ------------------------------ ---------- ------------
  21. sql_REDO
  22. --------------------------------------------------------------------------------
  23. UNKNOWN 1575420 27-JUN-17
  24. update "JINGYU"."T2" set "CONTENTS" = 'xxx' where 'YSWGNNLCLMYWPSLQ ETVLGQJRKQIEAMOEYUFNRUQULVFRVPEDRV' and ROWID = 'AAAVWVAAGAAAAHnABj';
  25. UNKNOWN 1575420 27-JUN-17
  26. update 'WHCWFOZVLJWHFWLJ DNVSMQTORGJFFXYAdioJZWJCDDOYXAOQJG' 'AAAVWVAAGAAAAOYAAE';
  27. sql>

至此,LogMiner基本的操作实验已完成。

附:与LogMiner有关的一些操作命令参考:

  1. conn / as sysdba
  2. --安装LOGMINER
  3. @$ORACLE_HOME/rdbms/admin/dbmslmd.sql;
  4. @$ORACLE_HOME/rdbms/admin/dbmslm.sql;
  5. @$ORACLE_HOME/rdbms/admin/dbmslms.sql;
  6. @$ORACLE_HOME/rdbms/admin/prvtlm.plb;
  7.  
  8. --停止logmnr
  9. exec dbms_logmnr.end_logmnr
  10. --查询附加日志开启情况:
  11. select supplemental_log_data_min,supplemental_log_data_pk,supplemental_log_data_ui from v$database;
  12.  
  13. --开启附加日志
  14. alter database add supplemental log data;
  15.  
  16. --取消补充日志
  17. drop supplemental data (primary key) columns;
  18. data (unique) data;
  19.  
  20. --最后一个即为新的归档
  21. select name,dest_id,255)">thread#,255)">sequence# from v$archived_log;

最后确认如果开启了附加日志,username就可以捕获到正确的值:

  1. sql> set lines 180
  2. sql> /
  3.  
  4. GROUP# THREAD# SEQUENCE# BYTES BLOCKSIZE MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIME NEXT_CHANGE# NEXT_TIME
  5. ---------- ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ------------ ------------ ------------
  6. 1 1 35 52428800 512 2 YES INACTIVE 1590589 27-JUN-17 1591935 27-JUN-17
  7. 2 1 36 52428800 512 2 NO CURRENT 1591935 27-JUN-17 2.8147E+14
  8. 3 2 29 52428800 512 2 YES INACTIVE 1590594 27-JUN-17 1591938 27-JUN-17
  9. 4 2 30 52428800 512 2 NO CURRENT 1591938 27-JUN-17 2.8147E+14
  10.  
  11. 1,36
  12. 2,30
  13. sql> update t2 set contents =
  14. 2 'aaa' where id = 44449;
  15.  
  16. 1 row updated.
  17.  
  18. sql> commit;
  19.  
  20. Commit complete.
  21.  
  22. RUN {
  23. allocate channel dev1 device type disk format '/tmp/backup/arc_%h_%e_%t';
  24.  
  25. backup as copy archivelog sequence 36 thread 1;
  26. backup as copy archivelog sequence 30 thread 2;
  27.  
  28. release channel dev1;
  29. }
  30.  
  31. begin
  32. dbms_logmnr.add_logfile('/tmp/backup/arc_1_36_947808116');
  33. dbms_logmnr.add_logfile('/tmp/backup/arc_2_30_947808118');
  34. dbms_logmnr.start_logmnr(Options=>dbms_logmnr.dict_from_online_catalog);
  35. end;
  36. /
  37.  
  38. sql> 'JINGYU';
  39.  
  40. USERNAME SCN TIMESTAMP
  41. ------------------------------ ---------- ------------
  42. sql_REDO
  43. ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  44. JINGYU 1593448 27-JUN-17
  45. set transaction read write;
  46.  
  47. JINGYU 1593448 27-JUN-17
  48. update "T2" set where 'WZTSQZWYOCNDFKSMNJQLOLFUBRDOHCBMKXBHAPJSHCMWBYZJVH' and ROWID = 'AAAVWVAAGAAAACLAAL';
  49.  
  50. JINGYU 1593450 27-JUN-17
  51. commit;

可以看到,开启了附加日志,就可以正常显示username的信息了。

猜你在找的Oracle相关文章