Pyhon制作脚本提取日志数据

原创

深雾

修改于 2020-08-17 02:05:00

65600

代码可运行

文章被收录于专栏：工具类工具类

运行总次数：0

代码可运行

Python

可能是java和lua的基础，这门语言学起来莫名的快，安装环境看了半天基础语法就开始写脚本了。

需求

提取log日志文件夹的日志，error错误日志和add数据信息，定时更新当前日期的最新日志信息

脚本

需求还需要定时更新查找当天日志文件，后面补上

#!/usr/bin/python
# -*- coding: UTF-8 -*-
import os,sys,io,importlib
sys.setrecursionlimit(10000000)
importlib.reload(sys)
final = []
#work为绝对路径，windos下"d:/ProgramH5Server/H5_server_lj/log"
#linux运行1：chmod a+x log.py  2：sed -i 's/\r$//' log.py 3：./log.py
work = "d:/ProgramH5Server/H5_server_lj/log"
for root,dirs,files in os.walk(work): 
    for file in files: 
        final.append(os.path.join(root,file))    
 
def writeline(file):
    filename = file
    log_dir = os.path.join(work, filename)
    with io.open(log_dir, 'r', encoding='utf-8') as f: 
        print(file)
        lines = f.readlines()
        error_line = []
        operate_line = []
        for line in lines:
            if 'Error' in line or 'ERROR' in line or 'Exception' in line or 'EXCEPTION' in line or './' in line :
                error_line.append(line)
            elif '---add' in line :
                operate_line.append(line)
 
    errorlogname = 'error.log'
    operatelogname = 'operate.log'
    resultwork = os.path.dirname(__file__)
    log_a = os.path.join(resultwork, errorlogname)
    log_b = os.path.join(resultwork, operatelogname)
    with io.open(log_a, 'a',encoding='utf-8') as result:
        result.write('日志文件错误:'+ file)
        for i in list(set(error_line)):
            result.write(i)
    with open(log_b, 'a', encoding='utf-8') as result:
        result.write('日志文件操作:'+ file)
        for i in list(set(operate_line)):
            result.write(i)
 
for file in final:
    writeline(file)
 
#定时