思路:
1、文件读取
2、先找出只访问一次的 只有一次时间
3、访问多次的 寻找开始时间和 最后一次时间
1、将所有IP和时间分别定义一个列表 两者元素相同
2、遍历搜索IP的index位置,同时去找时间位置
3、最后一次时间需要对IP和时间列表翻转
列表翻转方法:
1、 使用reversed()函数:reversed()函数返回的是一个迭代器,而不是一个List,需要再使用List函数转换一下
2、使用sorted() 其中reverse=True是按降序排列,reverse=False是按照升序排列
3、使用分片: 其中[::-1]代表从后向前取值,每次步进值为1
#/usr/bin/env python
#-*-coding:UTF-8 -*-
ips=[]
datelist=[]
ips_once=[] #仅出现一次的IP集合
ipindex_list=[] #IP信息列表
commdatetime=[] #时间信息列表 和IP信息是一一对应
infodict={} #创建了一个序列号 IP+时间的字典
ip_count_first=[] #仅出现一次的IP+时间集合
ip_count_many = [] #出现多次 IP第一次时间 第二次时间的集合
print("欢迎使用NGINX日志分析小工具!!!!")
print("功能一:统计每个IP访问的次数")
"""
with open("newlog.txt","r") as ngfile:
for line in ngfile:
iptime=line.split(' ')[0]
ip =iptime.split('-')[0]
time = iptime.split('[')[1]
print(ip,time)"""
with open("nginxlog.txt","r") as ngfile:
for line in ngfile:
ips.append(line.split()[0])
datelist.append(line.split()[1])
for i in range(0,int(len(ips))):
infodict[i]= "IP:"+ips[i]+" 访问时间:"+datelist[i]
for ip in set(ips):
ip_count = str(ips).count(ip)
print("IP地址: "+ip+" 访问书次数:"+ str(ip_count))
if ip_count == 1:
ip_index = ips.index(ip)
ip_count_first.append(infodict[ip_index])
ips_once.append(ip)
else:
first_index = ips.index(ip)
first_time = datelist[first_index]
ips_reverse= ips[::-1]
last_index = ips_reverse.index(ip)
datelist_reverse = datelist[::-1]
last_time = datelist_reverse[last_index]
ip_count_many.append('ip:'+ip+" 第一次访问时间: "+first_time+' 最后一次访问时间:'+last_time)
#print(ip_count_first)
#多次记录
print('功能二:统计只访问1次的IP地址和时间:'.format('*',3))
for ip_time in ip_count_first:
print(ip_time)
print('功能三:访问多次的IP地址,第一次时间和最后一次时间:')
for j in ip_count_many:
print(j)日志IP和时间部分
103.106.120.4 24/May/2018:06:12:10 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:12 103.106.120.4 24/May/2018:06:12:13 103.106.120.4 24/May/2018:06:12:14 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:12 103.106.120.4 24/May/2018:06:12:12 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:19:16 123.168.70.118 24/May/2018:06:16:57 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:17:04 123.168.70.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:43 123.168.70.118 24/May/2018:06:17:43 112.36.36.74 24/May/2018:06:18:00 183.230.30.249 24/May/2018:06:21:56 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:11 103.106.120.4 24/May/2018:06:12:12 103.106.120.4 24/May/2018:06:12:12 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:15 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:16 153.119.226.180 24/May/2018:06:13:19 123.168.70.118 24/May/2018:06:16:57 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:58 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.113 24/May/2018:06:16:59 123.168.70.118 24/May/2018:06:16:59 123.168.70.110 24/May/2018:06:17:04 123.168.70.117 24/May/2018:06:17:05 123.168.71.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:05 123.168.70.118 24/May/2018:06:17:43 123.168.70.118 24/May/2018:06:17:43 112.36.36.74 24/May/2018:06:18:00 183.230.30.249 24/May/2018:06:21:56 112.36.36.70 24/May/2018:06:18:00 112.36.36.70 24/May/2018:06:18:02 110.36.38.70 24/May/2018:06:18:00
结果:
欢迎使用NGINX日志分析小工具!!!! 功能一:统计每个IP访问的次数 IP地址: 123.168.71.118 访问书次数:1 IP地址: 110.36.38.70 访问书次数:1 IP地址: 153.119.226.180 访问书次数:68 IP地址: 112.36.36.70 访问书次数:2 IP地址: 123.168.70.117 访问书次数:1 IP地址: 123.168.70.113 访问书次数:1 IP地址: 123.168.70.118 访问书次数:82 IP地址: 123.168.70.110 访问书次数:1 IP地址: 112.36.36.74 访问书次数:2 IP地址: 103.106.120.4 访问书次数:42 IP地址: 183.230.30.249 访问书次数:2 功能二:统计只访问1次的IP地址和时间: IP:123.168.71.118 访问时间:24/May/2018:06:17:05 IP:110.36.38.70 访问时间:24/May/2018:06:18:00 IP:123.168.70.117 访问时间:24/May/2018:06:17:05 IP:123.168.70.113 访问时间:24/May/2018:06:16:59 IP:123.168.70.110 访问时间:24/May/2018:06:17:04 功能三:访问多次的IP地址,第一次时间和最后一次时间: ip:153.119.226.180 第一次访问时间: 24/May/2018:06:13:15 最后一次访问时间:24/May/2018:06:13:19 ip:112.36.36.70 第一次访问时间: 24/May/2018:06:18:00 最后一次访问时间:24/May/2018:06:18:02 ip:123.168.70.118 第一次访问时间: 24/May/2018:06:16:57 最后一次访问时间:24/May/2018:06:17:43 ip:112.36.36.74 第一次访问时间: 24/May/2018:06:18:00 最后一次访问时间:24/May/2018:06:18:00 ip:103.106.120.4 第一次访问时间: 24/May/2018:06:12:10 最后一次访问时间:24/May/2018:06:12:12 ip:183.230.30.249 第一次访问时间: 24/May/2018:06:21:56 最后一次访问时间:24/May/2018:06:21:56

Python分析NGINX日志里面相同IP第一次访问时间和最后一次访问时间
原文:http://blog.51cto.com/dreamlinux/2120866