Saruman!: added location note

2009-12-29T08:27:40Z

added location note

← Older revision		Revision as of 08:27, 29 December 2009
Line 28:		Line 28:

	# if you only have one site, or you want all the logs in a single report		# if you only have one site, or you want all the logs in a single report
	/bin/grep $GREPOPTIONS $ALOGDIR/access*.log{.1,} 2>/dev/null > $TMPFILE # get all the logs into the tmpfile, notice the GREPOPTIONS variable.		# /bin/grep $GREPOPTIONS $ALOGDIR/access*.log{.1,} 2>/dev/null > $TMPFILE # get all the logs into the tmpfile, notice the GREPOPTIONS variable.
	# resolve all the ips and generate the reports, note that "--trails --prefix http://www.domain.com" is optional it's only needed for generating trails stats		# resolve all the ips and generate the reports, note that "--trails --prefix http://www.domain.com" is optional it's only needed for generating trails stats
	($IP2H < $TMPFILE ) \| $VISITORS --trails --prefix http://www.domain.com - > $REPORTDIR/stats.html		# ($IP2H < $TMPFILE ) \| $VISITORS --trails --prefix http://www.domain.com - > $REPORTDIR/stats.html

	# -OR-		# -OR-
	# if you have multiple vhosts/prefixes and want separate reports, you can use this:		# if you have multiple vhosts/prefixes and want separate reports, you can use this:
	# replace all the "~~www prefix1 prefix2 prefix3~~" by your own prefixes (as in ~~http://PREFIX~~.~~domain.com~~)		# replace all the "saruman.biz mediawikifarm.nl" by your own prefixes (as they appear in the apache.conf for each vhost)
	for name in ~~www prefix1 prefix2 prefix3~~; do		for name in saruman.biz mediawikifarm.nl; do
	/bin/grep $GREPOPTIONS $ALOGDIR/~~access-~~$name.log{.1,} 2>/dev/null > $TMPFILE		/bin/grep $GREPOPTIONS $ALOGDIR/$name-access.log{.1,} 2>/dev/null > $TMPFILE
	($IP2H < $TMPFILE ) \| $VISITORS --trails --prefix http://$name~~.domain.com~~ - > $REPORTDIR/stats-$name.html		($IP2H < $TMPFILE ) \| $VISITORS --trails --prefix http://$name - > $REPORTDIR/stats-$name.html
	done		done

	rm -f $TMPFILE		rm -f $TMPFILE
	</source>		</source>

			Note that the resulting files get stored in ''/var/www/webstats'' and are readable for world. You could thus simply create a symlink somewhere in the directory tree of your website that links to these statistics (provided your apache configuration follows symlinks). Note that you might want to protect your statistics in some way, like with ''.htaccess''.

Saruman!: page created

2009-12-29T06:17:51Z

page created

New page

Visitor is an Apache2 log analyzer that can show which people visited your website. I found a simple cron-based setup [http://www.codealpha.net/441/easy-apache-log-statistics-using-visitors/ here]. The setup for our Debian system goes like this:

First install ''ip2host'' and ''visitor'' using the well understood
sudo apt-get install ip2host visitor
It will install the two requested packages, and probably also some extra packages like ''graphviz'' and ''ttf-liberation''.

Next we create a cache directory for ''ip2host''
sudo mkdir /var/cache/ip2host

Then we create the following script, which we save in ''/etc/cron.daily/visitors'':
<source lang="bash">
#!/bin/bash

MYIP="192.168" # i want to exclude my home network from the logs
SERVERIP="222.222.222.222" # my server's ip
REPORTDIR="/var/www/webstats" # folder where to store reports, this folder must exist
ALOGDIR="/var/log/apache2" # folder containing the logs
VISITORS="/usr/bin/visitors -A --exclude wp-cron.php --exclude robots.txt" # i exclude some files from the reports
IP2H="ip2host --cache=/var/cache/ip2host/cache.db"
GREPOPTIONS="-hv -e ^$MYIP -e ^$SERVERIP" # exclude my home network and my server's ip from the logs

# we create a tmp file that will hold the logs
TMPFILE=$(mktemp)
if [[ ! -f "$TMPFILE" ]]; then
echo "tmpfile doesn't exist."
exit 1
fi

# if you only have one site, or you want all the logs in a single report
/bin/grep $GREPOPTIONS $ALOGDIR/access*.log{.1,} 2>/dev/null > $TMPFILE # get all the logs into the tmpfile, notice the GREPOPTIONS variable.
# resolve all the ips and generate the reports, note that "--trails --prefix http://www.domain.com" is optional it's only needed for generating trails stats
($IP2H < $TMPFILE ) | $VISITORS --trails --prefix http://www.domain.com - > $REPORTDIR/stats.html

# -OR-
# if you have multiple vhosts/prefixes and want separate reports, you can use this:
# replace all the "www prefix1 prefix2 prefix3" by your own prefixes (as in http://PREFIX.domain.com)
for name in www prefix1 prefix2 prefix3; do
/bin/grep $GREPOPTIONS $ALOGDIR/access-$name.log{.1,} 2>/dev/null > $TMPFILE
($IP2H < $TMPFILE ) | $VISITORS --trails --prefix http://$name.domain.com - > $REPORTDIR/stats-$name.html
done

rm -f $TMPFILE
</source>

Apache2 and Visitor - Revision history

Saruman!: added location note

Saruman!: page created