Updaters

(This has now been implemented via a LEMON sensor running on lxnfs2, and a cron job that fetches the logs and extracts information from the log files into a small sqlight database (which gets overwritten every night)).

The usage graph can be found via LEMON. You can get graphs for a grand total, or split between internal/external/CDB machines, split by distribution, or select/drop architectures.

Sources:

• httpd logs on lxnfs machines
• SUE logs on lxnfs machines
• CDB via CDB2SQL access (while these are not updating directly from linuxsoft, they do so indirectly via Quattor)
• (rsync and ftp logs have been considered, but these services aren't used widely)

1. Installation

• 1.1 Following packages are required
  • lx-stats (>2.0)
  • lemon-sensor-linuxsoft (from LEMON sensors repository)

2. Configuration

• 2.1 Adding new linuxsoft server machines:
  • new machine must allow ssh access without password for root@lxnfs2
  • httpd log file must be /var/log/httpd/access_log
  • SUE log file must be /var/log/sueclients.log (and needs to be rotated at least once per year...)
  • edit /afs/cern.ch/project/linux/redhat/kickstart/etc/aimsconfig.pm, add to servers.
  • done!

• 2.2 Adding new system (i.e. SLC5)
  • check that /var/lx-stats/lx-stat-sqlite.pl correctly splits out the accesses for the new distribution into the DB
  • add the new distro to the LEMON sensor configuration under /etc/lemon.agent/sensor/lxstat.conf

• Debugging:
  • use sqlight3 /var/lx-stats/stat.sqlite on lxnfs2 to run queries interactively, i.e. to identify machines during a migration campaign. Use .schema updaters to get more info about the table.

-- JanIven - 18 Jul 2007