LinuxStatistics < LinuxSupport

LinuxSupport Web>LinuxSupportInternals>LinuxStatistics (2007-10-19, JanIven) (raw view)

collect usage info from various sources, generate shiny graphs.

----+ Updaters
Monitor the number of machines that pull updates from the linuxsoft service.


(This has now been implemented via a LEMON sensor running on lxnfs2, and a cron job that fetches the logs and extracts information from the log files into a small sqlight database (which gets overwritten every night)).

The usage graph can be found via [[http://lemonweb03.cern.ch/lemon-web/metric_graph.php?metric=lxstat_u&entity=linuxsoft_updaters&field=total&sdate=17-06-2007&sdate_time=10%3A11%3A28&edate=18-12-2010&edate_time=00%3A00%3A00][LEMON]].
You can get graphs for a grand total, or split between internal/external/CDB machines, split by distribution, or select/drop architectures.

Sources:
   * httpd logs on lxnfs machines
   * SUE logs on lxnfs machines
   * CDB via !CDB2SQL access (while these are not updating directly from linuxsoft, they do so indirectly via Quattor)
   * (rsync and ftp logs have been considered, but these services aren't used widely)


1.  Installation

   * 1.1 Following packages are required
      * lx-stats (>2.0)
      *  lemon-sensor-linuxsoft (from LEMON sensors repository)

2. Configuration

   * 2.1 Adding new linuxsoft server machines:
      * new machine must allow ssh access without password for root@lxnfs2
      * httpd log file must be /var/log/httpd/access_log
      * SUE log file must be /var/log/sueclients.log (and needs to be rotated at least once per year...)
      * edit /afs/cern.ch/project/linux/redhat/kickstart/etc/aimsconfig.pm, add to servers.
      * done!

   * 2.2 Adding new system (i.e. SLC5)
      * check that /var/lx-stats/lx-stat-sqlite.pl correctly splits out the accesses for the new distribution into the DB
      * add the new distro to the LEMON sensor configuration under /etc/lemon.agent/sensor/lxstat.conf

   * Debugging:
      * use =sqlight3 /var/lx-stats/stat.sqlite= on *lxnfs2* to run queries interactively, i.e. to identify machines during a migration campaign. Use =.schema updaters= to get more info about the table. 

-- Main.JanIven - 18 Jul 2007

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
rpm	lx-stats-1.0-1.noarch.rpm	r1	manage	15.5 K	2006-03-28 - 16:53	UnknownUser
rpm	lx-stats-1.0-1.src.rpm	r1	manage	13.4 K	2006-03-28 - 16:52	UnknownUser

Topic revision: r19 - 2007-10-19 - JanIven

LinuxSupport

LinuxSupport Web
LinuxSupport Web Home
Changes
Index
Search

- Cern Search
- TWiki Search
- Google Search
LinuxSupport All webs

Copyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback