LoggingServicesP1ver1

DDM logfile forwarding

The syslog-ng logging infrastructure is used to forward logging information to central logging hosts for troubleshooting. We collect, for DQ2 0.2.12:

• The subscriptions.log file from each DQ2 site.
• FTS logfile from the central server at BNL. To be done.

This version is based on VDT 1.7.0.

Goal

Install syslog-ng from the VDT on your DQ2 site services host to forward DQ2 logging data to the DDM logging host, http://ddm-log.uchicago.edu/.

Previous twiki instructions

• Original testing instructions for DQ2 0.2.12, http://twiki.mwt2.org/bin/view/Logging/SyslogInstall

Installation

• Syslog-ng in the new release of VDT 1.7.1 is located at http://vdt.cs.wisc.edu/vdt_171_cache/Syslog-ng.pacman. However, VDT 1.7.0 has the best guide, see: https://twiki.grid.iu.edu/twiki/bin/view/Integration/VDTSyslogNG.
• Login as root
• Get the recommended pacman; installed in /opt, setup.
• mkdir /opt/syslog-ng/
• pacman -get VTB:Syslog-ng-170
• Answered y to all questions.

Configuration for a DQ2 0.2.12 site service

Example:

• # source $VDT_LOCATION/setup.sh
• # cd $VDT_LOCATION/vdt/setup
• # ./configure_syslog_ng --server y
• # ./configure_syslog_ng --central-host ddm-log.uchicago.edu:5142
• # ./configure_syslog_ng --add-source "dq2 /opt/dq2/config/UC/subscriptions.log"
• changed log_socket_directory to $VDT_LOCATION/syslog-ng/etc/
• change pid_file_location to a directory where the daemon user has read and write privileges. (e.g. /opt/vtb-1.7.0/syslog-ng/etc/injectors.pid)
• Edited /etc/crontab with:

*/10 * * * * $VDT_LOCATION/syslog-ng/bin/syslog_injector.py -c $VDT_LOCATION/syslog_ng/etc/log_settings.ini -t 

FTS logging

For FTS logging, to the same as above, except define the source as:

• # ./configure_syslog_ng --add-source "fts   /full-path-to-FTS-logfile "

Startup

• Finally, running vdt-control --on should start the syslog-ng process and start sending log information to the central server. This is install the init.d scripts and start the syslog-ng service. Running vdt-control --off will remove the init.d scripts. Once vdt-control --on is run you can use the standard service or chkconfig commands with the syslog-ng service.

Validation

• Sent test message across to ddm-log.uchicago.edu:
• Seeing dq2 subscriptions.log file output arrives. Email Rob to verify.
• Optionally, you might have luck with seeing it appear in Splunk. Go to http://ddm-log.uchicago.edu:8000/ and login as user ddm with the usual atlas password.

-- RobertGardner - 10 May 2007 -- RobertGardner - 25 Jun 2007