MEDOC - Multi Experiment Data & Operation Center » NetDRMS_8.12

{{toc}}

h1. NetDRMS Installation

h2. Requirements

h3. Configuring production environment

Adding user production

<pre>

# adduser production

# addgroup ias

# adduser production ias

</pre>

h3. Configure /home/production/.profile

Adding environment variables

<pre>

# Added by Elie for netdrms

#Modif Pablo 07/06/2010

PATH="/usr/local/netdrms_current/bin/linux_x86_64:$PATH"

PATH="/usr/local/netdrms_current/scripts:$PATH"

PATH="/usr/local/jmd/jetty/bin:$PATH"

PATH="/usr/local/jmd/vso/scripts:$PATH"

PATH="/usr/local/pgsql/bin:$PATH"

PATH="/usr/local/netdrms/scripts:$PATH"

#2014-12-17 Avec Herve et Pablo on pense que la ligne suivante est intutile as it is f.. install in /usr/local/lib

PATH="/home/production/cfitsio:$PATH"

#Done

DERBY_HOME=/usr/local/jmd/derby

export DERBY_HOME

export CVSROOT=:pserver:anonymous@solarch.tuc.noao.edu:2401/vtarc1/vso/cvsroot

 #Added by Elie for jetty

PATH="/usr/local/jmd/derby/bin:$PATH"

</pre>

h4. sshagent to JSOC

TBD

h3. Mise en place de Privilèges pour le SUMS_MANAGER

Veuillez modifier le fichier /etc/sudoers afin que le user 'production' puisse exécuter le programme sum_chown que nous placerons plus loin dans le répertoire :usr/local/bin. See [[#Anchor|here]]

Cela se fait en ajoutant au fichier la ligne suivante :

	production host=NOPASSWD:/usr/local/bin/sum_chmown

h3. Mise en place du fichier de mot de passe pour la base postgres 

Veuillez créer le fichier .pgpass contenant les informations nécessaires au user 'production" afin qu'il se connecte sans mot de passe, en tant que 'production' ou 'postgres' aux 2 bases que l'on créera plus loin ias_sdo et ias_sdo_sums.

.pgpass content :

<pre>

	sol-sdo1:5432:ias_sdo:production: 

	sol-sdo1:5434:ias_sdo_sums:production: 

	sol-sdo1:5432:ias_sdo:postgres: 

	sol-sdo1:5434:ias_sdo_sums:postgres

</pre>

h3. Install missing libraries

	• libreadline-dev (but already installed with postgresql)

	• libssl-dev 

	• libpam0g-dev 

	• libperl-dev 

<pre>

# apt-get install $library_name

</pre> 

where

	_$library_name_ is the name of library

Then to update path on libraries, please type :

<pre>

# ldconfig

</pre>

h3. Reconfigure locale

<pre>

# dpkg-reconfigure locales

</pre>

select fr_FR.UTF8 UTF8 and unselect en_US.UTF-8

localedef -i en_US -f UTF-8 en_US.UTF-8

(see here : [[http://www.thomas-krenn.com/en/wiki/Perl_warning_Setting_locale_failed_in_Debian]])

h3. Install missing packages

<pre>

# apt-get install gfortran swig

</pre>

h3. Installation of cfitsio library

Vesrion 3.37 (currently on sdo : 3.24)

<pre>

# wget ftp://heasarc.gsfc.nasa.gov/software/fitsio/c/cfitsio3370.tar.gz

</pre>

Dés-archivage et décompression

<pre>

# tar -xzvf cfitsio3370.tar.gz

</pre> 

Placez vous dans le répertoire /home/production/cftisio

su - root and :

<pre>

# ./configure --prefix=/usr/local

# make 

# make install

</pre> 

h2. Installation of postgresql

See the section : [[Test_Environment_-_Virtual_Machine_description#Manual-install-of-postgresql]]

h2. NetDRMS databases

on /DATABASES

(Note  : section 2.4 dans doc netdrms first install)

<pre>

# mkdir data

# mkdir data_sums

# mkdir data_monitor

# chown postgres:postgres data

# chown postgres:postgres data_sums

# chown postgres:postgres data_monitor

</pre>

h3. Initialisation des 2 serveurs data et data_sums

En tant qu'utilisateur postgres

<pre>

# su - postgres

$ initdb --locale=C -D data -A md5 -W

(no password)

Success. You can now start the database server using:

    postgres -D data

or

    pg_ctl -D data -l logfile start

$ initdb --locale=C -D data_sums -A md5 -W

(no password)

Success. You can now start the database server using:

    postgres -D data_sums

or

    pg_ctl -D data_sums -l logfile start

$ initdb --locale=C -D data_monitor -A md5 -W

(no password)

Success. You can now start the database server using:

    postgres -D data_monitor

or

    pg_ctl -D data_monitor -l logfile start

</pre>

Edition des fichiers postgresql.conf pour configurer les bons ports d'écoute :

listen_addresses = '*'

data -> port 5432

data_sums -> port 5434

data_monitor -> port 5436

Edition des fichiers data*/pg_hba.conf : remplacer md5 par trust

<pre>

#"local"

local   all             all                                     trust

#"IPv4"

host   all             all                                     trust

</pre>

Démarrage des 3 bases :

<pre>

# su - postgres

$ cd /DATABASES

$ pg_ctl -D data -l ./PG_LOGS/data.log start

$ pg_ctl -D data_sums -l ./PG_LOGS/data_sums.log start

$ pg_ctl -D data_monitor -l ./PG_LOGS/data_monitor.log start

note :

PG_LOGS is the directory for logs 

</pre>

	createdb --locale C -E LATIN1 -T template0 ias_sdo

	createdb --locale C -E LATIN1 -T template0 -p 5434 ias_sdo_sums

        createdb --locale C -E LATIN1 -T template0 -p 5436 ias_sdo_monitor

h2. NetDRMS tool Install

On se base sur la doc dipsonible ici : [[http://inf-redmine.ias.u-psud.fr/redmine/attachments/download/114/Netdrms_First_Install.odt]]

Les sources sont dans : http://jsoc.stanford.edu/netdrms/dist/

/usr/local/netdrms_8.10/

(Pour comparaison avec le serveur en production, on copie également le dossier netdrms_2.4 de sdo)

on créé un lien symbolique netdrms_current qui pointe sur la dernière release

ln -s netdrms_8.10/ netdrms_current 

Edition fichier config.local

<pre>

cp config.local.template config.local

</pre>

Creation de 2 répertoires : 

<pre>

mkdir /usr/local/netdrms_8.10/logs/SUM

mkdir /usr/local/netdrms_8.10/logs/slony

</pre>

Voir le contenu du le fichier [[config.local]] à jour

Création d'un alias netdrms dans /root/.bashrc

<pre>

alias netdrms='cd /usr/local/netdrms_current'

</pre>

Lancement configure

<pre>

./configure

</pre>

h3. Modification du fichier /usr/local/netdrms_current/configure (Not Applied in NetDrms_8.10)

<pre>

# The system configuration for configure script

set PERLBIN = "/usr/bin/perl"

set PYBIN = "/usr/bin/python"

</pre>

h3. Compilation problem due to uncorrect variable types

Art (art.amezcua@stanford.edu) purpose us a workaround and send us 2 files with correct declaration :

SUMLIB_RmDo.pgc (diff with original file : [[diff_SUMLIB_RmDo.pgc]])

SUMLIB_RmDoX.pgc (diff with original file : [[diff_SUMLIB_RmDoX.pgc]])

<pre>

# wget http://jsoc.stanford.edu/~arta/SUMLIB_RmDo.pgc

# wget http://jsoc.stanford.edu/~arta/SUMLIB_RmDoX.pgc

</pre>

Overwriting the existing files in the right place (base/sums/libs/pg), the command 'make' works well.

But there is still problem with 'make sums'

h3. Workaround to solve make sums problem

Modify [[sum_rpc.h]] in order to match the type of some variables

h3. Modification du fichier /usr/local/netdrms_current/build/jsoc_machine.csh

ligne 28 :

<pre>

  case "x86_64":

      echo linux_x86_64

      breaksw

</pre>

h3. Copier /usr/local/netdrms_2.4_release/base/drms/apps/serverdefs.h dans /usr/local/netdrms_current/base/drms/apps (not applied in NetDrms_8.10)

h3. Modification du fichier /usr/local/netdrms_current/configure (not applied in NetDrms_8.10)

au lieu de $? en csh on va mettre plutot $status

ligne 110 :

<pre>

  if ($status==0) 

</pre>

et ligne 123 :

<pre>

  if ($status==0) 

</pre>

Lancement :

<pre>

./configure

</pre>

h3. Installation des libraries libtar-dev, libcurl3-dev et libecpg-dev

<pre>

apt-get install libtar libtar-dev

</pre>

<pre>

apt-get install libcurl3-dev

</pre>

<pre>

apt-get install libecpg-dev

</pre>

h3. #H4ck 2 Malade #PabloR0cks# (Not Applied in NetDrm_8.10)

Modification du fichier /usr/include/stdint.h

ligne 55 : long int remplacé par long long int

<pre>

#if __WORDSIZE == 64

typedef unsigned long int       uint64_t; --> ici long long int

#else

__extension__

typedef unsigned long long int  uint64_t;

#endif

</pre>

"Allo Linus ?!?.."

h3. Compilation

<pre>

# make

# make sums

# make jsoc_fetch

</pre>

NB : lib64 does not exist on debian 8. so ln -s /usr/lib lib64

h2. make sums KO  (Not applied in NetDrms_8.10)

Solution found : Take old lib libcrypto instead libssl

dans le fichier base/sums/apps/Rules.mk ligne 51 

replace -lssl by -lcrypto LD flag

h2. NetDRMS replication

<pre>

# cd base/drms/replication/etc

# scp production@sdo:/usr/local/netdrms/install-config-files/ias.subscribe_list.cfg  .

# scp production@sdo:/usr/local/netdrms/install-config-files/ias.repclient.cfg  .

WRONG !!!!!

To be done cp repclient.template.cfg into ias.subscribe_list.cfg because new field in config file can't appear 

Correct that step in NetDrms doc 

The existing ias.repclient.cfg can be used tough to fill params 

</pre>

Create tmp dir in netdrms working directory (/usr/local/netdrms_current)

<pre>

# mkdir tmp

</pre>

Prevent from deleting files

<pre>

cd logs/SUM ; scp production@sdo:/usr/local/netdrms/install-config-files/sum_rm.cfg .

</pre>

h2. Jetty installation

<pre>

# cd /usr/local

# wget http://vso.tuc.noao.edu/VSO/slony_proxy/jetty_install_kit_v1.4.2.tar.gz

# tar xzvf jetty_install_kit_v1.4.2.tar.gz

# cd jetty_install_kit_v1.4.2

# scp production@sdo:/usr/local/netdrms/install/install-jetty.cfg .

# ./install_jetty.sh install-jetty.cfg

</pre>

Cherche la commande ij

rajouter son chemin dans le path

vi ~/.bashrc

<pre>

# set PATH so it includes user's private bin if it exists

if [ -d "$HOME/bin" ] ; then

    PATH="$HOME/bin:$PATH"

fi

# Added by Elie for netdrms

#Modif Pablo 07/06/2010

PATH="$HOME/netdrms_current/bin/linux_x86_64:$PATH"

PATH="$HOME/netdrms_current/scripts:$PATH"

PATH="/usr/local/jmd/jetty/bin:$PATH"

PATH="/usr/local/jmd/vso/scripts:$PATH"

PATH="/usr/local/pgsql/bin:$PATH"

PATH="/usr/local/netdrms/scripts:$PATH"

#2014-12-17 Avec Herve et Pablo on pense que la ligne suivante est intutile as it is f.. install in /usr/local/lib

PATH="/home/production/cfitsio:$PATH"

#Done

DERBY_HOME=/usr/local/jmd/derby

export DERBY_HOME

export CVSROOT=:pserver:anonymous@solarch.tuc.noao.edu:2401/vtarc1/vso/cvsroot

 #Added by Elie for jetty

PATH="/usr/local/jmd/derby/bin:$PATH"

</pre>

h2. JMD configuration

As user production

<pre>

# cd /usr/local/jmd/jetty/webapps

</pre>

<pre>

# scp production@sdo:/usr/local/netdrms/install/JMD.cfg .

</pre>

We download the last version of JMD.war

<pre>

# wget http://vso.tuc.noao.edu/VSO/slony_proxy/JMD_v1.5.7.0.war

# mv JMD_v1.5.7.0.war JMD.war

</pre>

<pre>

# cp /usr/local/netdrms_current/_linux_x86_64/base/export/apps/jsoc_fetch .

</pre>

Define an alias jettylogs in .bashrc of production account :

<pre>

alias jettylogs='cd /usr/local/jmd/jetty/logs'

</pre>

<pre>

# jettylogs

# cd ../bin

# vi jetty.sh 

</pre>

Add the following line :

<pre>

JAVA_OPTIONS="$JAVA_OPTIONS -Xms256m -Xmx512m -Djetty.home=$JETTY_HOME -Djava.io.tmpdir=$TMP"

</pre>

copy the script remotesums_master_jmd.pl in the right place

<pre>

# netdrms

# cd base/drms/scripts/

# cp home/production/jetty_install_kit_v1.4/scripts/remotesums_master_jmd.pl .

</pre>

<pre>

# netdrms

# cd scripts

# rm remotesums_master.pl

# ln -s ../base/drms/scripts/remotesums_master_jmd.pl remotesums_master.pl

</pre>

Change exec rights

<pre>

# netdrms 

# cd base/drms/scripts

# chmod 740  remotesums_master_jmd.pl

# chmod 740 remotesums_master.pl

</pre>

h3(#Anchor). Copy sum_chmown binary to /usr/local/bin/

<pre>

# netdrms

# cd bin/linux_x86_64

# cp sum_chmown /usr/local/bin/

</pre>

h3. Retrieve modified get_slony_logs.pl file

<pre>

# netdrms

# cd base/drms/replication 

# scp production@sol-sdo1:/usr/local/netdrms/install/get_slony_logs.pl .

</pre>

h2. NetDRMS Start script

<pre>

sum_start.NetDRMS

</pre>

h2. Database repair (from Art)

On ias_sdo

<pre>

delete from admin.ns where name = 'lm_jps';

delete from admin.ns where name = 'aia_test';

</pre>

h2. Private key Public key generation 

<pre>

ssh-keygen -t rsa

</pre>

Not necessary cause we recover the ssh keys of the current server.

However, we have to retrieve the private key of production account on sdo3

From sdo :

<pre>

rsync -av id_rsa production@sdo3:/home/production/.ssh/

</pre>

h2. Node definition

file : /usr/local/netdrms_current/base/drms/replication/etc/ias.repclient.cfg

<pre>

node=IAStest

</pre>

h2. show_series and delete_series binaries

Remark : these 2 sources are not compiled during installation

Issue : in netdrms_current 8.10 , do :

$ make delete_series

$ make show_series

h2. SSH-HPN install 

Intallation de openssh 6.3p1 car le dernier patch hpn dispo est 6.3hpn13.V6 

web site for open ssh : http://ftp2.fr.openbsd.org/pub/OpenBSD/OpenSSH/portable/openssh-6.3p1.tar.gz

patch hpn : http://www.psc.edu/index.php/hpn-ssh-patches/hpn-14-kitchen-sink-patches/viewdownload/24-hpn-14-kitchen-sink-patches/102-openssh-6-3p1-hpnssh14v2-kitchen-sink-patch

<pre>

# tar -xzvf openssh-6.3p1.tar.gz

# gunzip openssh-6.3p1-hpnssh14v2.diff.gz

# cd openssh-6.3p1

# zcat ../openssh-6.3p1-hpnssh14v2.diff.gz | patch -p1

# ./configure --prefix=/usr/local/hpn-ssh --with-pam --with-md5-passwords --without-zlib-version-check --with-tcp-wrappers

# make

# make install

</pre>

Depuis sdo :

<pre>

# cd /usr/local/hpn-ssh/etc/

# rsync -av *key* netadm@sdo3:/home/netadm/

</pre>

Sur sdo3 :

<pre>

rsync -av /home/netadm/*key* /usr/local/hpn-ssh/etc/

</pre>

We have to configure the port number to 55000

<pre>

# vi ssh_config

</pre>

and add :

<pre>

#Port 22

Port 55000

</pre>

We configure also the server hpn (even we don't use it yet)

<pre>

# vi sshd_config

</pre>

and add :

<pre>

#Port 22

Port 55000

#PidFile /var/run/sshd.pid

PidFile /var/run/sshd.55000.pid

# allow the use of the none cipher

#NoneEnabled no

NoneEnabled yes

</pre>

h2. Correction

h3. Modification du fichier ias.repclient.cfg

Copier le template existant repclient.template.cfg dans le répertoire [netdrms_current]/base/drms/replication/etc

<pre>

production@sdo3:/usr/local/netdrms_current/base/drms/replication/etc$ cp repclient.template.cfg ias.repclient.cfg

</pre>

Nouveau / netdrms2.4 

<pre>

# Apps

kRSPerl=<path to Perl binary to use when Perl scripts are executed>

</pre>

h2. Subscription test 

h3. Librairies manquantes

Errors 

<pre>

Failure to apply SQL file 'IAStest.subscribe_series.sql' from server: ABORTING!

Can't locate DBI.pm 

.

.

.

Failure to apply SQL file 'IAStest.subscribe_series.sql' from server: ABORTING!

Can't locate DBD/Pg.pm

</pre>

<pre>

root@sdo3:/usr/local/netdrms_8.10/base/drms/replication/subscribe_series# apt-get install libdbi-perl 

root@sdo3:/usr/local/netdrms_8.10/base/drms/replication/subscribe_series# apt-get install libdbd-pg-perl

</pre>

h2. Test recuperation de meta data 

librairies manquantes 

apt-get install libnet-ssh-perl

apt-get install libstring-shellquote-perl

h2. TO BE DONE FURTHER

h3. Modification du fichir config.local pour la souscription au jsoc

<pre>

# NetDRMS users can request subdirectories from the Stanford proj directories 

# (e.g., JSOC/proj/util). These users will need to contact Stanford and obtain

# the source subdirectories desired. They will then place these subdirectories

# in the JSOC/proj directory of their NetDRMS release. To properly build 

# targets in these subdirectories, using the JSOC make system, the user needs

# to add entries to this configuration file - one entry for each subdirectory

# that contains source code to be compiled. Each entry is a space-separated pair

# of strings: the string "PROJDIR" followed by a subdirectory (of the proj 

# directory).  For example:

#

# PROJDIR     util/apps

# PROJDIR     util/libs

# 

# NOTE: It is not sufficient to list only a parent directory, like util. Source code

# in child directories will not automatically be compiled.

</pre>

h3. Python library for multi-threaded SUMS

Installation de la librairie python3.4m