Project

General

Profile

Wiki » History » Version 3

Pablo Alingery, 17/07/2017 11:42

1 1 Pablo Alingery
h1. Installation Netdrms_9.0
2 1 Pablo Alingery
3 1 Pablo Alingery
4 1 Pablo Alingery
h2. Create dir 
5 1 Pablo Alingery
6 2 Pablo Alingery
Create the directory to untar netdrms_9.0  from  http://jsoc.stanford.edu/~arta/for-pablo/netdrms-9.X.20170530tar.gz
7 1 Pablo Alingery
<pre>
8 1 Pablo Alingery
mkdir /usr/local/netdrms_9.0
9 1 Pablo Alingery
</pre>
10 1 Pablo Alingery
11 1 Pablo Alingery
12 1 Pablo Alingery
13 1 Pablo Alingery
h2. Configuration file 
14 1 Pablo Alingery
15 1 Pablo Alingery
<pre>
16 1 Pablo Alingery
cp config.local.template config.local
17 1 Pablo Alingery
</pre>
18 1 Pablo Alingery
19 1 Pablo Alingery
Config from netdmrs_8.12 
20 1 Pablo Alingery
Warning : Config not done for remote sum as jmd is used 
21 1 Pablo Alingery
22 1 Pablo Alingery
23 1 Pablo Alingery
h2. File configure modif
24 1 Pablo Alingery
25 1 Pablo Alingery
In file /usr/local/netdrms_current/configure
26 1 Pablo Alingery
27 1 Pablo Alingery
Replace all " $? !=0 " by " $status !=0 " in file configure then tape
28 1 Pablo Alingery
29 1 Pablo Alingery
30 1 Pablo Alingery
h2. File jsoc_machine.csh modif 
31 1 Pablo Alingery
32 1 Pablo Alingery
In file /usr/local/netdrms_current/build/jsoc_machine.csh (Same issue in NetDrms 8.11 )
33 1 Pablo Alingery
34 1 Pablo Alingery
ligne 28 :
35 1 Pablo Alingery
36 1 Pablo Alingery
<pre>
37 1 Pablo Alingery
case "x86_64":
38 1 Pablo Alingery
      echo linux_x86_64
39 1 Pablo Alingery
      breaksw
40 1 Pablo Alingery
</pre>
41 1 Pablo Alingery
42 1 Pablo Alingery
h2. File make_basic.mk 
43 1 Pablo Alingery
44 1 Pablo Alingery
In file make_basic.mk line 223
45 1 Pablo Alingery
46 1 Pablo Alingery
look for "GCC_LF_ALL ="
47 1 Pablo Alingery
add "-lcrypto"
48 1 Pablo Alingery
49 3 Pablo Alingery
h2. Execution configure
50 3 Pablo Alingery
<pre>
51 3 Pablo Alingery
./configure
52 3 Pablo Alingery
</pre>
53 1 Pablo Alingery
54 3 Pablo Alingery
h2. build 
55 3 Pablo Alingery
Type 
56 1 Pablo Alingery
57 3 Pablo Alingery
<pre>
58 3 Pablo Alingery
make
59 3 Pablo Alingery
make sums
60 3 Pablo Alingery
</pre>
61 1 Pablo Alingery
62 3 Pablo Alingery
Install OK 
63 1 Pablo Alingery
64 1 Pablo Alingery
h2. Starting  Netdrms 
65 1 Pablo Alingery
66 1 Pablo Alingery
<pre>
67 1 Pablo Alingery
Starting it I have got :
68 1 Pablo Alingery
production@sdo3:/usr/local/netdrms_current$ sum_start.NetDRMS
69 1 Pablo Alingery
Number of SUM process sets to spawn = 1
70 1 Pablo Alingery
Max number of SUM process can spawn = 8
71 1 Pablo Alingery
SUMSERVER is sdo3
72 1 Pablo Alingery
SUMS_MANAGER is production
73 1 Pablo Alingery
SUMS db is ias_sdo_sums
74 1 Pablo Alingery
SUMS log dir is /usr/local/netdrms_current/logs/SUM
75 1 Pablo Alingery
sum_start.NetDRMS at 2017.07.12_19:41:38
76 1 Pablo Alingery
77 1 Pablo Alingery
** NOTE: SUMS is already running
78 1 Pablo Alingery
Do you want me to do a sum_stop.NetDRMS followed by a sum_start.NetDRMS (y or n):
79 1 Pablo Alingery
y
80 1 Pablo Alingery
SUMS log dir is /usr/local/netdrms_current/logs/SUM
81 1 Pablo Alingery
82 1 Pablo Alingery
sum_stop.NetDRMS at 2017.07.12_19:41:53
83 1 Pablo Alingery
84 1 Pablo Alingery
NOTE: This will stop sum_svc and related processes. Make sure you want to do this
85 1 Pablo Alingery
Enter reason for stop (terminate with single '.' or ^D):
86 1 Pablo Alingery
>> some reason
87 1 Pablo Alingery
>> .
88 1 Pablo Alingery
Please identify yourself:
89 1 Pablo Alingery
>> Pablo
90 1 Pablo Alingery
Timed-out waiting for sums_procck.py (pid 12640) to exit.
91 1 Pablo Alingery
** Now starting SUMS on ias_sdo_sums
92 1 Pablo Alingery
SUM NetDRMS Start Complete
93 1 Pablo Alingery
production@sdo3:/usr/local/netdrms_current$ Running on SUMS-server host sdo3.
94 1 Pablo Alingery
Connection to SUMS DB ias_sdo_sums.
95 1 Pablo Alingery
Using SUMS-log file sum_svc_2017.07.12.192435.logR.
96 1 Pablo Alingery
Using SUMS-rm-log file 2017.07.12.192435.log.
97 1 Pablo Alingery
Process sum_svc is not running.
98 1 Pablo Alingery
Starting process sum_svc.
99 1 Pablo Alingery
100 1 Pablo Alingery
Please wait for sum_svc and tape inventory (optional) to initialize...
101 1 Pablo Alingery
Can't open config file /usr/local/netdrms_current/logs/SUM/sum_rm.cfg. Using defaults...
102 1 Pablo Alingery
rm: impossible de supprimer « /SUM12/D355906038/Records.txt »: Système de fichiers accessible en lecture seulement
103 1 Pablo Alingery
rm: impossible de supprimer « /SUM12/D355906038/S00000/spikes.fits »: Système de fichiers accessible en lecture seulement
104 1 Pablo Alingery
rm: impossible de supprimer « /SUM12/D355906038/S00000/image_lev1.fits »: Système de fichiers accessible en lecture seulement
105 1 Pablo Alingery
(...)
106 1 Pablo Alingery
</pre>
107 1 Pablo Alingery
108 1 Pablo Alingery
So I killed netdrms to fix that point 
109 1 Pablo Alingery
110 1 Pablo Alingery
<pre>
111 1 Pablo Alingery
Shutting down SUMS...
112 1 Pablo Alingery
Killing [sum_rm](pid 17376).
113 1 Pablo Alingery
Killing sum_svc(pid 17371).
114 1 Pablo Alingery
Removing pidfile /usr/local/netdrms_current/logs/SUM/sums.pidfile
115 1 Pablo Alingery
Exiting process via shutdown() with return value 0.
116 1 Pablo Alingery
</pre>
117 1 Pablo Alingery
118 1 Pablo Alingery
119 1 Pablo Alingery
The sum_rm is running although in config.local I have set SUMRM_NOOP to 1
120 1 Pablo Alingery
121 1 Pablo Alingery
<pre>
122 1 Pablo Alingery
# If the value is set to anything other than 0, then sum_rm is rendered inactive. Otherwise, sum_rm is active.
123 1 Pablo Alingery
SUMRM_NOOP                             1
124 1 Pablo Alingery
</pre>
125 1 Pablo Alingery
126 1 Pablo Alingery
So I put an old sum_rm.cfg in /home/production/netdrms_current/logs/SUM/ then it was ok
127 1 Pablo Alingery
128 1 Pablo Alingery
<pre>
129 1 Pablo Alingery
production@sdo3:/usr/local/netdrms_current$ sum_start.NetDRMS
130 1 Pablo Alingery
Number of SUM process sets to spawn = 1
131 1 Pablo Alingery
Max number of SUM process can spawn = 8
132 1 Pablo Alingery
SUMSERVER is sdo3
133 1 Pablo Alingery
SUMS_MANAGER is production
134 1 Pablo Alingery
SUMS db is ias_sdo_sums
135 1 Pablo Alingery
SUMS log dir is /usr/local/netdrms_current/logs/SUM
136 1 Pablo Alingery
sum_start.NetDRMS at 2017.07.12_19:46:51
137 1 Pablo Alingery
138 1 Pablo Alingery
** Now starting SUMS on ias_sdo_sums
139 1 Pablo Alingery
SUM NetDRMS Start Complete
140 1 Pablo Alingery
production@sdo3:/usr/local/netdrms_current$ Running on SUMS-server host sdo3.
141 1 Pablo Alingery
Connection to SUMS DB ias_sdo_sums.
142 1 Pablo Alingery
Using SUMS-log file sum_svc_2017.07.12.194651.log.
143 1 Pablo Alingery
Using SUMS-rm-log file 2017.07.12.194651.log.
144 1 Pablo Alingery
Process sum_svc is not running.
145 1 Pablo Alingery
Starting process sum_svc.
146 1 Pablo Alingery
147 1 Pablo Alingery
Please wait for sum_svc and tape inventory (optional) to initialize...
148 1 Pablo Alingery
Can't open the log file /home/production/netdrms_current/logs/SUM/sum_rm.log.2017.07.12.194651 for sum_rm on sdo3
149 1 Pablo Alingery
150 1 Pablo Alingery
151 1 Pablo Alingery
## sum_rm for production  pid = 17672 ##
152 1 Pablo Alingery
You are configured as the active user
153 1 Pablo Alingery
cmd: cat /tmp/cmdgrep.17672.log | wc -l 1> /tmp/sum_rm.17672.log
154 1 Pablo Alingery
Connect to Postgres host=sdo3 db=ias_sdo_sums user=production Ok
155 1 Pablo Alingery
DS_PavailRequest
156 1 Pablo Alingery
Called alrm_sig()
157 1 Pablo Alingery
Jul 12 19:46:53
158 1 Pablo Alingery
NOOP
159 1 Pablo Alingery
160 1 Pablo Alingery
production@sdo3:/usr/local/netdrms_current$ sum_svc now available
161 1 Pablo Alingery
</pre>
162 1 Pablo Alingery
163 1 Pablo Alingery
h2. Test Netdrms_9.0
164 1 Pablo Alingery
165 1 Pablo Alingery
Quick test on the thing that bothered us with netdrms_2.4 and lead us to think about an update :
166 1 Pablo Alingery
167 1 Pablo Alingery
<pre>
168 1 Pablo Alingery
production@sdo3:/usr/local/netdrms_current$ show_info -r -S -P 'hmi.sharp_720s_nrt[5398][! DATE__OBS>$(2016-12-20T23:00:00Z) AND DATE__OBS<$(2016-12-21T01:00:00Z) !]' key='DATE__OBS'
169 1 Pablo Alingery
recnum    sunum    DATE__OBS    SUDIR
170 1 Pablo Alingery
2190405    884413026    2016-12-20T23:10:30.80Z    /SUM13/D884413026/S00000
171 1 Pablo Alingery
2190409    884414163    2016-12-20T23:22:30.80Z    /SUM13/D884414163/S00000
172 1 Pablo Alingery
2190413    884416279    2016-12-20T23:34:30.80Z    /SUM13/D884416279/S00000
173 1 Pablo Alingery
2190417    884417281    2016-12-20T23:46:30.80Z    /SUM13/D884417281/S00000
174 1 Pablo Alingery
2190421    884419003    2016-12-20T23:58:30.80Z    /SUM13/D884419003/S00000
175 1 Pablo Alingery
2190425    884421131    2016-12-21T00:10:30.90Z    /SUM13/D884421131/S00000
176 1 Pablo Alingery
2190429    884422598    2016-12-21T00:22:30.90Z    /SUM13/D884422598/S00000
177 1 Pablo Alingery
2190433    884424336    2016-12-21T00:34:30.90Z    /SUM13/D884424336/S00000
178 1 Pablo Alingery
2190437    884425290    2016-12-21T00:46:30.90Z    /SUM13/D884425290/S00000
179 1 Pablo Alingery
2190441    884427329    2016-12-21T00:58:30.90Z    /SUM13/D884427329/S00000
180 1 Pablo Alingery
</pre>