Project

General

Profile

NetDRMS Installation » History » Version 245

Herve Ballans, 08/06/2016 15:35

1 50 Herve Ballans
{{toc}}
2 1 Herve Ballans
3 1 Herve Ballans
h1. NetDRMS Installation
4 1 Herve Ballans
5 1 Herve Ballans
h2. Requirements
6 1 Herve Ballans
7 47 Pablo Alingery
h3. Configuring production environment
8 1 Herve Ballans
9 121 Pablo Alingery
Adding user production (en root)
10 47 Pablo Alingery
11 1 Herve Ballans
<pre>
12 1 Herve Ballans
# adduser production
13 1 Herve Ballans
# addgroup ias
14 1 Herve Ballans
# adduser production ias
15 1 Herve Ballans
</pre>
16 1 Herve Ballans
17 49 Herve Ballans
h3. Configure /home/production/.profile
18 1 Herve Ballans
19 49 Herve Ballans
Adding environment variables
20 1 Herve Ballans
21 1 Herve Ballans
<pre>
22 122 Herve Ballans
#Modif Herve.B Pablo.A 12/05/2016
23 122 Herve Ballans
24 1 Herve Ballans
PATH="/usr/local/netdrms_current/bin/linux_x86_64:$PATH"
25 49 Herve Ballans
PATH="/usr/local/netdrms_current/scripts:$PATH"
26 122 Herve Ballans
PATH="/usr/local/jmd/bin:$PATH"
27 122 Herve Ballans
PATH="/usr/local/jmd/scripts:$PATH"
28 141 Pablo Alingery
#The following is not needed as installed with 'apt-get install' 
29 141 Pablo Alingery
#PATH="/usr/local/pgsql/bin:$PATH"
30 122 Herve Ballans
PATH="/usr/local/netdrms-tools/scripts:$PATH"
31 49 Herve Ballans
#2014-12-17 Avec Herve et Pablo on pense que la ligne suivante est intutile as it is f.. install in /usr/local/lib
32 140 Pablo Alingery
PATH="/usr/local/cfitsio:$PATH"
33 1 Herve Ballans
#Done
34 49 Herve Ballans
35 122 Herve Ballans
DERBY_HOME=/usr/local/jmd/databases/derby/derbyBD
36 49 Herve Ballans
export DERBY_HOME
37 49 Herve Ballans
38 49 Herve Ballans
export CVSROOT=:pserver:anonymous@solarch.tuc.noao.edu:2401/vtarc1/vso/cvsroot
39 49 Herve Ballans
</pre>
40 49 Herve Ballans
41 162 Pablo Alingery
h3. Configure /varl/lib/postgres/.profile
42 161 Pablo Alingery
43 163 Pablo Alingery
Add to $PATH so postgres can exeute command like initdb
44 161 Pablo Alingery
45 161 Pablo Alingery
<pre>
46 161 Pablo Alingery
#Modif Herve.B Pablo.A 19/05/2016
47 161 Pablo Alingery
PATH="/usr/lib/postgresql/9.4/bin:$PATH"
48 161 Pablo Alingery
</pre>
49 161 Pablo Alingery
50 125 Pablo Alingery
h3. Setting privileges for SUMS_MANAGER
51 87 Herve Ballans
52 126 Pablo Alingery
Please modify file /etc/sudoers so user 'production' will be able to execute  'sum_chown' that we will locate in the dir : /usr/local/bin . See below
53 125 Pablo Alingery
Add to /etc/sudoers the following line :
54 1 Herve Ballans
	production host=NOPASSWD:/usr/local/bin/sum_chmown
55 1 Herve Ballans
56 127 Pablo Alingery
h3. Set passwords file for db postgres 
57 1 Herve Ballans
58 127 Pablo Alingery
Please create file .pgpass with the following information for user 'production" so he will be able to connect without password as 'production' or 'postgres' to 2 db that we will create later ias_sdo and ias_sdo_sums.
59 1 Herve Ballans
60 1 Herve Ballans
61 1 Herve Ballans
.pgpass content :
62 1 Herve Ballans
<pre>
63 128 Pablo Alingery
	#hostname:5432:ias_sdo:production: 
64 128 Pablo Alingery
	#hostname:5434:ias_sdo_sums:production: 
65 128 Pablo Alingery
	#hostname:5432:ias_sdo:postgres: 
66 128 Pablo Alingery
	#hostname:5434:ias_sdo_sums:postgres
67 1 Herve Ballans
</pre>
68 128 Pablo Alingery
69 129 Pablo Alingery
where #hostname is the name of your server
70 129 Pablo Alingery
71 129 Pablo Alingery
72 131 Pablo Alingery
%{color:red}WARNING : change hostname when migrate sdo-new to sdo%
73 1 Herve Ballans
74 133 Pablo Alingery
h3. Install missing libraries 
75 1 Herve Ballans
76 133 Pablo Alingery
• libreadline-dev (but already installed with postgresql)
77 133 Pablo Alingery
• libssl-dev 
78 133 Pablo Alingery
• libpam0g-dev 
79 133 Pablo Alingery
• libperl-dev 
80 1 Herve Ballans
81 133 Pablo Alingery
NB : Already done in Debian 8.4 Jessy
82 1 Herve Ballans
<pre>
83 1 Herve Ballans
# apt-get install $library_name
84 1 Herve Ballans
</pre> 
85 1 Herve Ballans
where
86 1 Herve Ballans
	_$library_name_ is the name of library
87 19 Pablo Alingery
88 1 Herve Ballans
Then to update path on libraries, please type :
89 1 Herve Ballans
<pre>
90 19 Pablo Alingery
# ldconfig
91 1 Herve Ballans
</pre>
92 1 Herve Ballans
93 1 Herve Ballans
h3. Reconfigure locale
94 1 Herve Ballans
95 1 Herve Ballans
<pre>
96 1 Herve Ballans
# dpkg-reconfigure locales
97 1 Herve Ballans
</pre>
98 1 Herve Ballans
99 1 Herve Ballans
select fr_FR.UTF8 UTF8 and unselect en_US.UTF-8
100 1 Herve Ballans
101 1 Herve Ballans
localedef -i en_US -f UTF-8 en_US.UTF-8
102 1 Herve Ballans
103 1 Herve Ballans
(see here : [[http://www.thomas-krenn.com/en/wiki/Perl_warning_Setting_locale_failed_in_Debian]])
104 1 Herve Ballans
105 134 Pablo Alingery
h3. Install gfortran packages
106 1 Herve Ballans
107 1 Herve Ballans
<pre>
108 1 Herve Ballans
# apt-get install gfortran swig
109 1 Herve Ballans
</pre>
110 1 Herve Ballans
111 1 Herve Ballans
h3. Installation of cfitsio library
112 1 Herve Ballans
113 135 Pablo Alingery
In /usr/local dir
114 135 Pablo Alingery
115 135 Pablo Alingery
Version 3.39 (currently on sdo : 3.24)
116 1 Herve Ballans
<pre>
117 135 Pablo Alingery
# wget ftp://heasarc.gsfc.nasa.gov/software/fitsio/c/cfitsio3390.tar.gz
118 1 Herve Ballans
</pre>
119 137 Pablo Alingery
Untar and  decompression
120 1 Herve Ballans
<pre>
121 136 Pablo Alingery
# tar -xzvf cfitsio3390.tar.gz
122 1 Herve Ballans
</pre> 
123 1 Herve Ballans
124 139 Pablo Alingery
Go into /usr/local and type
125 1 Herve Ballans
126 1 Herve Ballans
su - root and :
127 1 Herve Ballans
<pre>
128 1 Herve Ballans
# ./configure --prefix=/usr/local
129 1 Herve Ballans
# make 
130 1 Herve Ballans
# make install
131 135 Pablo Alingery
</pre>
132 118 Pablo Alingery
133 237 Herve Ballans
h3. Installation des libraries libtar-dev, libcurl3-dev et libecpg-dev
134 237 Herve Ballans
135 237 Herve Ballans
<pre>
136 237 Herve Ballans
apt-get install libtar libtar-dev
137 237 Herve Ballans
</pre>
138 237 Herve Ballans
139 238 Pablo Alingery
Note, selecting 'libcurl4-openssl-dev' instead of 'libcurl3-dev'
140 238 Pablo Alingery
libcurl4-openssl-dev is already the newest version
141 237 Herve Ballans
<pre>
142 237 Herve Ballans
apt-get install libcurl3-dev
143 237 Herve Ballans
</pre>
144 237 Herve Ballans
145 237 Herve Ballans
<pre>
146 237 Herve Ballans
apt-get install libecpg-dev
147 237 Herve Ballans
</pre>
148 237 Herve Ballans
149 144 Pablo Alingery
h3. Installation of apache2 and lib perl
150 118 Pablo Alingery
151 118 Pablo Alingery
<pre>
152 118 Pablo Alingery
# apt-get install apache2
153 118 Pablo Alingery
154 118 Pablo Alingery
# apt-get install libjson-perl
155 118 Pablo Alingery
156 118 Pablo Alingery
# apt-get install libapache2-mod-perl2
157 118 Pablo Alingery
</pre>
158 1 Herve Ballans
159 183 Herve Ballans
h3. Installation of postgresql
160 1 Herve Ballans
161 145 Pablo Alingery
Into 'root'
162 145 Pablo Alingery
 
163 145 Pablo Alingery
<pre>
164 147 Pablo Alingery
apt-get install postgresql-9.4 postgresql-client-9.4 
165 145 Pablo Alingery
</pre>
166 145 Pablo Alingery
167 213 Herve Ballans
h3. Installation of python3
168 209 Pablo Alingery
169 209 Pablo Alingery
Into 'root'
170 209 Pablo Alingery
 
171 209 Pablo Alingery
<pre>
172 209 Pablo Alingery
apt-get install python3 
173 1 Herve Ballans
</pre>
174 210 Pablo Alingery
175 211 Pablo Alingery
Add some modules psycopg2 (postgres connector) and pySmartDL (Download manager) 
176 210 Pablo Alingery
177 210 Pablo Alingery
<pre>
178 210 Pablo Alingery
apt-get install python3-psycopg2
179 210 Pablo Alingery
</pre>
180 210 Pablo Alingery
181 210 Pablo Alingery
<pre>
182 210 Pablo Alingery
apt-get install python3-psycopg2
183 210 Pablo Alingery
</pre>
184 210 Pablo Alingery
185 210 Pablo Alingery
Add python3-pip for modules within python3
186 210 Pablo Alingery
187 210 Pablo Alingery
<pre>
188 210 Pablo Alingery
apt-get install python3-pip
189 1 Herve Ballans
</pre>
190 212 Pablo Alingery
191 212 Pablo Alingery
<pre>
192 212 Pablo Alingery
pip3 install pySmartDL
193 212 Pablo Alingery
</pre>
194 1 Herve Ballans
195 213 Herve Ballans
Both python2.7 and 3.4 versions are installed on the system.
196 213 Herve Ballans
By default, the python2.7 is used.
197 213 Herve Ballans
In order to change in 3.4 by default, type :
198 213 Herve Ballans
<pre>
199 213 Herve Ballans
update-alternatives --config python
200 213 Herve Ballans
</pre>
201 209 Pablo Alingery
202 1 Herve Ballans
h3. Installation of sdo_scripts
203 218 Pablo Alingery
204 219 Pablo Alingery
Install monitoring scripts for sdo
205 218 Pablo Alingery
206 218 Pablo Alingery
<pre>
207 218 Pablo Alingery
208 218 Pablo Alingery
</pre>
209 218 Pablo Alingery
210 1 Herve Ballans
h2. NetDRMS databases
211 1 Herve Ballans
212 156 Pablo Alingery
into /var/lib/postgresql  (hard mount point separated,  7 disks 15000 tr/min in raid5 in order to distribute read and write) 
213 1 Herve Ballans
214 1 Herve Ballans
<pre>
215 158 Pablo Alingery
# cd /var/lib/postgresql
216 157 Pablo Alingery
# mkdir data  data_sums data_monitor
217 157 Pablo Alingery
# chown -R postgres:postgres * 
218 1 Herve Ballans
</pre>
219 1 Herve Ballans
220 160 Pablo Alingery
h3. Initialize 3 servers data,  data_sums, data_monitor
221 1 Herve Ballans
222 159 Pablo Alingery
Into postgres
223 1 Herve Ballans
<pre>
224 1 Herve Ballans
# su - postgres
225 1 Herve Ballans
226 1 Herve Ballans
$ initdb --locale=C -D data -A md5 -W
227 1 Herve Ballans
(no password)
228 2 Herve Ballans
229 2 Herve Ballans
Success. You can now start the database server using:
230 2 Herve Ballans
231 2 Herve Ballans
    postgres -D data
232 2 Herve Ballans
or
233 2 Herve Ballans
    pg_ctl -D data -l logfile start
234 2 Herve Ballans
235 1 Herve Ballans
236 1 Herve Ballans
$ initdb --locale=C -D data_sums -A md5 -W
237 2 Herve Ballans
(no password)
238 2 Herve Ballans
239 2 Herve Ballans
Success. You can now start the database server using:
240 2 Herve Ballans
241 2 Herve Ballans
    postgres -D data_sums
242 2 Herve Ballans
or
243 2 Herve Ballans
    pg_ctl -D data_sums -l logfile start
244 8 Pablo Alingery
245 8 Pablo Alingery
$ initdb --locale=C -D data_monitor -A md5 -W
246 8 Pablo Alingery
(no password)
247 8 Pablo Alingery
248 8 Pablo Alingery
Success. You can now start the database server using:
249 8 Pablo Alingery
250 8 Pablo Alingery
    postgres -D data_monitor
251 8 Pablo Alingery
or
252 8 Pablo Alingery
    pg_ctl -D data_monitor -l logfile start
253 2 Herve Ballans
</pre>
254 2 Herve Ballans
255 1 Herve Ballans
256 1 Herve Ballans
257 1 Herve Ballans
Edition des fichiers postgresql.conf pour configurer les bons ports d'écoute :
258 1 Herve Ballans
listen_addresses = '*'
259 1 Herve Ballans
data -> port 5432
260 10 Pablo Alingery
data_sums -> port 5434
261 1 Herve Ballans
data_monitor -> port 5436
262 10 Pablo Alingery
263 165 Pablo Alingery
Edit files data*/pg_hba.conf : replace 'md5' by 'trust'
264 1 Herve Ballans
<pre>
265 1 Herve Ballans
#"local"
266 1 Herve Ballans
local   all             all                                     trust
267 1 Herve Ballans
#"IPv4"
268 1 Herve Ballans
host   all             all                                     trust
269 1 Herve Ballans
</pre>
270 166 Pablo Alingery
271 166 Pablo Alingery
h3. Tunning postgres 
272 166 Pablo Alingery
273 166 Pablo Alingery
In file postgres.conf ( according to https://www.qwant.com/?q=Tunning+postgres+server+9.4+&client=firefox  )
274 166 Pablo Alingery
275 168 Pablo Alingery
shared_buffer=4096MB %{color:red}So 1/12 of the total RAM memory available%
276 1 Herve Ballans
277 169 Pablo Alingery
work_mem = 24MB
278 168 Pablo Alingery
279 168 Pablo Alingery
maintenance_work_mem = 4096MB
280 1 Herve Ballans
281 169 Pablo Alingery
wal_buffers = 16MB
282 169 Pablo Alingery
283 169 Pablo Alingery
checkpoint_segments = 32
284 169 Pablo Alingery
285 169 Pablo Alingery
checkpoint_completion_target = 0.9
286 169 Pablo Alingery
287 169 Pablo Alingery
random_page_cost = 1.0
288 169 Pablo Alingery
289 169 Pablo Alingery
effective_cache_size = 16384MB so 1/4 of the max memory 
290 169 Pablo Alingery
291 170 Pablo Alingery
292 170 Pablo Alingery
293 170 Pablo Alingery
#log
294 169 Pablo Alingery
logging_collector = on 
295 169 Pablo Alingery
log_directory = 'pg_log' 
296 169 Pablo Alingery
log_filename = 'postgresql-%Y-%m-%d_%H%M%S.log' # log file name pattern,
297 169 Pablo Alingery
log_truncate_on_rotation = on           # If on, an existing log file with the
298 169 Pablo Alingery
log_rotation_age = 1d                   # Automatic rotation of logfiles will
299 170 Pablo Alingery
client_min_messages = error
300 170 Pablo Alingery
log_min_messages = error 
301 170 Pablo Alingery
log_min_duration_statement = 0
302 170 Pablo Alingery
303 170 Pablo Alingery
log_connections = on
304 170 Pablo Alingery
log_disconnections = on
305 170 Pablo Alingery
log_duration = off
306 170 Pablo Alingery
log_hostname = on
307 170 Pablo Alingery
log_line_prefix = '%t [%p]: %u@%h - %d :'  
308 170 Pablo Alingery
309 170 Pablo Alingery
track_counts = on
310 170 Pablo Alingery
autovacuum = on 
311 170 Pablo Alingery
312 170 Pablo Alingery
extra_float_digits = 3
313 170 Pablo Alingery
314 177 Pablo Alingery
h3. Start the 3 databases :
315 1 Herve Ballans
316 1 Herve Ballans
<pre>
317 1 Herve Ballans
# su - postgres
318 196 Herve Ballans
$ cd /var/lib/postgresql
319 172 Pablo Alingery
$ pg_ctl -D data  start
320 172 Pablo Alingery
$ pg_ctl -D data_sums start
321 172 Pablo Alingery
$ pg_ctl -D data_monitor start
322 1 Herve Ballans
</pre>
323 174 Pablo Alingery
324 1 Herve Ballans
h3. Create the 3 databases :
325 181 Pablo Alingery
326 178 Pablo Alingery
Into user 'postgres'
327 1 Herve Ballans
328 179 Pablo Alingery
* createdb --locale C -E LATIN1 -T template0 ias_sdo
329 179 Pablo Alingery
* createdb --locale C -E LATIN1 -T template0 -p 5434 ias_sdo_sums
330 179 Pablo Alingery
* createdb --locale C -E LATIN1 -T template0 -p 5436 ias_sdo_monitor
331 54 Herve Ballans
332 182 Herve Ballans
h3. Automatic startup
333 182 Herve Ballans
334 182 Herve Ballans
Add following lines in the /etc/rc.local file :
335 182 Herve Ballans
336 182 Herve Ballans
<pre>
337 197 Herve Ballans
su -l -c "/usr/lib/postgresql/9.4/bin/pg_ctl -D /var/lib/postgresql/data start" postgres
338 197 Herve Ballans
su -l -c "/usr/lib/postgresql/9.4/bin/pg_ctl -D /var/lib/postgresql/data_sums start" postgres
339 197 Herve Ballans
su -l -c "/usr/lib/postgresql/9.4/bin/pg_ctl -D /var/lib/postgresql/data_monitor start" postgres
340 182 Herve Ballans
</pre>
341 182 Herve Ballans
342 184 Herve Ballans
h2. System tuning
343 1 Herve Ballans
344 187 Herve Ballans
Current configuration :
345 185 Herve Ballans
<pre>
346 185 Herve Ballans
# sysctl -a
347 185 Herve Ballans
</pre>
348 1 Herve Ballans
349 187 Herve Ballans
In the following file :
350 185 Herve Ballans
<pre>
351 185 Herve Ballans
# vi /etc/sysctl.conf
352 185 Herve Ballans
</pre>
353 1 Herve Ballans
354 188 Herve Ballans
we change some values (default values are commented with '#')
355 194 Herve Ballans
356 195 Herve Ballans
(resources links [[Links|here]])
357 194 Herve Ballans
358 185 Herve Ballans
<pre>
359 191 Herve Ballans
# Semaphore is a object that is used to control utilization of a particular process.
360 191 Herve Ballans
# kernel.sem = SEMMSL SEMMNS SEMOPM SEMMNI
361 191 Herve Ballans
# SEMMSL        maximum number of semaphores per array  (min 128)
362 191 Herve Ballans
# SEMMNS        maximum semaphores system-wide  
363 191 Herve Ballans
# SEMOPM        maximum operations per semop call       
364 191 Herve Ballans
# SEMMNI        maximum arrays 
365 191 Herve Ballans
#semop incresed from 32 (default value)operation to 100 (3rd value )
366 191 Herve Ballans
# kernel.sem = 250      32000   32      128
367 191 Herve Ballans
kernel.sem = 250 32000 100 128
368 191 Herve Ballans
369 191 Herve Ballans
In order to  apply changes :#This sets the  OS receive buffer size for all types of connections (default value 212992)
370 191 Herve Ballans
#net.core.rmem_default = 212992
371 191 Herve Ballans
#net.core.rmem_max = 212992
372 191 Herve Ballans
net.core.rmem_default = 33554432
373 191 Herve Ballans
net.core.rmem_max = 33554432
374 191 Herve Ballans
375 191 Herve Ballans
#This is the OS send buffer size for all types of connections (212992 default value) 
376 191 Herve Ballans
#net.core.wmem_default = 212992
377 191 Herve Ballans
#net.core.wmem_max = 212992
378 191 Herve Ballans
net.core.wmem_default = 33554432
379 191 Herve Ballans
net.core.wmem_max = 33554432
380 191 Herve Ballans
381 193 Pablo Alingery
#TCP Autotuning setting. "The first value tells the kernel the minimum receive buffer for each TCP connection, and this buffer is always
382 193 Pablo Alingery
# allocated to a TCP socket, even under high pressure on the system. ... The second value specified tells the kernel the default receive
383 193 Pablo Alingery
# buffer allocated for each TCP socket. This value overrides the /proc/sys/net/core/rmem_default value used by other protocols. ...
384 192 Pablo Alingery
# The third and last value specified in this variable specifies the maximum receive buffer that can be allocated for a TCP socket."
385 1 Herve Ballans
#net.ipv4.tcp_rmem = 4096       87380   6291456
386 1 Herve Ballans
net.ipv4.tcp_rmem = 10240 87380 33554432
387 1 Herve Ballans
388 193 Pablo Alingery
#TCP Autotuning setting. "This variable takes 3 different values which holds information on how much TCP sendbuffer memory space
389 193 Pablo Alingery
# each TCP socket has to use. Every TCP socket has this much buffer space to use before the buffer is filled up. Each of the three 
390 193 Pablo Alingery
#values are used under different conditions. ... The first value in this variable tells the minimum TCP send buffer space available
391 193 Pablo Alingery
# for a single TCP socket. ... The second value in the variable tells us the default buffer space allowed for a single TCP socket to use. ... 
392 193 Pablo Alingery
#The third value tells the kernel the maximum TCP send buffer space." 
393 191 Herve Ballans
#net.ipv4.tcp_wmem = 4096       16384   4194304
394 191 Herve Ballans
net.ipv4.tcp_wmem = 10240 87380 33554432
395 191 Herve Ballans
396 191 Herve Ballans
#Disable cache metrics so the initial conditions of the closed connections will not be saved to be used in near future connections
397 191 Herve Ballans
#net.ipv4.tcp_no_metrics_save = 0
398 191 Herve Ballans
net.ipv4.tcp_no_metrics_save = 1
399 191 Herve Ballans
400 1 Herve Ballans
# Increase number of incoming connections backlog
401 1 Herve Ballans
# net.core.netdev_max_backlog = 1000
402 1 Herve Ballans
net.core.netdev_max_backlog = 5000
403 1 Herve Ballans
404 1 Herve Ballans
# The tcp_mem variable defines how the TCP stack should behave when it comes to memory usage. ... 
405 192 Pablo Alingery
#The first value specified in the tcp_mem variable tells the kernel the low threshold. 
406 192 Pablo Alingery
#Below this point, the TCP stack do not bother at all about putting any pressure on the memory usage by different TCP sockets. ... 
407 193 Pablo Alingery
#The second value tells the kernel at which point to start pressuring memory usage down. ... The final value tells the kernel how many
408 193 Pablo Alingery
# memory pages it may use maximally
409 1 Herve Ballans
# net.ipv4.tcp_mem = 1543347    2057796 3086694
410 191 Herve Ballans
net.ipv4.tcp_mem = 786432 1048576 26777216
411 191 Herve Ballans
412 192 Pablo Alingery
# local port range that is used by TCP and UDP traffic to choose the local port. You will see in the parameters of this file two numbers:
413 192 Pablo Alingery
# The first number is the first local port allowed for TCP and UDP traffic on the server, the second is the last local port number.
414 191 Herve Ballans
# net.ipv4.ip_local_port_range = 32768  61000
415 191 Herve Ballans
net.ipv4.ip_local_port_range = 1024 65535
416 191 Herve Ballans
417 191 Herve Ballans
# maximum number of sockets in TIME-WAIT to be held simultaneously.
418 191 Herve Ballans
# net.ipv4.tcp_max_tw_buckets = 262144
419 191 Herve Ballans
net.ipv4.tcp_max_tw_buckets = 360000
420 1 Herve Ballans
</pre>
421 185 Herve Ballans
422 191 Herve Ballans
Then we run the following command to make our change take effect:
423 191 Herve Ballans
424 185 Herve Ballans
<pre>
425 185 Herve Ballans
# sysctl -p
426 185 Herve Ballans
</pre>
427 176 Pablo Alingery
428 216 Pablo Alingery
h2. JMD Installation 
429 215 Herve Ballans
430 217 Pablo Alingery
Download new JMD package build by Niles Oien 2016-04-07 following thoses actions :
431 215 Herve Ballans
432 215 Herve Ballans
<pre>
433 215 Herve Ballans
cd /urs/local
434 215 Herve Ballans
435 215 Herve Ballans
[oien@spsc-nso19-12 ~]$ ftp gong2.nso.edu
436 215 Herve Ballans
Name (gong2.nso.edu:oien): anonymous
437 215 Herve Ballans
Password: <---------------- use your email as the password
438 215 Herve Ballans
ftp> cd outgoing/oien
439 215 Herve Ballans
ftp> get pablo_jmd.tar.gz
440 215 Herve Ballans
ftp> quit
441 215 Herve Ballans
</pre>
442 215 Herve Ballans
443 215 Herve Ballans
Install new JMD package following thoses actions 
444 215 Herve Ballans
445 215 Herve Ballans
<pre>
446 215 Herve Ballans
[oien@spsc-nso19-12 ~]$ gunzip -vf pablo_jmd.tar.gz
447 215 Herve Ballans
pablo_jmd.tar.gz:      8.3% -- replaced with pablo_jmd.tar
448 215 Herve Ballans
[oien@spsc-nso19-12 ~]$ tar xf pablo_jmd.tar
449 215 Herve Ballans
[oien@spsc-nso19-12 ~]$ cd pablo_jmd
450 215 Herve Ballans
[oien@spsc-nso19-12 pablo_jmd]$ less PABLO_README.txt
451 215 Herve Ballans
cd ..
452 215 Herve Ballans
mv jmd jmd_old
453 215 Herve Ballans
mv pablo_jmd jmd 
454 215 Herve Ballans
</pre>
455 215 Herve Ballans
456 215 Herve Ballans
h2. JMD Configuration
457 215 Herve Ballans
458 215 Herve Ballans
Configure webserver  to request jsoc_fetch
459 215 Herve Ballans
(following the mail from nilesoien@gmail.com)
460 215 Herve Ballans
461 222 Pablo Alingery
%{color:red}WARNING : change hostname when migrate sdo-new to sdo%
462 222 Pablo Alingery
463 220 Pablo Alingery
config d 'apache2 fichier sdo-new.ias.u-psud.fr 
464 215 Herve Ballans
<pre>
465 215 Herve Ballans
466 215 Herve Ballans
<VirtualHost *:80>
467 220 Pablo Alingery
        ServerName sdo-new.ias.u-psud.fr
468 215 Herve Ballans
        ServerAdmin pablo.alingery@ias.u-psud.fr
469 215 Herve Ballans
        #ErrorLog /var/log/apache2/error.log
470 215 Herve Ballans
        DocumentRoot /var/www
471 215 Herve Ballans
472 215 Herve Ballans
        # Possible values include: debug, info, notice, warn, error, crit,
473 215 Herve Ballans
        # alert, emerg.
474 215 Herve Ballans
        LogLevel debug
475 215 Herve Ballans
476 215 Herve Ballans
        #CustomLog /var/log/apache2/VSO/access.log combined
477 215 Herve Ballans
478 215 Herve Ballans
        Alias /VSO/DRMS/cgi-bin/ "/home/production/netdrms-tools/scripts/cgi-bin/"
479 215 Herve Ballans
480 215 Herve Ballans
        <Location /VSO/DRMS/cgi-bin>
481 215 Herve Ballans
                SetHandler perl-script
482 215 Herve Ballans
                PerlResponseHandler ModPerl::Registry
483 215 Herve Ballans
                PerlOptions +ParseHeaders
484 215 Herve Ballans
                Options +ExecCGI
485 215 Herve Ballans
                Order allow,deny
486 215 Herve Ballans
                Allow from all
487 215 Herve Ballans
        </Location>
488 215 Herve Ballans
</VirtualHost>
489 215 Herve Ballans
490 215 Herve Ballans
</pre>
491 215 Herve Ballans
492 223 Herve Ballans
Activate the new virtualhost and disable the default one :
493 223 Herve Ballans
<pre>
494 225 Herve Ballans
# a2ensite sdo-new.ias.u-psud.fr.conf
495 225 Herve Ballans
# a2dissite 000-default.conf
496 225 Herve Ballans
# service apache2 restart
497 225 Herve Ballans
</pre>
498 225 Herve Ballans
499 225 Herve Ballans
Allow symlink for the cgi scripts dierctory in apache2.conf :
500 225 Herve Ballans
<pre>
501 225 Herve Ballans
<Directory /home/production/netdrms-tools/scripts/>
502 225 Herve Ballans
        Options FollowSymLinks
503 225 Herve Ballans
        AllowOverride None
504 225 Herve Ballans
        Require all granted
505 225 Herve Ballans
</Directory>
506 225 Herve Ballans
</pre>
507 225 Herve Ballans
508 225 Herve Ballans
<pre>
509 225 Herve Ballans
# service apache2 restart
510 223 Herve Ballans
</pre>
511 223 Herve Ballans
 
512 226 Pablo Alingery
%{color:red}To be  added futher to test cgi%
513 1 Herve Ballans
Execution test cgi with URL :
514 226 Pablo Alingery
515 226 Pablo Alingery
make sure my $hostname=in the cgi file vso_jsoc_fetch.cgi is correct and test
516 224 Pablo Alingery
http://sdo-new.ias.u-psud.fr/VSO/DRMS/cgi-bin/vso_jsoc_fetch.cgi
517 215 Herve Ballans
518 215 Herve Ballans
expected result  :
519 215 Herve Ballans
<pre>
520 215 Herve Ballans
{
521 215 Herve Ballans
   "wait" : 0,
522 215 Herve Ballans
   "requestid" : "",
523 215 Herve Ballans
   "data" : {},
524 215 Herve Ballans
   "method" : "url_quick",
525 215 Herve Ballans
   "size" : 0,
526 215 Herve Ballans
   "errormsg" : "Empty query",
527 215 Herve Ballans
   "protocol" : "as-is",
528 215 Herve Ballans
   "status" : 1,
529 215 Herve Ballans
   "space_ratio" : 0.1,
530 215 Herve Ballans
   "load_ratio" : 0.066875,
531 215 Herve Ballans
   "dir" : "",
532 215 Herve Ballans
   "count" : 0
533 215 Herve Ballans
}
534 215 Herve Ballans
</pre>
535 215 Herve Ballans
536 1 Herve Ballans
h2. NetDRMS tool Install
537 23 Pablo Alingery
538 199 Pablo Alingery
The following installed is based on : [[http://inf-redmine.ias.u-psud.fr/redmine/attachments/download/114/Netdrms_First_Install.odt]]
539 1 Herve Ballans
540 207 Pablo Alingery
The sources are in : http://jsoc.stanford.edu/netdrms/dist/ 
541 207 Pablo Alingery
Locally on sdo-new in  : /home/production/sources
542 1 Herve Ballans
543 199 Pablo Alingery
Symbolic link created 'netdrms_current' that corresponds to the last release
544 227 Pablo Alingery
ln -s netdrms_8.11/ netdrms_current 
545 1 Herve Ballans
546 199 Pablo Alingery
Edit file config.local
547 27 Pablo Alingery
<pre>
548 27 Pablo Alingery
cp config.local.template config.local
549 1 Herve Ballans
</pre>
550 29 Pablo Alingery
551 203 Pablo Alingery
%{color:red}Warning WEB_DBUSER      apache  We think that it should value www maybe , to be checked testing the cgi%
552 208 Pablo Alingery
%{color:red}So check the cgi to figure out which user is used to connect to bd%
553 32 Herve Ballans
554 199 Pablo Alingery
Create 2 followings dirs : 
555 1 Herve Ballans
<pre>
556 227 Pablo Alingery
mkdir /usr/local/netdrms_8.11/logs/SUM
557 227 Pablo Alingery
mkdir /usr/local/netdrms_8.11/logs/slony
558 27 Pablo Alingery
</pre>
559 1 Herve Ballans
560 205 Pablo Alingery
%{color:red}Warning config.local from line 150 =>222 Remote config to provide data, series to externals%
561 205 Pablo Alingery
%{color:red}To be checked for PLATO%
562 1 Herve Ballans
563 1 Herve Ballans
Création d'un alias netdrms dans /root/.bashrc
564 27 Pablo Alingery
<pre>
565 1 Herve Ballans
alias netdrms='cd /usr/local/netdrms_current'
566 1 Herve Ballans
</pre>
567 31 Pablo Alingery
568 214 Pablo Alingery
569 206 Pablo Alingery
570 231 Pablo Alingery
h3. Modification du fichier /usr/local/netdrms_current/configure (Not Applied in NetDrms_8.10 and NetDrms_8.11 )
571 1 Herve Ballans
572 1 Herve Ballans
<pre>
573 1 Herve Ballans
# The system configuration for configure script
574 1 Herve Ballans
set PERLBIN = "/usr/bin/perl"
575 1 Herve Ballans
set PYBIN = "/usr/bin/python"
576 200 Pablo Alingery
</pre>
577 200 Pablo Alingery
578 230 Pablo Alingery
h3. Compilation problem due to uncorrect variable types (Not Applied in NetDrms_8.11)
579 35 Herve Ballans
580 34 Herve Ballans
Art (art.amezcua@stanford.edu) purpose us a workaround and send us 2 files with correct declaration :
581 42 Herve Ballans
582 42 Herve Ballans
SUMLIB_RmDo.pgc (diff with original file : [[diff_SUMLIB_RmDo.pgc]])
583 34 Herve Ballans
SUMLIB_RmDoX.pgc (diff with original file : [[diff_SUMLIB_RmDoX.pgc]])
584 1 Herve Ballans
585 228 Pablo Alingery
In dir  base/sums/libs/pg rename former file into *.orig and replace by SUMLIB_RmDo.pgc et SUMLIB_RmDoX.pgc
586 36 Herve Ballans
587 36 Herve Ballans
<pre>
588 36 Herve Ballans
# wget http://jsoc.stanford.edu/~arta/SUMLIB_RmDo.pgc
589 38 Herve Ballans
# wget http://jsoc.stanford.edu/~arta/SUMLIB_RmDoX.pgc
590 34 Herve Ballans
</pre>
591 1 Herve Ballans
592 233 Pablo Alingery
h3. Modification du fichier /usr/local/netdrms_current/build/jsoc_machine.csh (Same issue in NetDrms 8.11 )
593 1 Herve Ballans
594 1 Herve Ballans
ligne 28 :
595 1 Herve Ballans
596 1 Herve Ballans
<pre>
597 1 Herve Ballans
  case "x86_64":
598 1 Herve Ballans
      echo linux_x86_64
599 1 Herve Ballans
      breaksw
600 109 Pablo Alingery
</pre>
601 109 Pablo Alingery
602 109 Pablo Alingery
Overwriting the existing files in the right place (base/sums/libs/pg) & modif in jsoc_machine.csh 
603 109 Pablo Alingery
=> the command 'make' works well.
604 109 Pablo Alingery
605 109 Pablo Alingery
But there is still problem with 'make sums'
606 109 Pablo Alingery
607 109 Pablo Alingery
h3. Workaround to solve make sums problem
608 109 Pablo Alingery
609 109 Pablo Alingery
Modify [[sum_rpc.h]] in order to match the type of some variables
610 109 Pablo Alingery
611 240 Pablo Alingery
h3. Copier /usr/local/netdrms_2.4_release/base/drms/apps/serverdefs.h dans /usr/local/netdrms_current/base/drms/apps (not applied in NetDrms_8.10 and NetDrms8.11)
612 235 Pablo Alingery
613 239 Pablo Alingery
h3. Modification du fichier /usr/local/netdrms_current/configure (not applied in NetDrms_8.10 and NetDrms8.11 )
614 1 Herve Ballans
615 1 Herve Ballans
au lieu de $? en csh on va mettre plutot $status
616 1 Herve Ballans
617 61 Herve Ballans
ligne 110 :
618 61 Herve Ballans
619 61 Herve Ballans
<pre>
620 61 Herve Ballans
  if ($status==0) 
621 61 Herve Ballans
</pre>
622 117 Pablo Alingery
623 112 Herve Ballans
et ligne 123 :
624 115 Pablo Alingery
625 115 Pablo Alingery
<pre>
626 115 Pablo Alingery
  if ($status==0) 
627 116 Pablo Alingery
</pre>
628 116 Pablo Alingery
629 243 Pablo Alingery
630 243 Pablo Alingery
631 243 Pablo Alingery
%{color:red}------------------------------------------------------------------------------------------------------------------%
632 115 Pablo Alingery
633 115 Pablo Alingery
h3. #H4ck 2 Malade #PabloR0cks# (Not Applied in NetDrm_8.10)
634 112 Herve Ballans
635 119 Pablo Alingery
Modification du fichier /usr/include/stdint.h
636 112 Herve Ballans
637 112 Herve Ballans
ligne 55 : long int remplacé par long long int
638 112 Herve Ballans
639 112 Herve Ballans
<pre>
640 113 Pablo Alingery
#if __WORDSIZE == 64
641 113 Pablo Alingery
typedef unsigned long int       uint64_t; --> ici long long int
642 113 Pablo Alingery
#else
643 113 Pablo Alingery
__extension__
644 113 Pablo Alingery
typedef unsigned long long int  uint64_t;
645 113 Pablo Alingery
#endif
646 113 Pablo Alingery
</pre>
647 113 Pablo Alingery
648 113 Pablo Alingery
"Allo Linus ?!?.."
649 113 Pablo Alingery
650 113 Pablo Alingery
h3. Compilation
651 113 Pablo Alingery
652 113 Pablo Alingery
<pre>
653 113 Pablo Alingery
# make
654 113 Pablo Alingery
# make sums
655 113 Pablo Alingery
# make jsoc_fetch
656 113 Pablo Alingery
</pre>
657 113 Pablo Alingery
658 113 Pablo Alingery
NB : lib64 does not exist on debian 8. so ln -s /usr/lib lib64
659 113 Pablo Alingery
660 113 Pablo Alingery
h2. make sums KO  (Not applied in NetDrms_8.10)
661 113 Pablo Alingery
662 113 Pablo Alingery
Solution found : Take old lib libcrypto instead libssl
663 113 Pablo Alingery
664 113 Pablo Alingery
dans le fichier base/sums/apps/Rules.mk ligne 51 
665 112 Herve Ballans
replace -lssl by -lcrypto LD flag
666 112 Herve Ballans
667 112 Herve Ballans
h2. NetDRMS replication
668 112 Herve Ballans
669 1 Herve Ballans
<pre>
670 120 Pablo Alingery
# cd base/drms/replication/etc
671 1 Herve Ballans
# scp production@sdo:/usr/local/netdrms/install-config-files/ias.subscribe_list.cfg  .
672 112 Herve Ballans
# scp production@sdo:/usr/local/netdrms/install-config-files/ias.repclient.cfg  .
673 120 Pablo Alingery
WRONG !!!!!
674 112 Herve Ballans
To be done cp repclient.template.cfg into ias.subscribe_list.cfg because new field in config file can't appear 
675 112 Herve Ballans
Correct that step in NetDrms doc 
676 112 Herve Ballans
The existing ias.repclient.cfg can be used tough to fill params 
677 112 Herve Ballans
678 112 Herve Ballans
679 112 Herve Ballans
</pre>
680 112 Herve Ballans
681 112 Herve Ballans
682 112 Herve Ballans
Create tmp dir in netdrms working directory (/usr/local/netdrms_current)
683 112 Herve Ballans
<pre>
684 112 Herve Ballans
# mkdir tmp
685 112 Herve Ballans
</pre>
686 112 Herve Ballans
687 112 Herve Ballans
Prevent from deleting files
688 112 Herve Ballans
<pre>
689 112 Herve Ballans
cd logs/SUM ; scp production@sdo:/usr/local/netdrms/install-config-files/sum_rm.cfg .
690 91 Herve Ballans
</pre>
691 91 Herve Ballans
692 91 Herve Ballans
h2. NetDRMS Start script
693 91 Herve Ballans
694 91 Herve Ballans
<pre>
695 91 Herve Ballans
sum_start.NetDRMS
696 91 Herve Ballans
</pre>
697 91 Herve Ballans
698 91 Herve Ballans
h2. Database repair (from Art)
699 91 Herve Ballans
700 91 Herve Ballans
On ias_sdo
701 91 Herve Ballans
702 91 Herve Ballans
<pre>
703 91 Herve Ballans
delete from admin.ns where name = 'lm_jps';
704 91 Herve Ballans
delete from admin.ns where name = 'aia_test';
705 91 Herve Ballans
</pre>
706 93 Pablo Alingery
707 93 Pablo Alingery
h2. Private key Public key generation 
708 93 Pablo Alingery
709 93 Pablo Alingery
<pre>
710 93 Pablo Alingery
ssh-keygen -t rsa
711 93 Pablo Alingery
</pre>
712 103 Herve Ballans
713 103 Herve Ballans
Not necessary cause we recover the ssh keys of the current server.
714 103 Herve Ballans
715 103 Herve Ballans
However, we have to retrieve the private key of production account on sdo3
716 103 Herve Ballans
717 103 Herve Ballans
From sdo :
718 103 Herve Ballans
<pre>
719 103 Herve Ballans
rsync -av id_rsa production@sdo3:/home/production/.ssh/
720 103 Herve Ballans
</pre>
721 94 Herve Ballans
722 94 Herve Ballans
h2. Node definition
723 94 Herve Ballans
724 94 Herve Ballans
file : /usr/local/netdrms_current/base/drms/replication/etc/ias.repclient.cfg
725 94 Herve Ballans
726 94 Herve Ballans
<pre>
727 1 Herve Ballans
node=IAStest
728 96 Herve Ballans
</pre>
729 96 Herve Ballans
730 96 Herve Ballans
h2. show_series and delete_series binaries
731 96 Herve Ballans
732 97 Pablo Alingery
Remark : these 2 sources are not compiled during installation
733 96 Herve Ballans
Issue : in netdrms_current 8.10 , do :
734 96 Herve Ballans
$ make delete_series
735 94 Herve Ballans
$ make show_series
736 98 Pablo Alingery
737 1 Herve Ballans
h2. SSH-HPN install 
738 98 Pablo Alingery
739 1 Herve Ballans
Intallation de openssh 6.3p1 car le dernier patch hpn dispo est 6.3hpn13.V6 
740 99 Herve Ballans
741 99 Herve Ballans
web site for open ssh : http://ftp2.fr.openbsd.org/pub/OpenBSD/OpenSSH/portable/openssh-6.3p1.tar.gz
742 1 Herve Ballans
patch hpn : http://www.psc.edu/index.php/hpn-ssh-patches/hpn-14-kitchen-sink-patches/viewdownload/24-hpn-14-kitchen-sink-patches/102-openssh-6-3p1-hpnssh14v2-kitchen-sink-patch
743 99 Herve Ballans
744 99 Herve Ballans
<pre>
745 99 Herve Ballans
# tar -xzvf openssh-6.3p1.tar.gz
746 99 Herve Ballans
# gunzip openssh-6.3p1-hpnssh14v2.diff.gz
747 99 Herve Ballans
# cd openssh-6.3p1
748 99 Herve Ballans
# zcat ../openssh-6.3p1-hpnssh14v2.diff.gz | patch -p1
749 99 Herve Ballans
# ./configure --prefix=/usr/local/hpn-ssh --with-pam --with-md5-passwords --without-zlib-version-check --with-tcp-wrappers
750 99 Herve Ballans
# make
751 99 Herve Ballans
# make install
752 1 Herve Ballans
</pre>
753 99 Herve Ballans
754 99 Herve Ballans
Depuis sdo :
755 99 Herve Ballans
<pre>
756 99 Herve Ballans
# cd /usr/local/hpn-ssh/etc/
757 99 Herve Ballans
# rsync -av *key* netadm@sdo3:/home/netadm/
758 99 Herve Ballans
</pre>
759 99 Herve Ballans
760 99 Herve Ballans
Sur sdo3 :
761 1 Herve Ballans
<pre>
762 100 Herve Ballans
rsync -av /home/netadm/*key* /usr/local/hpn-ssh/etc/
763 100 Herve Ballans
</pre>
764 100 Herve Ballans
765 100 Herve Ballans
We have to configure the port number to 55000
766 100 Herve Ballans
<pre>
767 100 Herve Ballans
# vi ssh_config
768 100 Herve Ballans
</pre>
769 101 Herve Ballans
770 100 Herve Ballans
and add :
771 100 Herve Ballans
<pre>
772 100 Herve Ballans
#Port 22
773 100 Herve Ballans
Port 55000
774 1 Herve Ballans
</pre>
775 101 Herve Ballans
776 100 Herve Ballans
We configure also the server hpn (even we don't use it yet)
777 100 Herve Ballans
<pre>
778 100 Herve Ballans
# vi sshd_config
779 100 Herve Ballans
</pre>
780 100 Herve Ballans
781 100 Herve Ballans
and add :
782 100 Herve Ballans
<pre>
783 100 Herve Ballans
#Port 22
784 100 Herve Ballans
Port 55000
785 100 Herve Ballans
786 100 Herve Ballans
#PidFile /var/run/sshd.pid
787 100 Herve Ballans
PidFile /var/run/sshd.55000.pid
788 100 Herve Ballans
789 100 Herve Ballans
# allow the use of the none cipher
790 100 Herve Ballans
#NoneEnabled no
791 99 Herve Ballans
NoneEnabled yes
792 98 Pablo Alingery
</pre>
793 106 Pablo Alingery
794 105 Pablo Alingery
h2. Correction
795 105 Pablo Alingery
796 105 Pablo Alingery
h3. Modification du fichier ias.repclient.cfg
797 105 Pablo Alingery
798 105 Pablo Alingery
Copier le template existant repclient.template.cfg dans le répertoire [netdrms_current]/base/drms/replication/etc
799 105 Pablo Alingery
 
800 105 Pablo Alingery
<pre>
801 105 Pablo Alingery
production@sdo3:/usr/local/netdrms_current/base/drms/replication/etc$ cp repclient.template.cfg ias.repclient.cfg
802 105 Pablo Alingery
</pre>
803 1 Herve Ballans
804 106 Pablo Alingery
Nouveau / netdrms2.4 
805 105 Pablo Alingery
<pre>
806 105 Pablo Alingery
# Apps
807 106 Pablo Alingery
kRSPerl=<path to Perl binary to use when Perl scripts are executed>
808 105 Pablo Alingery
</pre>
809 107 Pablo Alingery
810 107 Pablo Alingery
h2. Subscription test 
811 107 Pablo Alingery
812 107 Pablo Alingery
h3. Librairies manquantes
813 107 Pablo Alingery
814 107 Pablo Alingery
Errors 
815 107 Pablo Alingery
<pre>
816 107 Pablo Alingery
Failure to apply SQL file 'IAStest.subscribe_series.sql' from server: ABORTING!
817 107 Pablo Alingery
Can't locate DBI.pm 
818 107 Pablo Alingery
.
819 107 Pablo Alingery
.
820 107 Pablo Alingery
.
821 107 Pablo Alingery
Failure to apply SQL file 'IAStest.subscribe_series.sql' from server: ABORTING!
822 107 Pablo Alingery
Can't locate DBD/Pg.pm
823 107 Pablo Alingery
</pre>
824 1 Herve Ballans
825 1 Herve Ballans
<pre>
826 1 Herve Ballans
root@sdo3:/usr/local/netdrms_8.10/base/drms/replication/subscribe_series# apt-get install libdbi-perl 
827 1 Herve Ballans
root@sdo3:/usr/local/netdrms_8.10/base/drms/replication/subscribe_series# apt-get install libdbd-pg-perl
828 1 Herve Ballans
</pre>
829 110 Herve Ballans
830 110 Herve Ballans
h3. Series souscrites
831 110 Herve Ballans
832 110 Herve Ballans
hmi.sharp_720s_nrt
833 110 Herve Ballans
hmi.mharp_720s_nrt
834 110 Herve Ballans
hmi.bharp_720s_nrt
835 110 Herve Ballans
836 110 Herve Ballans
<pre>
837 110 Herve Ballans
production@sdo3:~$ show_info -s hmi.sharp_720s_nrt
838 110 Herve Ballans
First Record: hmi.sharp_720s_nrt[476][2012.09.14_02:12:00_TAI], Recnum = 829707
839 110 Herve Ballans
Last Record:  hmi.sharp_720s_nrt[4943][2016.03.22_18:24:00_TAI], Recnum = 2015202
840 110 Herve Ballans
Last Recnum:  2015202
841 110 Herve Ballans
Has shadow table: no
842 107 Pablo Alingery
</pre>
843 111 Herve Ballans
844 111 Herve Ballans
h3. Lancement de jetty
845 111 Herve Ballans
846 111 Herve Ballans
<pre>
847 111 Herve Ballans
$ jetty.sh start
848 111 Herve Ballans
</pre>
849 111 Herve Ballans
850 111 Herve Ballans
851 111 Herve Ballans
852 108 Pablo Alingery
853 108 Pablo Alingery
h2. Test recuperation de meta data 
854 108 Pablo Alingery
855 108 Pablo Alingery
librairies manquantes 
856 108 Pablo Alingery
apt-get install libnet-ssh-perl
857 108 Pablo Alingery
apt-get install libstring-shellquote-perl
858 108 Pablo Alingery
859 152 Pablo Alingery
h2. TO BE DONE FURTHER
860 108 Pablo Alingery
861 107 Pablo Alingery
862 152 Pablo Alingery
%{color:red} configure sytem nbr de fichier ouvert en meme temps%
863 1 Herve Ballans
864 152 Pablo Alingery
%{color:red} configure sytem taille  buffer%
865 152 Pablo Alingery
866 155 Pablo Alingery
%{color:red} swap désactivé ? discussion Stephane et Gilles%
867 152 Pablo Alingery
868 80 Pablo Alingery
869 1 Herve Ballans
h3. Modification du fichir config.local pour la souscription au jsoc
870 1 Herve Ballans
871 1 Herve Ballans
872 1 Herve Ballans
<pre>
873 1 Herve Ballans
# NetDRMS users can request subdirectories from the Stanford proj directories 
874 1 Herve Ballans
# (e.g., JSOC/proj/util). These users will need to contact Stanford and obtain
875 1 Herve Ballans
# the source subdirectories desired. They will then place these subdirectories
876 1 Herve Ballans
# in the JSOC/proj directory of their NetDRMS release. To properly build 
877 1 Herve Ballans
# targets in these subdirectories, using the JSOC make system, the user needs
878 1 Herve Ballans
# to add entries to this configuration file - one entry for each subdirectory
879 1 Herve Ballans
# that contains source code to be compiled. Each entry is a space-separated pair
880 1 Herve Ballans
# of strings: the string "PROJDIR" followed by a subdirectory (of the proj 
881 1 Herve Ballans
# directory).  For example:
882 1 Herve Ballans
#
883 1 Herve Ballans
# PROJDIR     util/apps
884 1 Herve Ballans
# PROJDIR     util/libs
885 1 Herve Ballans
# 
886 1 Herve Ballans
# NOTE: It is not sufficient to list only a parent directory, like util. Source code
887 18 Herve Ballans
# in child directories will not automatically be compiled.
888 18 Herve Ballans
</pre>
889 18 Herve Ballans
890 18 Herve Ballans
h3. Python library for multi-threaded SUMS
891 1 Herve Ballans
892 1 Herve Ballans
Installation de la librairie python3.4m