Project

General

Profile

NetDRMS Installation » History » Version 362

Pablo Alingery, 29/03/2017 16:00

1 50 Herve Ballans
{{toc}}
2 1 Herve Ballans
3 351 Pablo Alingery
h1. NetDRMS 8.12 Installation
4 1 Herve Ballans
5 276 Herve Ballans
h2. Preliminary note
6 275 Herve Ballans
7 275 Herve Ballans
In the following sections, when there is a command line :
8 324 Herve Ballans
<pre>#</pre>means that command is executed into _root_ user
9 324 Herve Ballans
<pre>$</pre>means that command is executed into _production_ user
10 275 Herve Ballans
11 333 Herve Ballans
h2. Environment
12 333 Herve Ballans
13 343 Herve Ballans
Server : DELL PowerEdge R730
14 343 Herve Ballans
RAM : 64.00GB
15 343 Herve Ballans
CPU : 32 CPUs Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
16 345 Herve Ballans
17 345 Herve Ballans
Storage Configuration :
18 344 Herve Ballans
* 264 GB mounted in / (2 X 278.88 GB SAS 12G disks in RAID1)
19 344 Herve Ballans
* 1,7 TB mounted in /var/lib/postgresql (7 X 278.88 GB SAS 12G disks in RAID5 configuration)
20 344 Herve Ballans
* 1 global spare for both RAID
21 344 Herve Ballans
* DDP storage mounted in /SUM*
22 343 Herve Ballans
23 343 Herve Ballans
Guest OS : Debian 8.4
24 343 Herve Ballans
Kernel : Linux sdo-new 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt25-1 (2016-03-06) x86_64 GNU/Linux
25 343 Herve Ballans
26 1 Herve Ballans
h2. Requirements
27 1 Herve Ballans
28 47 Pablo Alingery
h3. Configuring production environment
29 1 Herve Ballans
30 284 Herve Ballans
Adding user production
31 47 Pablo Alingery
32 1 Herve Ballans
<pre>
33 1 Herve Ballans
# adduser production
34 1 Herve Ballans
# addgroup ias
35 1 Herve Ballans
# adduser production ias
36 1 Herve Ballans
</pre>
37 1 Herve Ballans
38 49 Herve Ballans
h3. Configure /home/production/.profile
39 1 Herve Ballans
40 49 Herve Ballans
Adding environment variables
41 1 Herve Ballans
42 1 Herve Ballans
<pre>
43 122 Herve Ballans
#Modif Herve.B Pablo.A 12/05/2016
44 122 Herve Ballans
45 1 Herve Ballans
PATH="/usr/local/netdrms_current/bin/linux_x86_64:$PATH"
46 49 Herve Ballans
PATH="/usr/local/netdrms_current/scripts:$PATH"
47 122 Herve Ballans
PATH="/usr/local/jmd/bin:$PATH"
48 122 Herve Ballans
PATH="/usr/local/jmd/scripts:$PATH"
49 141 Pablo Alingery
#The following is not needed as installed with 'apt-get install' 
50 141 Pablo Alingery
#PATH="/usr/local/pgsql/bin:$PATH"
51 122 Herve Ballans
PATH="/usr/local/netdrms-tools/scripts:$PATH"
52 49 Herve Ballans
#2014-12-17 Avec Herve et Pablo on pense que la ligne suivante est intutile as it is f.. install in /usr/local/lib
53 140 Pablo Alingery
PATH="/usr/local/cfitsio:$PATH"
54 1 Herve Ballans
#Done
55 49 Herve Ballans
56 122 Herve Ballans
DERBY_HOME=/usr/local/jmd/databases/derby/derbyBD
57 49 Herve Ballans
export DERBY_HOME
58 49 Herve Ballans
59 49 Herve Ballans
export CVSROOT=:pserver:anonymous@solarch.tuc.noao.edu:2401/vtarc1/vso/cvsroot
60 49 Herve Ballans
</pre>
61 49 Herve Ballans
62 162 Pablo Alingery
h3. Configure /varl/lib/postgres/.profile
63 161 Pablo Alingery
64 163 Pablo Alingery
Add to $PATH so postgres can exeute command like initdb
65 161 Pablo Alingery
66 161 Pablo Alingery
<pre>
67 161 Pablo Alingery
#Modif Herve.B Pablo.A 19/05/2016
68 161 Pablo Alingery
PATH="/usr/lib/postgresql/9.4/bin:$PATH"
69 161 Pablo Alingery
</pre>
70 161 Pablo Alingery
71 125 Pablo Alingery
h3. Setting privileges for SUMS_MANAGER
72 87 Herve Ballans
73 126 Pablo Alingery
Please modify file /etc/sudoers so user 'production' will be able to execute  'sum_chown' that we will locate in the dir : /usr/local/bin . See below
74 125 Pablo Alingery
Add to /etc/sudoers the following line :
75 1 Herve Ballans
	production host=NOPASSWD:/usr/local/bin/sum_chmown
76 1 Herve Ballans
77 127 Pablo Alingery
h3. Set passwords file for db postgres 
78 1 Herve Ballans
79 127 Pablo Alingery
Please create file .pgpass with the following information for user 'production" so he will be able to connect without password as 'production' or 'postgres' to 2 db that we will create later ias_sdo and ias_sdo_sums.
80 1 Herve Ballans
81 1 Herve Ballans
82 1 Herve Ballans
.pgpass content :
83 1 Herve Ballans
<pre>
84 128 Pablo Alingery
	#hostname:5432:ias_sdo:production: 
85 128 Pablo Alingery
	#hostname:5434:ias_sdo_sums:production: 
86 128 Pablo Alingery
	#hostname:5432:ias_sdo:postgres: 
87 128 Pablo Alingery
	#hostname:5434:ias_sdo_sums:postgres
88 1 Herve Ballans
</pre>
89 128 Pablo Alingery
90 129 Pablo Alingery
where #hostname is the name of your server
91 129 Pablo Alingery
92 129 Pablo Alingery
93 131 Pablo Alingery
%{color:red}WARNING : change hostname when migrate sdo-new to sdo%
94 1 Herve Ballans
95 133 Pablo Alingery
h3. Install missing libraries 
96 1 Herve Ballans
97 293 Herve Ballans
* libreadline-dev (but already installed with postgresql)
98 293 Herve Ballans
* libssl-dev 
99 293 Herve Ballans
* libpam0g-dev 
100 293 Herve Ballans
* libperl-dev 
101 293 Herve Ballans
* libnet-ssh-perl
102 293 Herve Ballans
* libstring-shellquote-perl
103 296 Herve Ballans
* libdbi-perl 
104 296 Herve Ballans
* libdbd-pg-perl
105 1 Herve Ballans
106 133 Pablo Alingery
NB : Already done in Debian 8.4 Jessy
107 1 Herve Ballans
<pre>
108 1 Herve Ballans
# apt-get install $library_name
109 1 Herve Ballans
</pre> 
110 1 Herve Ballans
where
111 1 Herve Ballans
	_$library_name_ is the name of library
112 19 Pablo Alingery
113 1 Herve Ballans
Then to update path on libraries, please type :
114 1 Herve Ballans
<pre>
115 19 Pablo Alingery
# ldconfig
116 1 Herve Ballans
</pre>
117 1 Herve Ballans
118 1 Herve Ballans
h3. Reconfigure locale
119 1 Herve Ballans
120 1 Herve Ballans
<pre>
121 1 Herve Ballans
# dpkg-reconfigure locales
122 1 Herve Ballans
</pre>
123 1 Herve Ballans
124 1 Herve Ballans
select fr_FR.UTF8 UTF8 and unselect en_US.UTF-8
125 1 Herve Ballans
126 1 Herve Ballans
localedef -i en_US -f UTF-8 en_US.UTF-8
127 1 Herve Ballans
128 1 Herve Ballans
(see here : [[http://www.thomas-krenn.com/en/wiki/Perl_warning_Setting_locale_failed_in_Debian]])
129 1 Herve Ballans
130 134 Pablo Alingery
h3. Install gfortran packages
131 1 Herve Ballans
132 1 Herve Ballans
<pre>
133 1 Herve Ballans
# apt-get install gfortran swig
134 1 Herve Ballans
</pre>
135 1 Herve Ballans
136 1 Herve Ballans
h3. Installation of cfitsio library
137 1 Herve Ballans
138 135 Pablo Alingery
In /usr/local dir
139 135 Pablo Alingery
140 135 Pablo Alingery
Version 3.39 (currently on sdo : 3.24)
141 1 Herve Ballans
<pre>
142 135 Pablo Alingery
# wget ftp://heasarc.gsfc.nasa.gov/software/fitsio/c/cfitsio3390.tar.gz
143 1 Herve Ballans
</pre>
144 137 Pablo Alingery
Untar and  decompression
145 1 Herve Ballans
<pre>
146 136 Pablo Alingery
# tar -xzvf cfitsio3390.tar.gz
147 1 Herve Ballans
</pre> 
148 1 Herve Ballans
149 139 Pablo Alingery
Go into /usr/local and type
150 1 Herve Ballans
151 1 Herve Ballans
su - root and :
152 1 Herve Ballans
<pre>
153 1 Herve Ballans
# ./configure --prefix=/usr/local
154 1 Herve Ballans
# make 
155 1 Herve Ballans
# make install
156 135 Pablo Alingery
</pre>
157 118 Pablo Alingery
158 237 Herve Ballans
h3. Installation des libraries libtar-dev, libcurl3-dev et libecpg-dev
159 237 Herve Ballans
160 237 Herve Ballans
<pre>
161 237 Herve Ballans
apt-get install libtar libtar-dev
162 237 Herve Ballans
</pre>
163 237 Herve Ballans
164 238 Pablo Alingery
Note, selecting 'libcurl4-openssl-dev' instead of 'libcurl3-dev'
165 238 Pablo Alingery
libcurl4-openssl-dev is already the newest version
166 237 Herve Ballans
<pre>
167 237 Herve Ballans
apt-get install libcurl3-dev
168 237 Herve Ballans
</pre>
169 237 Herve Ballans
170 237 Herve Ballans
<pre>
171 237 Herve Ballans
apt-get install libecpg-dev
172 237 Herve Ballans
</pre>
173 237 Herve Ballans
174 144 Pablo Alingery
h3. Installation of apache2 and lib perl
175 118 Pablo Alingery
176 118 Pablo Alingery
<pre>
177 118 Pablo Alingery
# apt-get install apache2
178 118 Pablo Alingery
179 118 Pablo Alingery
# apt-get install libjson-perl
180 118 Pablo Alingery
181 118 Pablo Alingery
# apt-get install libapache2-mod-perl2
182 118 Pablo Alingery
</pre>
183 1 Herve Ballans
184 183 Herve Ballans
h3. Installation of postgresql
185 1 Herve Ballans
186 145 Pablo Alingery
Into 'root'
187 145 Pablo Alingery
 
188 145 Pablo Alingery
<pre>
189 147 Pablo Alingery
apt-get install postgresql-9.4 postgresql-client-9.4 
190 145 Pablo Alingery
</pre>
191 145 Pablo Alingery
192 213 Herve Ballans
h3. Installation of python3
193 209 Pablo Alingery
194 209 Pablo Alingery
Into 'root'
195 209 Pablo Alingery
 
196 209 Pablo Alingery
<pre>
197 209 Pablo Alingery
apt-get install python3 
198 1 Herve Ballans
</pre>
199 210 Pablo Alingery
200 211 Pablo Alingery
Add some modules psycopg2 (postgres connector) and pySmartDL (Download manager) 
201 210 Pablo Alingery
202 210 Pablo Alingery
<pre>
203 210 Pablo Alingery
apt-get install python3-psycopg2
204 210 Pablo Alingery
</pre>
205 210 Pablo Alingery
206 210 Pablo Alingery
Add python3-pip for modules within python3
207 210 Pablo Alingery
208 210 Pablo Alingery
<pre>
209 210 Pablo Alingery
apt-get install python3-pip
210 1 Herve Ballans
</pre>
211 212 Pablo Alingery
212 212 Pablo Alingery
<pre>
213 212 Pablo Alingery
pip3 install pySmartDL
214 212 Pablo Alingery
</pre>
215 1 Herve Ballans
216 213 Herve Ballans
Both python2.7 and 3.4 versions are installed on the system.
217 213 Herve Ballans
By default, the python2.7 is used.
218 213 Herve Ballans
In order to change in 3.4 by default, type :
219 213 Herve Ballans
<pre>
220 213 Herve Ballans
update-alternatives --config python
221 213 Herve Ballans
</pre>
222 209 Pablo Alingery
223 1 Herve Ballans
h3. Installation of sdo_scripts
224 218 Pablo Alingery
225 219 Pablo Alingery
Install monitoring scripts for sdo
226 218 Pablo Alingery
227 218 Pablo Alingery
<pre>
228 268 Pablo Alingery
rsync -av scripts production@sdo-new:/home/production/netdrms-tools/
229 218 Pablo Alingery
</pre>
230 218 Pablo Alingery
231 349 Herve Ballans
h3. lib64 symbolic link 
232 349 Herve Ballans
233 349 Herve Ballans
Creating lib64 link (lib64 does not exist on debian 8)
234 349 Herve Ballans
<pre>
235 349 Herve Ballans
# cd /usr
236 349 Herve Ballans
# ln -s lib/ lib64
237 349 Herve Ballans
</pre>
238 349 Herve Ballans
239 349 Herve Ballans
240 1 Herve Ballans
h2. NetDRMS databases
241 1 Herve Ballans
242 156 Pablo Alingery
into /var/lib/postgresql  (hard mount point separated,  7 disks 15000 tr/min in raid5 in order to distribute read and write) 
243 1 Herve Ballans
244 1 Herve Ballans
<pre>
245 158 Pablo Alingery
# cd /var/lib/postgresql
246 157 Pablo Alingery
# mkdir data  data_sums data_monitor
247 157 Pablo Alingery
# chown -R postgres:postgres * 
248 1 Herve Ballans
</pre>
249 1 Herve Ballans
250 160 Pablo Alingery
h3. Initialize 3 servers data,  data_sums, data_monitor
251 1 Herve Ballans
252 159 Pablo Alingery
Into postgres
253 1 Herve Ballans
<pre>
254 1 Herve Ballans
# su - postgres
255 1 Herve Ballans
256 1 Herve Ballans
$ initdb --locale=C -D data -A md5 -W
257 1 Herve Ballans
(no password)
258 2 Herve Ballans
259 2 Herve Ballans
Success. You can now start the database server using:
260 2 Herve Ballans
261 2 Herve Ballans
    postgres -D data
262 2 Herve Ballans
or
263 2 Herve Ballans
    pg_ctl -D data -l logfile start
264 2 Herve Ballans
265 1 Herve Ballans
266 1 Herve Ballans
$ initdb --locale=C -D data_sums -A md5 -W
267 2 Herve Ballans
(no password)
268 2 Herve Ballans
269 2 Herve Ballans
Success. You can now start the database server using:
270 2 Herve Ballans
271 2 Herve Ballans
    postgres -D data_sums
272 2 Herve Ballans
or
273 2 Herve Ballans
    pg_ctl -D data_sums -l logfile start
274 8 Pablo Alingery
275 8 Pablo Alingery
$ initdb --locale=C -D data_monitor -A md5 -W
276 8 Pablo Alingery
(no password)
277 8 Pablo Alingery
278 8 Pablo Alingery
Success. You can now start the database server using:
279 8 Pablo Alingery
280 8 Pablo Alingery
    postgres -D data_monitor
281 8 Pablo Alingery
or
282 8 Pablo Alingery
    pg_ctl -D data_monitor -l logfile start
283 2 Herve Ballans
</pre>
284 2 Herve Ballans
285 1 Herve Ballans
286 1 Herve Ballans
287 1 Herve Ballans
Edition des fichiers postgresql.conf pour configurer les bons ports d'écoute :
288 1 Herve Ballans
listen_addresses = '*'
289 1 Herve Ballans
data -> port 5432
290 10 Pablo Alingery
data_sums -> port 5434
291 1 Herve Ballans
data_monitor -> port 5436
292 10 Pablo Alingery
293 165 Pablo Alingery
Edit files data*/pg_hba.conf : replace 'md5' by 'trust'
294 1 Herve Ballans
<pre>
295 1 Herve Ballans
#"local"
296 1 Herve Ballans
local   all             all                                     trust
297 1 Herve Ballans
#"IPv4"
298 1 Herve Ballans
host   all             all                                     trust
299 1 Herve Ballans
</pre>
300 166 Pablo Alingery
301 166 Pablo Alingery
h3. Tunning postgres 
302 166 Pablo Alingery
303 166 Pablo Alingery
In file postgres.conf ( according to https://www.qwant.com/?q=Tunning+postgres+server+9.4+&client=firefox  )
304 166 Pablo Alingery
305 168 Pablo Alingery
shared_buffer=4096MB %{color:red}So 1/12 of the total RAM memory available%
306 1 Herve Ballans
307 169 Pablo Alingery
work_mem = 24MB
308 168 Pablo Alingery
309 168 Pablo Alingery
maintenance_work_mem = 4096MB
310 1 Herve Ballans
311 169 Pablo Alingery
wal_buffers = 16MB
312 169 Pablo Alingery
313 169 Pablo Alingery
checkpoint_segments = 32
314 169 Pablo Alingery
315 169 Pablo Alingery
checkpoint_completion_target = 0.9
316 169 Pablo Alingery
317 169 Pablo Alingery
random_page_cost = 1.0
318 169 Pablo Alingery
319 169 Pablo Alingery
effective_cache_size = 16384MB so 1/4 of the max memory 
320 169 Pablo Alingery
321 170 Pablo Alingery
322 170 Pablo Alingery
323 170 Pablo Alingery
#log
324 169 Pablo Alingery
logging_collector = on 
325 169 Pablo Alingery
log_directory = 'pg_log' 
326 169 Pablo Alingery
log_filename = 'postgresql-%Y-%m-%d_%H%M%S.log' # log file name pattern,
327 169 Pablo Alingery
log_truncate_on_rotation = on           # If on, an existing log file with the
328 169 Pablo Alingery
log_rotation_age = 1d                   # Automatic rotation of logfiles will
329 170 Pablo Alingery
client_min_messages = error
330 170 Pablo Alingery
log_min_messages = error 
331 170 Pablo Alingery
log_min_duration_statement = 0
332 170 Pablo Alingery
333 170 Pablo Alingery
log_connections = on
334 170 Pablo Alingery
log_disconnections = on
335 170 Pablo Alingery
log_duration = off
336 170 Pablo Alingery
log_hostname = on
337 170 Pablo Alingery
log_line_prefix = '%t [%p]: %u@%h - %d :'  
338 170 Pablo Alingery
339 170 Pablo Alingery
track_counts = on
340 170 Pablo Alingery
autovacuum = on 
341 170 Pablo Alingery
342 170 Pablo Alingery
extra_float_digits = 3
343 170 Pablo Alingery
344 177 Pablo Alingery
h3. Start the 3 databases :
345 1 Herve Ballans
346 1 Herve Ballans
<pre>
347 1 Herve Ballans
# su - postgres
348 196 Herve Ballans
$ cd /var/lib/postgresql
349 172 Pablo Alingery
$ pg_ctl -D data  start
350 172 Pablo Alingery
$ pg_ctl -D data_sums start
351 172 Pablo Alingery
$ pg_ctl -D data_monitor start
352 1 Herve Ballans
</pre>
353 174 Pablo Alingery
354 1 Herve Ballans
h3. Create the 3 databases :
355 181 Pablo Alingery
356 178 Pablo Alingery
Into user 'postgres'
357 1 Herve Ballans
358 179 Pablo Alingery
* createdb --locale C -E LATIN1 -T template0 ias_sdo
359 179 Pablo Alingery
* createdb --locale C -E LATIN1 -T template0 -p 5434 ias_sdo_sums
360 179 Pablo Alingery
* createdb --locale C -E LATIN1 -T template0 -p 5436 ias_sdo_monitor
361 54 Herve Ballans
362 182 Herve Ballans
h3. Automatic startup
363 182 Herve Ballans
364 182 Herve Ballans
Add following lines in the /etc/rc.local file :
365 182 Herve Ballans
366 182 Herve Ballans
<pre>
367 197 Herve Ballans
su -l -c "/usr/lib/postgresql/9.4/bin/pg_ctl -D /var/lib/postgresql/data start" postgres
368 197 Herve Ballans
su -l -c "/usr/lib/postgresql/9.4/bin/pg_ctl -D /var/lib/postgresql/data_sums start" postgres
369 197 Herve Ballans
su -l -c "/usr/lib/postgresql/9.4/bin/pg_ctl -D /var/lib/postgresql/data_monitor start" postgres
370 182 Herve Ballans
</pre>
371 182 Herve Ballans
372 325 Pablo Alingery
h3. Install additional modules
373 327 Pablo Alingery
374 326 Pablo Alingery
We need dblink for triggers between db so let's install postgresql-contrib-9.4 
375 325 Pablo Alingery
376 325 Pablo Alingery
<pre>
377 326 Pablo Alingery
root@sdo-new:~# apt-get install postgresql-contrib-9.4
378 325 Pablo Alingery
</pre>
379 325 Pablo Alingery
380 328 Pablo Alingery
Create extension dblink for each db 
381 328 Pablo Alingery
ias_sdo
382 325 Pablo Alingery
<pre>
383 328 Pablo Alingery
root@sdo-new:$ psql ias_sdo -p5432 -U postgres
384 328 Pablo Alingery
psql (9.4.6)
385 325 Pablo Alingery
Type "help" for help.
386 1 Herve Ballans
387 328 Pablo Alingery
ias_sdo=# CREATE EXTENSION dblink ;
388 1 Herve Ballans
CREATE EXTENSION
389 328 Pablo Alingery
</pre>
390 1 Herve Ballans
391 328 Pablo Alingery
ias_sdo_sums 
392 328 Pablo Alingery
<pre>
393 328 Pablo Alingery
root@sdo-new:$ psql ias_sdo -p5434 -U postgres
394 328 Pablo Alingery
psql (9.4.6)
395 328 Pablo Alingery
Type "help" for help.
396 328 Pablo Alingery
397 328 Pablo Alingery
ias_sdo=# CREATE EXTENSION dblink ;
398 328 Pablo Alingery
CREATE EXTENSION
399 328 Pablo Alingery
</pre>
400 328 Pablo Alingery
401 328 Pablo Alingery
ias_sdo_monitor
402 328 Pablo Alingery
<pre>
403 328 Pablo Alingery
root@sdo-new:$ psql ias_sdo -p5436 -U postgres
404 328 Pablo Alingery
psql (9.4.6)
405 328 Pablo Alingery
Type "help" for help.
406 328 Pablo Alingery
407 328 Pablo Alingery
ias_sdo=# CREATE EXTENSION dblink ;
408 328 Pablo Alingery
CREATE EXTENSION
409 325 Pablo Alingery
</pre>
410 325 Pablo Alingery
411 330 Pablo Alingery
To check the list of installed extensions type :
412 330 Pablo Alingery
 <pre>
413 330 Pablo Alingery
ias_sdo=\dx
414 332 Herve Ballans
                                 List of installed extensions
415 332 Herve Ballans
  Name   | Version |   Schema   |                         Description                          
416 332 Herve Ballans
---------+---------+------------+--------------------------------------------------------------
417 332 Herve Ballans
 dblink  | 1.1     | public     | connect to other PostgreSQL databases from within a database
418 332 Herve Ballans
 plpgsql | 1.0     | pg_catalog | PL/pgSQL procedural language
419 332 Herve Ballans
(2 rows)
420 330 Pablo Alingery
421 330 Pablo Alingery
</pre>
422 332 Herve Ballans
423 332 Herve Ballans
424 325 Pablo Alingery
425 184 Herve Ballans
h2. System tuning
426 1 Herve Ballans
427 187 Herve Ballans
Current configuration :
428 185 Herve Ballans
<pre>
429 185 Herve Ballans
# sysctl -a
430 185 Herve Ballans
</pre>
431 1 Herve Ballans
432 187 Herve Ballans
In the following file :
433 185 Herve Ballans
<pre>
434 185 Herve Ballans
# vi /etc/sysctl.conf
435 185 Herve Ballans
</pre>
436 1 Herve Ballans
437 188 Herve Ballans
we change some values (default values are commented with '#')
438 194 Herve Ballans
439 195 Herve Ballans
(resources links [[Links|here]])
440 194 Herve Ballans
441 185 Herve Ballans
<pre>
442 191 Herve Ballans
# Semaphore is a object that is used to control utilization of a particular process.
443 191 Herve Ballans
# kernel.sem = SEMMSL SEMMNS SEMOPM SEMMNI
444 191 Herve Ballans
# SEMMSL        maximum number of semaphores per array  (min 128)
445 191 Herve Ballans
# SEMMNS        maximum semaphores system-wide  
446 191 Herve Ballans
# SEMOPM        maximum operations per semop call       
447 191 Herve Ballans
# SEMMNI        maximum arrays 
448 191 Herve Ballans
#semop incresed from 32 (default value)operation to 100 (3rd value )
449 191 Herve Ballans
# kernel.sem = 250      32000   32      128
450 191 Herve Ballans
kernel.sem = 250 32000 100 128
451 191 Herve Ballans
452 191 Herve Ballans
In order to  apply changes :#This sets the  OS receive buffer size for all types of connections (default value 212992)
453 191 Herve Ballans
#net.core.rmem_default = 212992
454 191 Herve Ballans
#net.core.rmem_max = 212992
455 191 Herve Ballans
net.core.rmem_default = 33554432
456 191 Herve Ballans
net.core.rmem_max = 33554432
457 191 Herve Ballans
458 191 Herve Ballans
#This is the OS send buffer size for all types of connections (212992 default value) 
459 191 Herve Ballans
#net.core.wmem_default = 212992
460 191 Herve Ballans
#net.core.wmem_max = 212992
461 191 Herve Ballans
net.core.wmem_default = 33554432
462 191 Herve Ballans
net.core.wmem_max = 33554432
463 191 Herve Ballans
464 193 Pablo Alingery
#TCP Autotuning setting. "The first value tells the kernel the minimum receive buffer for each TCP connection, and this buffer is always
465 193 Pablo Alingery
# allocated to a TCP socket, even under high pressure on the system. ... The second value specified tells the kernel the default receive
466 193 Pablo Alingery
# buffer allocated for each TCP socket. This value overrides the /proc/sys/net/core/rmem_default value used by other protocols. ...
467 192 Pablo Alingery
# The third and last value specified in this variable specifies the maximum receive buffer that can be allocated for a TCP socket."
468 1 Herve Ballans
#net.ipv4.tcp_rmem = 4096       87380   6291456
469 1 Herve Ballans
net.ipv4.tcp_rmem = 10240 87380 33554432
470 1 Herve Ballans
471 193 Pablo Alingery
#TCP Autotuning setting. "This variable takes 3 different values which holds information on how much TCP sendbuffer memory space
472 193 Pablo Alingery
# each TCP socket has to use. Every TCP socket has this much buffer space to use before the buffer is filled up. Each of the three 
473 193 Pablo Alingery
#values are used under different conditions. ... The first value in this variable tells the minimum TCP send buffer space available
474 193 Pablo Alingery
# for a single TCP socket. ... The second value in the variable tells us the default buffer space allowed for a single TCP socket to use. ... 
475 193 Pablo Alingery
#The third value tells the kernel the maximum TCP send buffer space." 
476 191 Herve Ballans
#net.ipv4.tcp_wmem = 4096       16384   4194304
477 191 Herve Ballans
net.ipv4.tcp_wmem = 10240 87380 33554432
478 191 Herve Ballans
479 191 Herve Ballans
#Disable cache metrics so the initial conditions of the closed connections will not be saved to be used in near future connections
480 191 Herve Ballans
#net.ipv4.tcp_no_metrics_save = 0
481 191 Herve Ballans
net.ipv4.tcp_no_metrics_save = 1
482 191 Herve Ballans
483 1 Herve Ballans
# Increase number of incoming connections backlog
484 1 Herve Ballans
# net.core.netdev_max_backlog = 1000
485 1 Herve Ballans
net.core.netdev_max_backlog = 5000
486 1 Herve Ballans
487 1 Herve Ballans
# The tcp_mem variable defines how the TCP stack should behave when it comes to memory usage. ... 
488 192 Pablo Alingery
#The first value specified in the tcp_mem variable tells the kernel the low threshold. 
489 192 Pablo Alingery
#Below this point, the TCP stack do not bother at all about putting any pressure on the memory usage by different TCP sockets. ... 
490 193 Pablo Alingery
#The second value tells the kernel at which point to start pressuring memory usage down. ... The final value tells the kernel how many
491 193 Pablo Alingery
# memory pages it may use maximally
492 1 Herve Ballans
# net.ipv4.tcp_mem = 1543347    2057796 3086694
493 191 Herve Ballans
net.ipv4.tcp_mem = 786432 1048576 26777216
494 191 Herve Ballans
495 192 Pablo Alingery
# local port range that is used by TCP and UDP traffic to choose the local port. You will see in the parameters of this file two numbers:
496 192 Pablo Alingery
# The first number is the first local port allowed for TCP and UDP traffic on the server, the second is the last local port number.
497 191 Herve Ballans
# net.ipv4.ip_local_port_range = 32768  61000
498 191 Herve Ballans
net.ipv4.ip_local_port_range = 1024 65535
499 191 Herve Ballans
500 191 Herve Ballans
# maximum number of sockets in TIME-WAIT to be held simultaneously.
501 191 Herve Ballans
# net.ipv4.tcp_max_tw_buckets = 262144
502 191 Herve Ballans
net.ipv4.tcp_max_tw_buckets = 360000
503 1 Herve Ballans
</pre>
504 185 Herve Ballans
505 191 Herve Ballans
Then we run the following command to make our change take effect:
506 191 Herve Ballans
507 185 Herve Ballans
<pre>
508 185 Herve Ballans
# sysctl -p
509 185 Herve Ballans
</pre>
510 176 Pablo Alingery
511 216 Pablo Alingery
h2. JMD Installation 
512 215 Herve Ballans
513 217 Pablo Alingery
Download new JMD package build by Niles Oien 2016-04-07 following thoses actions :
514 215 Herve Ballans
515 215 Herve Ballans
<pre>
516 215 Herve Ballans
cd /urs/local
517 215 Herve Ballans
518 215 Herve Ballans
[oien@spsc-nso19-12 ~]$ ftp gong2.nso.edu
519 215 Herve Ballans
Name (gong2.nso.edu:oien): anonymous
520 215 Herve Ballans
Password: <---------------- use your email as the password
521 215 Herve Ballans
ftp> cd outgoing/oien
522 215 Herve Ballans
ftp> get pablo_jmd.tar.gz
523 215 Herve Ballans
ftp> quit
524 215 Herve Ballans
</pre>
525 215 Herve Ballans
526 215 Herve Ballans
Install new JMD package following thoses actions 
527 215 Herve Ballans
528 215 Herve Ballans
<pre>
529 215 Herve Ballans
[oien@spsc-nso19-12 ~]$ gunzip -vf pablo_jmd.tar.gz
530 215 Herve Ballans
pablo_jmd.tar.gz:      8.3% -- replaced with pablo_jmd.tar
531 215 Herve Ballans
[oien@spsc-nso19-12 ~]$ tar xf pablo_jmd.tar
532 215 Herve Ballans
[oien@spsc-nso19-12 ~]$ cd pablo_jmd
533 338 Pablo Alingery
[oien@spsc-nso19-12 pablo_jmd]$ less README.txt
534 215 Herve Ballans
cd ..
535 215 Herve Ballans
mv jmd jmd_old
536 215 Herve Ballans
mv pablo_jmd jmd 
537 215 Herve Ballans
</pre>
538 215 Herve Ballans
539 340 Pablo Alingery
url provided by jsoc to download last JMD version http://vso.tuc.noao.edu/VSO/downloads/JMD
540 339 Pablo Alingery
541 266 Herve Ballans
h2. Apache Configuration for JMD
542 215 Herve Ballans
543 215 Herve Ballans
Configure webserver  to request jsoc_fetch
544 215 Herve Ballans
(following the mail from nilesoien@gmail.com)
545 215 Herve Ballans
546 222 Pablo Alingery
%{color:red}WARNING : change hostname when migrate sdo-new to sdo%
547 222 Pablo Alingery
548 220 Pablo Alingery
config d 'apache2 fichier sdo-new.ias.u-psud.fr 
549 215 Herve Ballans
<pre>
550 215 Herve Ballans
551 215 Herve Ballans
<VirtualHost *:80>
552 220 Pablo Alingery
        ServerName sdo-new.ias.u-psud.fr
553 215 Herve Ballans
        ServerAdmin pablo.alingery@ias.u-psud.fr
554 215 Herve Ballans
        #ErrorLog /var/log/apache2/error.log
555 215 Herve Ballans
        DocumentRoot /var/www
556 215 Herve Ballans
557 215 Herve Ballans
        # Possible values include: debug, info, notice, warn, error, crit,
558 215 Herve Ballans
        # alert, emerg.
559 215 Herve Ballans
        LogLevel debug
560 215 Herve Ballans
561 215 Herve Ballans
        #CustomLog /var/log/apache2/VSO/access.log combined
562 215 Herve Ballans
563 215 Herve Ballans
        Alias /VSO/DRMS/cgi-bin/ "/home/production/netdrms-tools/scripts/cgi-bin/"
564 215 Herve Ballans
565 215 Herve Ballans
        <Location /VSO/DRMS/cgi-bin>
566 215 Herve Ballans
                SetHandler perl-script
567 215 Herve Ballans
                PerlResponseHandler ModPerl::Registry
568 215 Herve Ballans
                PerlOptions +ParseHeaders
569 215 Herve Ballans
                Options +ExecCGI
570 215 Herve Ballans
                Order allow,deny
571 215 Herve Ballans
                Allow from all
572 215 Herve Ballans
        </Location>
573 215 Herve Ballans
</VirtualHost>
574 215 Herve Ballans
575 215 Herve Ballans
</pre>
576 215 Herve Ballans
577 223 Herve Ballans
Activate the new virtualhost and disable the default one :
578 223 Herve Ballans
<pre>
579 225 Herve Ballans
# a2ensite sdo-new.ias.u-psud.fr.conf
580 225 Herve Ballans
# a2dissite 000-default.conf
581 225 Herve Ballans
# service apache2 restart
582 225 Herve Ballans
</pre>
583 225 Herve Ballans
584 225 Herve Ballans
Allow symlink for the cgi scripts dierctory in apache2.conf :
585 225 Herve Ballans
<pre>
586 225 Herve Ballans
<Directory /home/production/netdrms-tools/scripts/>
587 225 Herve Ballans
        Options FollowSymLinks
588 225 Herve Ballans
        AllowOverride None
589 225 Herve Ballans
        Require all granted
590 225 Herve Ballans
</Directory>
591 225 Herve Ballans
</pre>
592 225 Herve Ballans
593 225 Herve Ballans
<pre>
594 225 Herve Ballans
# service apache2 restart
595 223 Herve Ballans
</pre>
596 223 Herve Ballans
 
597 226 Pablo Alingery
%{color:red}To be  added futher to test cgi%
598 1 Herve Ballans
Execution test cgi with URL :
599 226 Pablo Alingery
600 226 Pablo Alingery
make sure my $hostname=in the cgi file vso_jsoc_fetch.cgi is correct and test
601 224 Pablo Alingery
http://sdo-new.ias.u-psud.fr/VSO/DRMS/cgi-bin/vso_jsoc_fetch.cgi
602 215 Herve Ballans
603 215 Herve Ballans
expected result  :
604 215 Herve Ballans
<pre>
605 215 Herve Ballans
{
606 215 Herve Ballans
   "wait" : 0,
607 215 Herve Ballans
   "requestid" : "",
608 215 Herve Ballans
   "data" : {},
609 215 Herve Ballans
   "method" : "url_quick",
610 215 Herve Ballans
   "size" : 0,
611 215 Herve Ballans
   "errormsg" : "Empty query",
612 215 Herve Ballans
   "protocol" : "as-is",
613 215 Herve Ballans
   "status" : 1,
614 215 Herve Ballans
   "space_ratio" : 0.1,
615 215 Herve Ballans
   "load_ratio" : 0.066875,
616 215 Herve Ballans
   "dir" : "",
617 215 Herve Ballans
   "count" : 0
618 215 Herve Ballans
}
619 215 Herve Ballans
</pre>
620 215 Herve Ballans
621 267 Herve Ballans
h2. JMD configuration
622 267 Herve Ballans
623 291 Herve Ballans
Modify the file [[/usr/local/jmd/cfg/JMD.cfg]]
624 267 Herve Ballans
625 267 Herve Ballans
626 271 Herve Ballans
%{color:red}Warning : when migrate production server, change _sdo-new_ by _sdo_%
627 271 Herve Ballans
628 1 Herve Ballans
h2. NetDRMS tool Install
629 23 Pablo Alingery
630 199 Pablo Alingery
The following installed is based on : [[http://inf-redmine.ias.u-psud.fr/redmine/attachments/download/114/Netdrms_First_Install.odt]]
631 1 Herve Ballans
632 207 Pablo Alingery
The sources are in : http://jsoc.stanford.edu/netdrms/dist/ 
633 207 Pablo Alingery
Locally on sdo-new in  : /home/production/sources
634 1 Herve Ballans
635 199 Pablo Alingery
Symbolic link created 'netdrms_current' that corresponds to the last release
636 350 Pablo Alingery
<pre>
637 350 Pablo Alingery
ln -s netdrms_8.12/ netdrms_current 
638 350 Pablo Alingery
</pre>
639 360 Pablo Alingery
Edit file config.local and make sure that resource exist 
640 360 Pablo Alingery
641 360 Pablo Alingery
for example : 
642 360 Pablo Alingery
<pre>
643 360 Pablo Alingery
#   defaults
644 360 Pablo Alingery
#     PostgreSQL API headers (must contain libpq-fe.h)
645 360 Pablo Alingery
POSTGRES_INCS:X86_64    /usr/include/postgresql
646 360 Pablo Alingery
POSTGRES_INCS:AVX       /usr/include/postgresql
647 360 Pablo Alingery
648 360 Pablo Alingery
#     the location of the PostgreSQL libs; likely to be either
649 360 Pablo Alingery
#     /usr/lib or /usr/lib64 or /usr/local/pgsql/lib
650 360 Pablo Alingery
POSTGRES_LIBS:X86_64    /usr/lib/postgresql/9.4/lib
651 360 Pablo Alingery
POSTGRES_LIBS:AVX       /usr/lib/postgresql/9.4/lib
652 360 Pablo Alingery
</pre>
653 360 Pablo Alingery
654 360 Pablo Alingery
So make sure /usr/include/postgresql does exist and is the location of libpq-fe.h for example (see in config.local comments about POSTGRES API headers )
655 360 Pablo Alingery
656 27 Pablo Alingery
<pre>
657 1 Herve Ballans
cp config.local.template config.local
658 1 Herve Ballans
</pre>
659 29 Pablo Alingery
660 350 Pablo Alingery
%{color:red}Warning WEB_DBUSER      apache  we think that it should value www maybe , to be checked testing the cgi%
661 1 Herve Ballans
%{color:red}So check the cgi to figure out which user is used to connect to bd%
662 32 Herve Ballans
663 199 Pablo Alingery
Create 2 followings dirs : 
664 1 Herve Ballans
<pre>
665 350 Pablo Alingery
mkdir /usr/local/netdrms_8.12/logs/SUM -p
666 350 Pablo Alingery
mkdir /usr/local/netdrms_8.12/logs/slony -p
667 27 Pablo Alingery
</pre>
668 1 Herve Ballans
669 205 Pablo Alingery
%{color:red}Warning config.local from line 150 =>222 Remote config to provide data, series to externals%
670 205 Pablo Alingery
%{color:red}To be checked for PLATO%
671 1 Herve Ballans
672 1 Herve Ballans
Création d'un alias netdrms dans /root/.bashrc
673 27 Pablo Alingery
<pre>
674 1 Herve Ballans
alias netdrms='cd /usr/local/netdrms_current'
675 1 Herve Ballans
</pre>
676 31 Pablo Alingery
677 1 Herve Ballans
h3. Prepare compiling
678 1 Herve Ballans
679 1 Herve Ballans
Into _production_ profile
680 352 Pablo Alingery
Replace all " $? !=0 " by " $status !=0 " in file configure then tape
681 246 Herve Ballans
<pre>
682 252 Herve Ballans
$ ./configure
683 246 Herve Ballans
</pre>
684 246 Herve Ballans
685 347 Pablo Alingery
686 358 Pablo Alingery
Modification du fichier /usr/local/netdrms_current/build/jsoc_machine.csh (Same issue in NetDrms 8.11 )
687 347 Pablo Alingery
688 347 Pablo Alingery
ligne 28 :
689 347 Pablo Alingery
690 347 Pablo Alingery
  case "x86_64":
691 347 Pablo Alingery
      echo linux_x86_64
692 347 Pablo Alingery
      breaksw
693 347 Pablo Alingery
694 347 Pablo Alingery
Overwriting the existing files in the right place (base/sums/libs/pg) & modif in jsoc_machine.csh
695 347 Pablo Alingery
=> the command 'make' works well.
696 347 Pablo Alingery
697 113 Pablo Alingery
h3. Compilation
698 113 Pablo Alingery
699 361 Pablo Alingery
In file make_basic.mk line 223 
700 359 Pablo Alingery
look for "GCC_LF_ALL ="
701 361 Pablo Alingery
add "-lcrypto" 
702 353 Pablo Alingery
703 353 Pablo Alingery
704 249 Herve Ballans
<pre>
705 253 Herve Ballans
$ make
706 253 Herve Ballans
$ make sums
707 113 Pablo Alingery
</pre>
708 113 Pablo Alingery
709 255 Herve Ballans
h2. SSH-HPN install 
710 255 Herve Ballans
711 258 Herve Ballans
Intallation de openssh 7.2p2 car le dernier patch hpn dispo est 7.2hpn14.V10 
712 255 Herve Ballans
713 258 Herve Ballans
web site for open ssh : http://ftp2.fr.openbsd.org/pub/OpenBSD/OpenSSH/portable/openssh-7.2p2.tar.gz
714 258 Herve Ballans
patch hpn : https://sourceforge.net/projects/hpnssh/files/HPN-SSH%2014v10%207.2p2/openssh-7_2_P2-hpn-14.10.diff
715 255 Herve Ballans
716 256 Pablo Alingery
In the dir /home/production/sources into  'root'
717 255 Herve Ballans
718 255 Herve Ballans
<pre>
719 258 Herve Ballans
# tar -xzvf openssh-7.2p2.tar.gz
720 258 Herve Ballans
# cd openssh-7.2p2/
721 258 Herve Ballans
# cat ../openssh-7_2_P2-hpn-14.10.diff |patch -p1
722 255 Herve Ballans
# ./configure --prefix=/usr/local/hpn-ssh --with-pam --with-md5-passwords --without-zlib-version-check --with-tcp-wrappers
723 255 Herve Ballans
# make
724 255 Herve Ballans
# make install
725 255 Herve Ballans
</pre>
726 255 Herve Ballans
727 255 Herve Ballans
Depuis sdo :
728 255 Herve Ballans
<pre>
729 255 Herve Ballans
# cd /usr/local/hpn-ssh/etc/
730 259 Herve Ballans
# rsync -av *key* production@sdo-new:/home/production/
731 255 Herve Ballans
</pre>
732 255 Herve Ballans
733 273 Herve Ballans
Following the link : http://vso.stanford.edu/netdrms/rmtsums.html
734 1 Herve Ballans
<pre>
735 274 Herve Ballans
$ cd /home/production/
736 273 Herve Ballans
$ ssh-agent -c > ~/.ssh-agent_rs
737 285 Pablo Alingery
</pre>
738 362 Pablo Alingery
NB : correct file   ~/.ssh-agent_rs replace setenv by export and add '=' between var and value 
739 285 Pablo Alingery
<pre>
740 285 Pablo Alingery
#!/bin/csh
741 285 Pablo Alingery
export SSH_AUTH_SOCK=/tmp/ssh-9POrTXobhLR4/agent.74272;
742 285 Pablo Alingery
export SSH_AGENT_PID=74273;
743 285 Pablo Alingery
echo Agent pid 74273;
744 285 Pablo Alingery
</pre>
745 285 Pablo Alingery
746 285 Pablo Alingery
<pre>
747 273 Herve Ballans
$ source ~/.ssh-agent_rs
748 273 Herve Ballans
$ ssh-add ~/.ssh/id_rsa
749 269 Herve Ballans
</pre>
750 269 Herve Ballans
751 259 Herve Ballans
Sur sdo-new :
752 255 Herve Ballans
<pre>
753 260 Herve Ballans
# mv /home/production/*key* /usr/local/hpn-ssh/etc/
754 255 Herve Ballans
</pre>
755 255 Herve Ballans
756 255 Herve Ballans
We have to configure the port number to 55000
757 255 Herve Ballans
<pre>
758 255 Herve Ballans
# vi ssh_config
759 255 Herve Ballans
</pre>
760 255 Herve Ballans
761 255 Herve Ballans
and add :
762 255 Herve Ballans
<pre>
763 255 Herve Ballans
#Port 22
764 255 Herve Ballans
Port 55000
765 255 Herve Ballans
</pre>
766 255 Herve Ballans
767 255 Herve Ballans
We configure also the server hpn (even we don't use it yet)
768 255 Herve Ballans
<pre>
769 255 Herve Ballans
# vi sshd_config
770 255 Herve Ballans
</pre>
771 255 Herve Ballans
772 255 Herve Ballans
and add :
773 255 Herve Ballans
<pre>
774 255 Herve Ballans
#Port 22
775 255 Herve Ballans
Port 55000
776 255 Herve Ballans
777 255 Herve Ballans
#PidFile /var/run/sshd.pid
778 255 Herve Ballans
PidFile /var/run/sshd.55000.pid
779 255 Herve Ballans
780 255 Herve Ballans
# allow the use of the none cipher
781 255 Herve Ballans
#NoneEnabled no
782 255 Herve Ballans
NoneEnabled yes
783 255 Herve Ballans
</pre>
784 255 Herve Ballans
785 265 Herve Ballans
In order to force the use of SSH-hpn by JMD :
786 265 Herve Ballans
787 265 Herve Ballans
<pre>
788 265 Herve Ballans
$ vi /usr/local/jmd/cfg/JMD.cfg
789 265 Herve Ballans
</pre>
790 265 Herve Ballans
791 265 Herve Ballans
and replace the path of scp binary :
792 265 Herve Ballans
793 265 Herve Ballans
<pre>
794 265 Herve Ballans
SCPCommand=/usr/local/hpn-ssh/bin/scp -o NoneSwitch=yes -o NoneEnabled=yes
795 265 Herve Ballans
</pre>
796 265 Herve Ballans
797 262 Herve Ballans
h2. Private key Public key generation 
798 262 Herve Ballans
799 262 Herve Ballans
JSOC need your public key to directly connect to your netdrms server. In order to generate your RSA public/private key pair :
800 262 Herve Ballans
801 262 Herve Ballans
<pre>
802 262 Herve Ballans
$ ssh-keygen -t rsa
803 262 Herve Ballans
</pre>
804 262 Herve Ballans
805 263 Pablo Alingery
Not necessary in our case cause we recover the ssh keys of the current server 'sdo'.
806 262 Herve Ballans
807 262 Herve Ballans
However, we have to retrieve the private key of production account on sdo-new
808 262 Herve Ballans
809 262 Herve Ballans
From sdo :
810 262 Herve Ballans
<pre>
811 262 Herve Ballans
rsync -av id_rsa production@sdo-new:/home/production/.ssh/
812 262 Herve Ballans
</pre>
813 262 Herve Ballans
814 300 Herve Ballans
In order to test the connection :
815 300 Herve Ballans
<pre>
816 300 Herve Ballans
$ ssh jsocexp@jsocport.stanford.edu -p55000
817 300 Herve Ballans
</pre>
818 300 Herve Ballans
819 301 Herve Ballans
Note : the IP of the server has to be declared to the jsoc
820 301 Herve Ballans
821 299 Pablo Alingery
h2. NetDRMS Replication Config
822 112 Herve Ballans
823 319 Herve Ballans
%{color:red}To be check if we keep that here or not%
824 311 Pablo Alingery
To prevent from deleting files 
825 307 Pablo Alingery
<pre>
826 307 Pablo Alingery
cd logs/SUM ; scp production@sdo:/usr/local/netdrms/install-config-files/sum_rm.cfg .
827 112 Herve Ballans
</pre>
828 1 Herve Ballans
829 1 Herve Ballans
Create tmp dir in netdrms working directory (/usr/local/netdrms_current)
830 112 Herve Ballans
<pre>
831 315 Herve Ballans
$ mkdir tmp
832 112 Herve Ballans
</pre>
833 112 Herve Ballans
834 308 Pablo Alingery
Create config file from template 
835 112 Herve Ballans
<pre>
836 315 Herve Ballans
$ cd base/drms/replication/etc
837 313 Pablo Alingery
cp repclient.template.cfg ias.repclient.cfg
838 307 Pablo Alingery
</pre>
839 91 Herve Ballans
840 316 Herve Ballans
Define node in file : [[/usr/local/netdrms_current/base/drms/replication/etc/ias.repclient.cfg]]
841 1 Herve Ballans
842 309 Pablo Alingery
In our case :
843 94 Herve Ballans
<pre>
844 1 Herve Ballans
node=IASprod
845 319 Herve Ballans
</pre>
846 319 Herve Ballans
847 341 Pablo Alingery
There are 4 new fields in the new version of repclient (see Art mail June 11, 2016)
848 335 Herve Ballans
849 319 Herve Ballans
<pre>
850 320 Herve Ballans
#kRSBaseURL=<base URL for all Slony services>
851 334 Herve Ballans
kRSBaseURL=http://jsoc.stanford.edu/cgi-bin/ajax
852 320 Herve Ballans
#kSubService=<URL of the subscription service>
853 334 Herve Ballans
kSubService=${kRSBaseURL}/request-subs.py
854 320 Herve Ballans
#kPubListService=<URL of the publication-list service>
855 334 Herve Ballans
kPubListService=${kRSBaseURL}/publist.py
856 320 Herve Ballans
#kSubXfer=<URL of the file transfer directory>
857 334 Herve Ballans
kSubXfer=http://jsoc.stanford.edu/subscription
858 106 Pablo Alingery
</pre>
859 321 Pablo Alingery
860 321 Pablo Alingery
h2. NetDRMS Subsribe list Config
861 321 Pablo Alingery
862 321 Pablo Alingery
Create config subscribe file from template 
863 321 Pablo Alingery
<pre>
864 321 Pablo Alingery
$ cd base/drms/replication/etc
865 321 Pablo Alingery
cp subscribe_list.template.cfg ias.subscribe_list.cfg
866 321 Pablo Alingery
</pre>
867 321 Pablo Alingery
868 292 Pablo Alingery
h2. TO BE DONE BEFORE MIGRATION
869 1 Herve Ballans
870 152 Pablo Alingery
%{color:red} configure sytem taille  buffer%
871 152 Pablo Alingery
872 155 Pablo Alingery
%{color:red} swap désactivé ? discussion Stephane et Gilles%
873 1 Herve Ballans
874 1 Herve Ballans
%{color:red}Test ssh connection to JSOC , NSO CFA before subcription and just after name sdo-new into sdo%
875 317 Pablo Alingery
%{color:red}Take old counter and place it in the same dir before migration%
876 354 Pablo Alingery
877 354 Pablo Alingery
%{color:red}Before import existing db into postgres dont't forget to drop old one%
878 356 Pablo Alingery
879 357 Pablo Alingery
%{color:red}Install VSO, test cgi to access hmi/aia data%