Project

General

Profile

Update TEST server - pdocution@idoc-medoc-test » History » Version 2

Guanji Wang, 11/08/2017 17:45

1 2 Guanji Wang
h1. Update TEST server - production@idoc-medoc-test 
2 1 Guanji Wang
3 1 Guanji Wang
>h2. A. Prepare the test-server branch in git:
4 1 Guanji Wang
5 1 Guanji Wang
>1. In branch 'master', git add, commit and push all update to gitlab IAS.
6 1 Guanji Wang
7 1 Guanji Wang
>2. Test pysitools and idoc-medoc-test to see:
8 1 Guanji Wang
>* If the project && datasets are well detected.
9 1 Guanji Wang
>* If the download function works.
10 1 Guanji Wang
>* If all tests pass and the result is Ok, then go to step 3.
11 1 Guanji Wang
    
12 1 Guanji Wang
>3. Git checkout 'test-server' branch, git cherry-pick the commit ID which are used in test server.
13 1 Guanji Wang
14 1 Guanji Wang
>4. In case if there are some conflicts or conflict headers added in XML files, for easier and cleaner update, we can delete the data folder in branch test-server, then ' git checkout master -data' to recover the proper data from 'master' branch.
15 1 Guanji Wang
16 1 Guanji Wang
>5. Attention, in master branch, data source is sdo3 but not sdo, so we need execute my script -  transfer_local_test.cmd (The link : https://git.ias.u-psud.fr/gwang/idoc-medoc-solar-portal/blob/test-server/transfer_local_test.cmd)
17 1 Guanji Wang
18 1 Guanji Wang
19 1 Guanji Wang
><pre><code class="javascript">
20 1 Guanji Wang
  #!/bin/bash
21 1 Guanji Wang
echo "This is a shell to replace the host name in datasets or preference or sdodownload form url etc.."  
22 1 Guanji Wang
23 1 Guanji Wang
sdo3_cgi='sdo3.ias.u-psud.fr/VSO/DRMS/cgi-bin/ias_export_hmi.cgi'
24 1 Guanji Wang
sdo_cgi='sdo.ias.u-psud.fr/SDO/ias_export_hmi.cgi'
25 1 Guanji Wang
26 1 Guanji Wang
sdoformlocal='localhost:8184/sitools/datastorage/user/idoc_medoc/sdodownloadform.html'
27 1 Guanji Wang
sdoformtest='idoc-medoc-test.ias.u-psud.fr/sitools/datastorage/user/idoc_medoc/sdodownloadform.html'
28 1 Guanji Wang
29 1 Guanji Wang
30 1 Guanji Wang
sdo3datasource='jdbc:postgresql://sdo3.ias.u-psud.fr:5436'
31 1 Guanji Wang
sdodatasource='jdbc:postgresql://sdo.ias.u-psud.fr:5436'
32 1 Guanji Wang
33 1 Guanji Wang
34 1 Guanji Wang
sdo3metasource='jdbc:postgresql://sdo3:5432'
35 1 Guanji Wang
sdometasource='jdbc:postgresql://sdo:5432'
36 1 Guanji Wang
37 1 Guanji Wang
echo "Change cgi sdo3 to sdo"
38 1 Guanji Wang
39 1 Guanji Wang
find ./ -type f ! -name 'transfer_server_test.cmd' -exec sed -i -e "s|$sdo3_cgi|$sdo_cgi|g" {} \;
40 1 Guanji Wang
echo "Done modifier the path"
41 1 Guanji Wang
echo "Stupid changes begin"
42 1 Guanji Wang
43 1 Guanji Wang
find ./ -type f ! -name 'transfer_server_test.cmd' -exec sed -i -e "s|$sdoformlocal|$sdoformtest|g" {} \;
44 1 Guanji Wang
echo "Done modifier the sdo form host domain"
45 1 Guanji Wang
46 1 Guanji Wang
47 1 Guanji Wang
find ./ -type f ! -name 'transfer_server_test.cmd' -exec sed -i -e "s|$sdo3datasource|$sdodatasource|g" {} \;
48 1 Guanji Wang
echo "Done modifier the sdo data source"
49 1 Guanji Wang
50 1 Guanji Wang
51 1 Guanji Wang
52 1 Guanji Wang
find ./ -type f ! -name 'transfer_server_test.cmd' -exec sed -i -e "s|$sdo3metasource|$sdometasource|g" {} \;
53 1 Guanji Wang
echo "Done modifier meta data source"
54 1 Guanji Wang
55 1 Guanji Wang
echo "Stupid change finish"
56 1 Guanji Wang
</code></pre>
57 1 Guanji Wang
58 1 Guanji Wang
>6. Every time we restart sitools, the lastupdatedate element in all XML files will be updated, so don't forget to re-commit all the new changes.
59 1 Guanji Wang
60 1 Guanji Wang
61 1 Guanji Wang
>h2. B. In the test server:
62 1 Guanji Wang
63 1 Guanji Wang
>1. Check if the sitools will be restarted automatically in case of the cut of electricity. 
64 1 Guanji Wang
65 1 Guanji Wang
><pre><code class="python">
66 1 Guanji Wang
cat /etc/rc.local
67 1 Guanji Wang
</code></pre>
68 1 Guanji Wang
69 1 Guanji Wang
>!Selection_387.jpg!
70 1 Guanji Wang
71 1 Guanji Wang
>2. Stop the sitools project and git fetch the source: git fetch {repository} {branch}.
72 1 Guanji Wang
73 1 Guanji Wang
>3. Git pull:  If there are conflicts in XML, try to commit the conflicts and if it works, go to step5, if it doesn't work, go to step 4.
74 1 Guanji Wang
75 1 Guanji Wang
>4. Re-distribute sitools project by executing cmd in following production@idoc-medoc-test :   /home/production/scripts/Dev_To_Test_git_clone.cmd.
76 1 Guanji Wang
77 1 Guanji Wang
78 1 Guanji Wang
79 1 Guanji Wang
><pre><code class="javascript">
80 1 Guanji Wang
#!/bin/bash
81 1 Guanji Wang
82 1 Guanji Wang
NOW=$(date +"%Y-%m-%d")
83 1 Guanji Wang
84 1 Guanji Wang
SitoolsDirTest=/usr/local/Sitools2_solar
85 1 Guanji Wang
86 1 Guanji Wang
$SitoolsDirTest/workspace/fr.cnes.sitools.core/sitools stop
87 1 Guanji Wang
wait ${!}
88 1 Guanji Wang
89 1 Guanji Wang
#echo $SitoolsDirTest $SitoolsDirTest"_"$NOW
90 1 Guanji Wang
rm -Rf $SitoolsDirTest"_"$NOW
91 1 Guanji Wang
mv $SitoolsDirTest $SitoolsDirTest"_"$NOW
92 1 Guanji Wang
#mkdir /usr/local/Sitools2_solar
93 1 Guanji Wang
94 1 Guanji Wang
git clone https://gwang@git.ias.u-psud.fr/gwang/idoc-medoc-solar-portal.git -b test-server /usr/local/Sitools2_solar
95 1 Guanji Wang
#echo $USER@$HOSTNAME:$SitoolsDir/*
96 1 Guanji Wang
97 1 Guanji Wang
mkdir $SitoolsDirTest/data/resourses_logs_solar
98 1 Guanji Wang
99 1 Guanji Wang
$SitoolsDirTest/workspace/fr.cnes.sitools.core/sitools start
100 1 Guanji Wang
101 1 Guanji Wang
echo "Please erase old Sitools2_solar dir on disk "
102 1 Guanji Wang
Dev_To_Test_git_clone.cmd (END)
103 1 Guanji Wang
104 1 Guanji Wang
105 1 Guanji Wang
</code></pre>
106 1 Guanji Wang
107 1 Guanji Wang
108 1 Guanji Wang
>5. Restart the sitools project.
109 1 Guanji Wang
 
110 1 Guanji Wang
>6. Track the log, do simple test in idoc-medoc-test and have fun.
111 1 Guanji Wang
112 1 Guanji Wang
113 1 Guanji Wang
>h2.  C. ANNEXE: 
114 1 Guanji Wang
115 1 Guanji Wang
>1. The commits in the test-server branch - https://git.ias.u-psud.fr/gwang/idoc-medoc-solar-portal/commits/test-server 
116 1 Guanji Wang
117 1 Guanji Wang
>2. The whole project source code for test branch - https://git.ias.u-psud.fr/gwang/idoc-medoc-solar-portal/tree/test-server