Project

General

Profile

Update TEST server - production@idoc-medoc-test » History » Version 1

Anonymous, 11/08/2017 17:47

1 1 Anonymous
h1. Update TEST server - production@idoc-medoc-test 
2 1 Anonymous
3 1 Anonymous
>h2. A. Prepare the test-server branch in git:
4 1 Anonymous
5 1 Anonymous
>1. In branch 'master', git add, commit and push all update to gitlab IAS.
6 1 Anonymous
7 1 Anonymous
>2. Test pysitools and idoc-medoc-test to see:
8 1 Anonymous
>* If the project && datasets are well detected.
9 1 Anonymous
>* If the download function works.
10 1 Anonymous
>* If all tests pass and the result is Ok, then go to step 3.
11 1 Anonymous
    
12 1 Anonymous
>3. Git checkout 'test-server' branch, git cherry-pick the commit ID which are used in test server.
13 1 Anonymous
14 1 Anonymous
>4. In case if there are some conflicts or conflict headers added in XML files, for easier and cleaner update, we can delete the data folder in branch test-server, then ' git checkout master -data' to recover the proper data from 'master' branch.
15 1 Anonymous
16 1 Anonymous
>5. Attention, in master branch, data source is sdo3 but not sdo, so we need execute my script -  transfer_local_test.cmd (The link : https://git.ias.u-psud.fr/gwang/idoc-medoc-solar-portal/blob/test-server/transfer_local_test.cmd)
17 1 Anonymous
18 1 Anonymous
19 1 Anonymous
><pre><code class="javascript">
20 1 Anonymous
  #!/bin/bash
21 1 Anonymous
echo "This is a shell to replace the host name in datasets or preference or sdodownload form url etc.."  
22 1 Anonymous
23 1 Anonymous
sdo3_cgi='sdo3.ias.u-psud.fr/VSO/DRMS/cgi-bin/ias_export_hmi.cgi'
24 1 Anonymous
sdo_cgi='sdo.ias.u-psud.fr/SDO/ias_export_hmi.cgi'
25 1 Anonymous
26 1 Anonymous
sdoformlocal='localhost:8184/sitools/datastorage/user/idoc_medoc/sdodownloadform.html'
27 1 Anonymous
sdoformtest='idoc-medoc-test.ias.u-psud.fr/sitools/datastorage/user/idoc_medoc/sdodownloadform.html'
28 1 Anonymous
29 1 Anonymous
30 1 Anonymous
sdo3datasource='jdbc:postgresql://sdo3.ias.u-psud.fr:5436'
31 1 Anonymous
sdodatasource='jdbc:postgresql://sdo.ias.u-psud.fr:5436'
32 1 Anonymous
33 1 Anonymous
34 1 Anonymous
sdo3metasource='jdbc:postgresql://sdo3:5432'
35 1 Anonymous
sdometasource='jdbc:postgresql://sdo:5432'
36 1 Anonymous
37 1 Anonymous
echo "Change cgi sdo3 to sdo"
38 1 Anonymous
39 1 Anonymous
find ./ -type f ! -name 'transfer_server_test.cmd' -exec sed -i -e "s|$sdo3_cgi|$sdo_cgi|g" {} \;
40 1 Anonymous
echo "Done modifier the path"
41 1 Anonymous
echo "Stupid changes begin"
42 1 Anonymous
43 1 Anonymous
find ./ -type f ! -name 'transfer_server_test.cmd' -exec sed -i -e "s|$sdoformlocal|$sdoformtest|g" {} \;
44 1 Anonymous
echo "Done modifier the sdo form host domain"
45 1 Anonymous
46 1 Anonymous
47 1 Anonymous
find ./ -type f ! -name 'transfer_server_test.cmd' -exec sed -i -e "s|$sdo3datasource|$sdodatasource|g" {} \;
48 1 Anonymous
echo "Done modifier the sdo data source"
49 1 Anonymous
50 1 Anonymous
51 1 Anonymous
52 1 Anonymous
find ./ -type f ! -name 'transfer_server_test.cmd' -exec sed -i -e "s|$sdo3metasource|$sdometasource|g" {} \;
53 1 Anonymous
echo "Done modifier meta data source"
54 1 Anonymous
55 1 Anonymous
echo "Stupid change finish"
56 1 Anonymous
</code></pre>
57 1 Anonymous
58 1 Anonymous
>6. Every time we restart sitools, the lastupdatedate element in all XML files will be updated, so don't forget to re-commit all the new changes.
59 1 Anonymous
60 1 Anonymous
61 1 Anonymous
>h2. B. In the test server:
62 1 Anonymous
63 1 Anonymous
>1. Check if the sitools will be restarted automatically in case of the cut of electricity. 
64 1 Anonymous
65 1 Anonymous
><pre><code class="python">
66 1 Anonymous
cat /etc/rc.local
67 1 Anonymous
</code></pre>
68 1 Anonymous
69 1 Anonymous
>!Selection_387.jpg!
70 1 Anonymous
71 1 Anonymous
>2. Stop the sitools project and git fetch the source: git fetch {repository} {branch}.
72 1 Anonymous
73 1 Anonymous
>3. Git pull:  If there are conflicts in XML, try to commit the conflicts and if it works, go to step5, if it doesn't work, go to step 4.
74 1 Anonymous
75 1 Anonymous
>4. Re-distribute sitools project by executing cmd in following production@idoc-medoc-test :   /home/production/scripts/Dev_To_Test_git_clone.cmd.
76 1 Anonymous
77 1 Anonymous
78 1 Anonymous
79 1 Anonymous
><pre><code class="javascript">
80 1 Anonymous
#!/bin/bash
81 1 Anonymous
82 1 Anonymous
NOW=$(date +"%Y-%m-%d")
83 1 Anonymous
84 1 Anonymous
SitoolsDirTest=/usr/local/Sitools2_solar
85 1 Anonymous
86 1 Anonymous
$SitoolsDirTest/workspace/fr.cnes.sitools.core/sitools stop
87 1 Anonymous
wait ${!}
88 1 Anonymous
89 1 Anonymous
#echo $SitoolsDirTest $SitoolsDirTest"_"$NOW
90 1 Anonymous
rm -Rf $SitoolsDirTest"_"$NOW
91 1 Anonymous
mv $SitoolsDirTest $SitoolsDirTest"_"$NOW
92 1 Anonymous
#mkdir /usr/local/Sitools2_solar
93 1 Anonymous
94 1 Anonymous
git clone https://gwang@git.ias.u-psud.fr/gwang/idoc-medoc-solar-portal.git -b test-server /usr/local/Sitools2_solar
95 1 Anonymous
#echo $USER@$HOSTNAME:$SitoolsDir/*
96 1 Anonymous
97 1 Anonymous
mkdir $SitoolsDirTest/data/resourses_logs_solar
98 1 Anonymous
99 1 Anonymous
$SitoolsDirTest/workspace/fr.cnes.sitools.core/sitools start
100 1 Anonymous
101 1 Anonymous
echo "Please erase old Sitools2_solar dir on disk "
102 1 Anonymous
Dev_To_Test_git_clone.cmd (END)
103 1 Anonymous
104 1 Anonymous
105 1 Anonymous
</code></pre>
106 1 Anonymous
107 1 Anonymous
108 1 Anonymous
>5. Restart the sitools project.
109 1 Anonymous
 
110 1 Anonymous
>6. Track the log, do simple test in idoc-medoc-test and have fun.
111 1 Anonymous
112 1 Anonymous
113 1 Anonymous
>h2.  C. ANNEXE: 
114 1 Anonymous
115 1 Anonymous
>1. The commits in the test-server branch - https://git.ias.u-psud.fr/gwang/idoc-medoc-solar-portal/commits/test-server 
116 1 Anonymous
117 1 Anonymous
>2. The whole project source code for test branch - https://git.ias.u-psud.fr/gwang/idoc-medoc-solar-portal/tree/test-server