Skip to content
This repository has been archived by the owner on Jan 7, 2023. It is now read-only.

Updated wait_workload_to_stop and stop_workload and Add new method to check vdbench #145

Open
wants to merge 102 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
102 commits
Select commit Hold shift + click to select a range
fa145d0
Set the maximum number of simultaneous remote commands for pdsh
Aug 25, 2016
1a4b423
Enable Vdbench support in CeTune
Aug 25, 2016
117f710
Merge pull request #104 from ningli16/master
xuechendi Aug 31, 2016
c94cfc5
Merge pull request #105 from Shaoshian/vdbench_parameters
xuechendi Aug 31, 2016
c4355e3
fix a report list bug
Shaoshian Sep 2, 2016
096c645
Merge pull request #106 from Shaoshian/fix_a_report_list_bug
xuechendi Sep 2, 2016
67e7245
save vdbench parameters for result show
Sep 4, 2016
63c70b6
Merge pull request #107 from ningli16/master
xuechendi Sep 5, 2016
7ad6301
edit vdbench parameter file name
Shaoshian Sep 5, 2016
bce2f4a
Merge pull request #108 from Shaoshian/fix_vdbench_parameter
xuechendi Sep 5, 2016
401efa9
delete description from all.conf
Shaoshian Sep 6, 2016
eeafccc
Merge pull request #109 from Shaoshian/delete_decription_from_allconf
xuechendi Sep 6, 2016
357955a
fix create case without parameters bug
Shaoshian Sep 7, 2016
88f5765
Merge pull request #110 from Shaoshian/fix_create_case_without_parame…
xuechendi Sep 7, 2016
451c243
change the case_type extracting method
Sep 8, 2016
efa7fc9
Merge pull request #111 from ningli16/master
xuechendi Sep 8, 2016
b4c17f9
add user login function
Shaoshian Sep 9, 2016
c3720ce
Merge pull request #112 from Shaoshian/login
xuechendi Sep 9, 2016
e274e65
transfer str to int of replica size
xuechendi Sep 12, 2016
f2b61df
Merge branch 'master' of https://github.com/xuechendi/CeTune
xuechendi Sep 12, 2016
fc27830
Merge pull request #113 from xuechendi/master
xuechendi Sep 12, 2016
dc9b951
fix latency result not match bug
Shaoshian Sep 13, 2016
0723271
Merge pull request #114 from Shaoshian/fix_latency_result_not_match
xuechendi Sep 13, 2016
b66df50
modify login page
Shaoshian Sep 20, 2016
b1e51ff
Merge pull request #116 from Shaoshian/modify_login_page
xuechendi Sep 21, 2016
71bae40
report add 99.99% latency colume
Shaoshian Sep 20, 2016
8bd19b0
Merge pull request #115 from Shaoshian/report_add_latency_col
xuechendi Sep 23, 2016
058b9c1
fix sn_iops value error bug
Shaoshian Sep 27, 2016
de0398a
Merge pull request #117 from Shaoshian/fix_sn_iops_error
xuechendi Sep 27, 2016
bc6290b
delete add case create description row function
Shaoshian Oct 10, 2016
c0765a7
Merge pull request #118 from Shaoshian/delete_add_case_create_descrip…
Oct 10, 2016
1820767
fix no timestamp after execute case
Shaoshian Oct 18, 2016
5497ad6
Merge pull request #119 from Shaoshian/fix_no_timestamp_after_excute_…
xuechendi Oct 18, 2016
4466c1a
fix a check db data bug
Shaoshian Oct 19, 2016
4aeffa3
Merge pull request #121 from Shaoshian/fix_a_check_db_data_bug
xuechendi Oct 19, 2016
9ddf76b
Remove the hardcode of rbd
xuechendi Oct 20, 2016
ccba72c
Merge pull request #122 from xuechendi/master
xuechendi Oct 20, 2016
e7cc867
collect all node ceph version
Shaoshian Oct 20, 2016
a693895
Merge pull request #123 from Shaoshian/collect_ceph_version_log
xuechendi Oct 21, 2016
b9ec27d
bug fix on process execute time
xuechendi Oct 22, 2016
9cdeb73
Merge pull request #126 from xuechendi/master
xuechendi Oct 22, 2016
6989a6f
case conf add aditional option colume
Shaoshian Oct 25, 2016
ec2e7ba
do restart or redeploy before run case.
Shaoshian Oct 25, 2016
f2deafd
change radio button to dropdown list
Shaoshian Oct 26, 2016
31eb0aa
Extract workflow codes from tuner
xuechendi Oct 26, 2016
1db4d49
Merge pull request #128 from xuechendi/aditional_option
xuechendi Oct 26, 2016
d39c080
Bug fix on this PR
xuechendi Oct 27, 2016
7645c25
Merge pull request #129 from xuechendi/aditional_option
xuechendi Oct 27, 2016
6f6cf5b
Merge pull request #130 from 01org/wip_restart_redeploy
xuechendi Oct 27, 2016
63a8642
Fix import issue happens on some version of python
xuechendi Oct 27, 2016
627979a
Merge pull request #131 from xuechendi/master
xuechendi Oct 27, 2016
ebf6f1c
Move log print in the loop
Oct 27, 2016
2a3f549
Merge pull request #132 from ningli16/master
xuechendi Oct 28, 2016
25179ee
Fix import issue happens on some version of python
xuechendi Oct 27, 2016
d9892fb
Merge pull request #133 from xuechendi/master
xuechendi Oct 28, 2016
abfa57c
Fix on workflow.py
xuechendi Oct 28, 2016
f0ccf4b
Merge pull request #134 from xuechendi/master
xuechendi Oct 28, 2016
787fac8
modify cetune document
Shaoshian Nov 7, 2016
56f909e
Merge pull request #135 from Shaoshian/modify_cetune_document
xuechendi Nov 7, 2016
bc8c552
read case.conf will show error if has blank lines
Shaoshian Nov 8, 2016
d5b2324
Merge pull request #136 from Shaoshian/read_caseconf_show_error_with_…
xuechendi Nov 9, 2016
47e94a1
update cetune user guide
xuechendi Nov 11, 2016
4752a8d
Merge pull request #137 from xuechendi/master
xuechendi Nov 11, 2016
7d2caf0
New add a create_partition bash
xuechendi Nov 23, 2016
18cd682
Merge pull request #138 from xuechendi/master
xuechendi Nov 23, 2016
85500a8
1.Read cases.conf with blank lines.(old way can't improve it).2.Bench…
pythonfucku Nov 24, 2016
d8c20ef
Merge pull request #140 from pythonfucku/master
xuechendi Nov 24, 2016
edc87cd
optimization web loading speed,del no use interactive
pythonfucku Dec 6, 2016
ad8fb9d
Merge pull request #143 from pythonfucku/master
xuechendi Dec 6, 2016
3a8bc63
add Distributed analysis
pythonfucku Dec 9, 2016
c5425fe
fix Distributed analysis
pythonfucku Dec 13, 2016
e739f84
Merge pull request #144 from pythonfucku/master
xuechendi Dec 13, 2016
c63d079
add Distributed analysis remote log
pythonfucku Dec 13, 2016
e3f6aa2
Merge pull request #147 from pythonfucku/master
xuechendi Dec 13, 2016
0f8794d
fix a bug
pythonfucku Dec 14, 2016
6b64eba
Merge pull request #148 from pythonfucku/master
xuechendi Dec 14, 2016
5bbd08c
Add 99.99 latency at summary page
xuechendi Dec 14, 2016
9c4d481
Merge pull request #149 from xuechendi/master
xuechendi Dec 14, 2016
af3b170
Merge pull request #1 from 01org/master
pythonfucku Dec 15, 2016
6a881d8
add log,and clean up tmp_dir when running cases
pythonfucku Dec 15, 2016
245f6c6
clean up tmp_dir cetun_console.log
pythonfucku Dec 15, 2016
4b36229
add ceph daemon perf reset all
pythonfucku Dec 15, 2016
52cf58d
reset perf option
pythonfucku Dec 15, 2016
71b25a7
Merge pull request #150 from pythonfucku/master
xuechendi Dec 15, 2016
47a21fb
ui add resetPerf option
Shaoshian Dec 15, 2016
44bd32f
Merge pull request #151 from Shaoshian/ui_add_resetPerf_option
xuechendi Dec 16, 2016
964279f
[BUG FIX]fix issue we met in all nvme setup
xuechendi Dec 19, 2016
dbeda70
Merge pull request #153 from 01org/wip_fix_fmlab
xuechendi Dec 19, 2016
30efd6e
Add interrupt process codes into cetune
Shaoshian Dec 20, 2016
6a5c9ca
Merge pull request #154 from Shaoshian/wip_interrupt
xuechendi Dec 20, 2016
156eca1
fix workload fio iops
Shaoshian Jan 4, 2017
3a63c78
Merge pull request #156 from Shaoshian/fix_workload_fio_iops
xuechendi Jan 5, 2017
36de833
CeTune Docs update
xuechendi Jan 5, 2017
8bfb19f
Move pic dir to static for github to show those pic
xuechendi Jan 5, 2017
509851a
Merge pull request #157 from xuechendi/master
xuechendi Jan 5, 2017
288ac38
Small fix
xuechendi Jan 6, 2017
00dd8b0
Merge pull request #158 from 01org/wip_small_fix
xuechendi Jan 6, 2017
4b2a308
Description is Null in generic scenario
lixiaoy1 Jan 9, 2017
d279488
Get all IPs
lixiaoy1 Jan 9, 2017
e3d4e2d
Update generic.py
xuechendi Jan 9, 2017
e15c1d0
Merge pull request #159 from lixiaoy1/descrition_fix
xuechendi Jan 11, 2017
f8f0503
Merge pull request #160 from lixiaoy1/ip_fix
xuechendi Jan 11, 2017
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file modified CeTune Document.pdf
Binary file not shown.
33 changes: 20 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@

####Functionality Description
- CeTune is a toolkit/framework to deploy, benchmark, profile and tune *Ceph cluster performance.
- Aim to speed up the procedure of benchmarking *Ceph performance, and provide clear data charts of system metrics, latency breakdown data for users to analyze *Ceph performance.
Expand All @@ -17,24 +18,30 @@

* * *
####Installation
- Install to head and workers:

```
head and workers need deploy apt-get,wget,pip proxy.
apt-get install -y python
```

- Install to head:

```
git clone https://github.com/01org/CeTune.git

apt-get install -y python-pip pdsh unzip expect sysstat curl openjdk-7-jre haproxy python-matplotlib python-numpy python-yaml
pip install ceph-deploy argparse markdown2
apt-get install expect
cd /CeTune/deploy/
python controller_dependencies_install.py

#make sure head is able to autossh all worker nodes and 127.0.0.1
# make sure head is able to autossh all worker nodes and 127.0.0.1
cd ${CeTune_PATH}/deploy/prepare-scripts; ./configure_autossh.sh ${host} ${ssh_password}
```

- Install to workers:

```
apt-get install -y python-pip unzip sysstat curl openjdk-7-jre haproxy
apt-get install sqlite
cd /CeTune/deploy/
python worker_dependencies_install.py
```

* * *
Expand All @@ -52,13 +59,13 @@ python setup.py install
cd ${CeTune_PATH}/webui/
Python webui.py

#you will see below output
# you will see below output
root@client01:/CeTune/webui# python webui.py
http://0.0.0.0:8080/
```
- CeTune WebUI

![webui.png](pic/webui.png)
![webui.png](static/pic/webui.png)

* * *
####Configure
Expand Down Expand Up @@ -91,11 +98,11 @@ Assume ceph is installed on all nodes, this part is demonstrate the workflow of

- Uncheck 'Benchmark' and only check 'Deploy', then click 'Execute'

![webui_deploy.png](pic/webui_deploy.png)
![webui_deploy.png](static/pic/webui_deploy.png)

- WebUI will jump to 'CeTune Status' and you will about to see below console logs

![webui_deploy_detail.png](pic/webui_deploy_detail.png)
![webui_deploy_detail.png](static/pic/webui_deploy_detail.png)


* * *
Expand All @@ -112,11 +119,11 @@ Assume ceph is installed on all nodes, this part is demonstrate the workflow of
* * *
####Check Benchmark Results

![webui_result.png](pic/webui_result.png)
![webui_result.png](static/pic/webui_result.png)

![webui_result_detail.png](pic/webui_result_detail.png)
![webui_result_detail.png](static/pic/webui_result_detail.png)

![webui_result_detail2.png](pic/webui_result_detail2.png)
![webui_result_detail2.png](static/pic/webui_result_detail2.png)


* * *
Expand Down
372 changes: 303 additions & 69 deletions analyzer/analyzer.py

Large diffs are not rendered by default.

Loading