Skip to content

Commit 7b66cb7

Browse files
zergtantzergtant
committed
更新：第四章第二节 visdom
1 parent e051761 commit 7b66cb7

File tree

7 files changed

+345
-3
lines changed

7 files changed

+345
-3
lines changed

‎README.md

+3
Original file line numberDiff line numberDiff line change
@@ -76,6 +76,9 @@ API的改动不是很大，本教程已经通过测试，保证能够在1.0中
7676
[Fine-tuning](chapter4/4.1-fine-tuning.ipynb)
7777

7878
#### 第二节 可视化
79+
80+
[visdom](chapter4/4.2.1-visdom.ipynb)
81+
7982
#### 第三节 fastai
8083
#### 第四节 数据处理技巧
8184
#### 第五节 并行计算

‎chapter4/1.PNG

4.61 KB
Loading

‎chapter4/2.PNG

12.1 KB
Loading

‎chapter4/3.PNG

2.06 KB
Loading

‎chapter4/4.2.1-visdom.ipynb

+335
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,335 @@
1+
{
2+
"cells": [
3+
{
4+
"cell_type": "code",
5+
"execution_count": 1,
6+
"metadata": {},
7+
"outputs": [
8+
{
9+
"data": {
10+
"text/plain": [
11+
"'1.0.0'"
12+
]
13+
},
14+
"execution_count": 1,
15+
"metadata": {},
16+
"output_type": "execute_result"
17+
}
18+
],
19+
"source": [
20+
"import torch\n",
21+
"import math\n",
22+
"import numpy as np\n",
23+
"from visdom import Visdom\n",
24+
"import time\n",
25+
"torch.__version__"
26+
]
27+
},
28+
{
29+
"cell_type": "markdown",
30+
"metadata": {},
31+
"source": [
32+
"# 4.2.1 使用Visdom在 PyTorch 中进行可视化\n",
33+
"Visdom是Facebook在2017年发布的一款针对PyTorch的可视化工具。[官网](https://github.com/facebookresearch/visdom),visdom由于其功能简单，一般会被定义为服务器端的matplot，也就是说我们可以直接使用python的控制台模式进行开发并在服务器上执行，将一些可视化的数据传送到Visdom服务上，通过Visdom服务进行可视化"
34+
]
35+
},
36+
{
37+
"cell_type": "markdown",
38+
"metadata": {},
39+
"source": [
40+
"## 安装\n",
41+
"Visdom的安装很简单，直接使用命令`pip install visdom`安装即可。\n",
42+
"在安装完成后，使用命令`python -m visdom.server` 在本地启动服务器，启动后会提示`It's Alive! You can navigate to http://localhost:8097` 这就说明服务已经可用，我们打开浏览器，输入`http://localhost:8097` 即可看到页面。\n",
43+
"\n",
44+
"端口8097是默认的端口可以在启动命令后加 `-port`参数指定端口，常用的参数还有 `--hostname`，`-base_url`等"
45+
]
46+
},
47+
{
48+
"cell_type": "markdown",
49+
"metadata": {},
50+
"source": [
51+
"## 坑\n",
52+
"Visdom的服务在启动时会自动下载一些静态文件，这里坑就来了，因为某些无法描述的原因，导致下载会失败，比如类似这样的提示 `ERROR:root:Error 404 while downloading https://unpkg.com/[email protected]` 就说明静态文件没有下载完全，这样有可能就会打不开或者页面中没有菜单栏，那么需要手动进行下载，这里我打包了一份正常的静态文件，直接复制到`Lib\\site-packages\\visdom`中即可。\n",
53+
"\n",
54+
"如果不知道conda的环境目录在哪里，可以使用`conda env list` 查看\n",
55+
"\n",
56+
"感谢CSDN的伙伴提供的缺失文件，原文[这里](https://blog.csdn.net/qq_36941368/article/details/82288154)"
57+
]
58+
},
59+
{
60+
"cell_type": "markdown",
61+
"metadata": {},
62+
"source": [
63+
"## 基本概念\n",
64+
"### Environments\n",
65+
"Environments的作用是对可视化区域进行分区，每个用户都会有一个叫做main的默认分区，如图所示:\n",
66+
"![](1.PNG)\n",
67+
"在程序指定的情况下，默认的图表都会放到这里面"
68+
]
69+
},
70+
{
71+
"cell_type": "markdown",
72+
"metadata": {},
73+
"source": [
74+
"## Panes\n",
75+
"Panes是作为每一个可视化图表的容器，可以使用生成的图表，图片，文本进行填充，我们可以对Panes进行拖放，删除，调整大小和销毁等操作：\n",
76+
"![](2.PNG)\n",
77+
"Panes和Environments是一对多的关系，即一个Environments可以包含多个Panes\n"
78+
]
79+
},
80+
{
81+
"cell_type": "markdown",
82+
"metadata": {},
83+
"source": [
84+
"### VIEW\n",
85+
"在对Panes进行调整后，可以通过VIEW对状态进行管理：\n",
86+
"![](3.PNG)"
87+
]
88+
},
89+
{
90+
"cell_type": "markdown",
91+
"metadata": {},
92+
"source": [
93+
"## 可视化接口\n",
94+
"Visdom是由Plotly 提供的可视化支持，所以提供一下可视化的接口:\n",
95+
"- vis.scatter : 2D 或 3D 散点图\n",
96+
"- vis.line : 线图\n",
97+
"- vis.stem : 茎叶图\n",
98+
"- vis.heatmap : 热力图\n",
99+
"- vis.bar : 条形图\n",
100+
"- vis.histogram: 直方图\n",
101+
"- vis.boxplot : 箱型图\n",
102+
"- vis.surf : 表面图\n",
103+
"- vis.contour : 轮廓图\n",
104+
"- vis.quiver : 绘出二维矢量场\n",
105+
"- vis.image : 图片\n",
106+
"- vis.text : 文本\n",
107+
"- vis.mesh : 网格图\n",
108+
"- vis.save : 序列化状态"
109+
]
110+
},
111+
{
112+
"cell_type": "markdown",
113+
"metadata": {},
114+
"source": [
115+
"## 使用\n",
116+
"### 绘制简单的图形\n",
117+
"这里我们使用官方的DEMO来做样例"
118+
]
119+
},
120+
{
121+
"cell_type": "code",
122+
"execution_count": 2,
123+
"metadata": {},
124+
"outputs": [],
125+
"source": [
126+
"env = Visdom() \n",
127+
"assert env.check_connection() #测试一下链接，链接错误的话会报错"
128+
]
129+
},
130+
{
131+
"cell_type": "markdown",
132+
"metadata": {},
133+
"source": [
134+
"这里生成sin和cos两条曲线数据"
135+
]
136+
},
137+
{
138+
"cell_type": "code",
139+
"execution_count": 3,
140+
"metadata": {},
141+
"outputs": [],
142+
"source": [
143+
"Y = np.linspace(0, 2 * math.pi, 70)\n",
144+
"X = np.column_stack((np.sin(Y), np.cos(Y)))"
145+
]
146+
},
147+
{
148+
"cell_type": "markdown",
149+
"metadata": {},
150+
"source": [
151+
"使用茎叶图展示"
152+
]
153+
},
154+
{
155+
"cell_type": "code",
156+
"execution_count": 4,
157+
"metadata": {
158+
"scrolled": true
159+
},
160+
"outputs": [
161+
{
162+
"data": {
163+
"text/plain": [
164+
"'window_36f18bc34b4992'"
165+
]
166+
},
167+
"execution_count": 4,
168+
"metadata": {},
169+
"output_type": "execute_result"
170+
}
171+
],
172+
"source": [
173+
"env.stem(\n",
174+
" X=X,\n",
175+
" Y=Y,\n",
176+
" opts=dict(legend=['Sine', 'Cosine'])\n",
177+
" )"
178+
]
179+
},
180+
{
181+
"cell_type": "markdown",
182+
"metadata": {},
183+
"source": [
184+
"可以通过env参数指定Environments，如果名称包含了下划线`_`那么visdom会跟根据下划线分割并自动分组"
185+
]
186+
},
187+
{
188+
"cell_type": "code",
189+
"execution_count": 5,
190+
"metadata": {
191+
"scrolled": true
192+
},
193+
"outputs": [],
194+
"source": [
195+
"envtest = Visdom(env='test_mesh')\n",
196+
"assert envtest.check_connection()"
197+
]
198+
},
199+
{
200+
"cell_type": "markdown",
201+
"metadata": {},
202+
"source": [
203+
"生成一个网格图"
204+
]
205+
},
206+
{
207+
"cell_type": "code",
208+
"execution_count": 6,
209+
"metadata": {},
210+
"outputs": [
211+
{
212+
"data": {
213+
"text/plain": [
214+
"'window_36f18bc533e990'"
215+
]
216+
},
217+
"execution_count": 6,
218+
"metadata": {},
219+
"output_type": "execute_result"
220+
}
221+
],
222+
"source": [
223+
"x = [0, 0, 1, 1, 0, 0, 1, 1]\n",
224+
"y = [0, 1, 1, 0, 0, 1, 1, 0]\n",
225+
"z = [0, 0, 0, 0, 1, 1, 1, 1]\n",
226+
"X = np.c_[x, y, z]\n",
227+
"i = [7, 0, 0, 0, 4, 4, 6, 6, 4, 0, 3, 2]\n",
228+
"j = [3, 4, 1, 2, 5, 6, 5, 2, 0, 1, 6, 3]\n",
229+
"k = [0, 7, 2, 3, 6, 7, 1, 1, 5, 5, 7, 6]\n",
230+
"Y = np.c_[i, j, k]\n",
231+
"envtest.mesh(X=X, Y=Y, opts=dict(opacity=0.5))"
232+
]
233+
},
234+
{
235+
"cell_type": "markdown",
236+
"metadata": {},
237+
"source": [
238+
"## 更新损失函数"
239+
]
240+
},
241+
{
242+
"cell_type": "markdown",
243+
"metadata": {},
244+
"source": [
245+
"在训练的时候我们每一批次都会打印一下训练的损失和测试的准确率，这样展示的图表是需要动态增加数据的，下面我们来模拟一下这种情况"
246+
]
247+
},
248+
{
249+
"cell_type": "code",
250+
"execution_count": 7,
251+
"metadata": {},
252+
"outputs": [],
253+
"source": [
254+
"x,y=0,0\n",
255+
"env2 = Visdom()\n",
256+
"pane1= env2.line(\n",
257+
" X=np.array([x]),\n",
258+
" Y=np.array([y]),\n",
259+
" opts=dict(title='dynamic data'))"
260+
]
261+
},
262+
{
263+
"cell_type": "code",
264+
"execution_count": 8,
265+
"metadata": {},
266+
"outputs": [
267+
{
268+
"name": "stdout",
269+
"output_type": "stream",
270+
"text": [
271+
"0 0.0\n",
272+
"1 1.5\n",
273+
"3 5.25\n",
274+
"6 12.375\n",
275+
"10 24.5625\n",
276+
"15 44.34375\n",
277+
"21 75.515625\n",
278+
"28 123.7734375\n",
279+
"36 197.66015625\n",
280+
"45 309.990234375\n"
281+
]
282+
}
283+
],
284+
"source": [
285+
"for i in range(10):\n",
286+
" time.sleep(1) #每隔一秒钟打印一次数据\n",
287+
" x+=i\n",
288+
" y=(y+i)*1.5\n",
289+
" print(x,y)\n",
290+
" env2.line(\n",
291+
" X=np.array([x]),\n",
292+
" Y=np.array([y]),\n",
293+
" win=pane1,#win参数确认使用哪一个pane\n",
294+
" update='append') #我们做的动作是追加，除了追加意外还有其他方式，这里我们不做介绍了"
295+
]
296+
},
297+
{
298+
"cell_type": "markdown",
299+
"metadata": {},
300+
"source": [
301+
"在运行完上述程序时，切换到visdom，看看效果吧\n",
302+
"\n",
303+
"visdom的基本用法介绍完毕，下一节介绍更加强大的 tensorboardx"
304+
]
305+
},
306+
{
307+
"cell_type": "code",
308+
"execution_count": null,
309+
"metadata": {},
310+
"outputs": [],
311+
"source": []
312+
}
313+
],
314+
"metadata": {
315+
"kernelspec": {
316+
"display_name": "pytorch 1.0",
317+
"language": "python",
318+
"name": "pytorch1"
319+
},
320+
"language_info": {
321+
"codemirror_mode": {
322+
"name": "ipython",
323+
"version": 3
324+
},
325+
"file_extension": ".py",
326+
"mimetype": "text/x-python",
327+
"name": "python",
328+
"nbconvert_exporter": "python",
329+
"pygments_lexer": "ipython3",
330+
"version": "3.6.7"
331+
}
332+
},
333+
"nbformat": 4,
334+
"nbformat_minor": 2
335+
}

‎chapter4/readme.md

+7-3
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,11 @@
1-
# Pytorch 中文手册第三章 ： 提高
1+
# Pytorch 中文手册第四章 ： 提高
22

33
## 目录
44

5-
##第一节 Fine-tuning
5+
## 第一节 Fine-tuning
66

7-
[Fine-tuning](4.1-fine-tuning.ipynb)
7+
[Fine-tuning](4.1-fine-tuning.ipynb)
8+
9+
## 第二节 可视化
10+
11+
[visdom](4.2.1-visdom.ipynb)

‎chapter4/static.zip

1.21 MB
Binary file not shown.

0 commit comments

Comments
 (0)