Study and Share
English Version: https://today2tmr.com/en/2017/08/29/hand-drawing-effect/
pip install pillowfrom PIL import ImageImage类为基础类，一个对象即代表一个图像|
1 2 3 4 5 6 7 8 |
In [6]: from PIL import Image In [7]: import numpy as np In [8]: im = np.array(Image.open('test.jpg')) In [9]: print(im.shape, im.dtype) (1080, 1920, 3) uint8 |
English Version: https://today2tmr.com/en/2017/08/29/python-data-storage-and-functions/
np.savetxt(frame, array, fmt='%.18e', delimiter=None)
frame: 文件、字符串或产生器，可以是.gz或.bz2的压缩文件。array: 存入文件的数组。fmt: 写入文件的格式，例如：%d, %2.f, %.18edelimiter: 分隔字符串，默认是任何空格，CSV中为逗号|
1 2 3 |
In [4]: a = np.arange(100).reshape(5, 20) In [5]: np.savetxt('a.csv', a, fmt='%d', delimiter=',') |
|
1 2 3 4 5 6 |
# in a.csv 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19 20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39 40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59 60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79 80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99 |
|
1 2 3 |
In [4]: a = np.arange(100).reshape(5, 20) In [5]: np.savetxt('a.csv', a, fmt='%.1f', delimiter=',') |
|
1 2 3 4 5 |
0.0,1.0,2.0,3.0,4.0,5.0,6.0,7.0,8.0,9.0,10.0,11.0,12.0,13.0,14.0,15.0,16.0,17.0,18.0,19.0 20.0,21.0,22.0,23.0,24.0,25.0,26.0,27.0,28.0,29.0,30.0,31.0,32.0,33.0,34.0,35.0,36.0,37.0,38.0,39.0 40.0,41.0,42.0,43.0,44.0,45.0,46.0,47.0,48.0,49.0,50.0,51.0,52.0,53.0,54.0,55.0,56.0,57.0,58.0,59.0 60.0,61.0,62.0,63.0,64.0,65.0,66.0,67.0,68.0,69.0,70.0,71.0,72.0,73.0,74.0,75.0,76.0,77.0,78.0,79.0 80.0,81.0,82.0,83.0,84.0,85.0,86.0,87.0,88.0,89.0,90.0,91.0,92.0,93.0,94.0,95.0,96.0,97.0,98.0,99.0 |
English Version: https://today2tmr.com/en/2017/08/16/python-data-unit-one/
English Version: https://today2tmr.com/en/2017/08/16/python-data-week-zero/
课堂主页：http://www.icourse163.org/course/0809BIT021B-1001870002
English Version: https://today2tmr.com/en/2017/07/18/directory-of-python-spider-study-notes
English Version: https://today2tmr.com/en/2017/07/18/python-spider-study-note-week-fourunit-twelvescrapy-for-stock-data
参考： http://today2tmr.com/2017/07/18/python-爬虫学习笔记-第三周单元9股票数据定向爬虫/
English Version: https://today2tmr.com/en/2017/07/18/python-spider-study-note-week-fourunit-elevenbasic-use-of-scrapy
将页面http://python123.io/ws/demo.html存在demo.html文件中。
步骤：
scrapy startproject python123demo|
1 2 3 4 5 6 7 8 9 10 11 12 13 |
. └── python123demo ├── python123demo │ ├── __init__.py │ ├── items.py │ ├── middlewares.py │ ├── pipelines.py │ ├── __pycache__ │ ├── settings.py │ └── spiders │ ├── __init__.py │ └── __pycache__ └── scrapy.cfg |
English Version: https://today2tmr.com/en/2017/07/18/python-spider-study-note-week-fourunit-tenscrapy-crawling-framework
安装： pip install scrapy
测试： scrapy -h
---REQUESTS---> ENGINE ---REQUESTS---> SCHEDULER---REQUESTS---> ENGINE ---REQUESTS---> DOWNLOADER(连接互联网) ---RESPONSE---> ENGINE ---RESPONSE---> SPIDERS---ITEMS/REQUESTS---> ENGINE
---ITEMS---> ITEM PIPELINES---REQUESTS---> SCHEDULEREnglish Version: https://today2tmr.com/en/2017/07/18/python-spider-study-note-week-threeunit-ninedirectional-spider-for-stock-data
English Version: https://today2tmr.com/en/2017/07/17/python-spider-study-note-week-threeunit-eightdirectional-spider-for-price-comparison-of-taobao-product
功能描述
以”书包”为关键词的搜索页第一页信息
https://s.taobao.com/search?q=书包&imgfile=&commend=all&ssid=s5-e&search_type=item&sourceId=tb.index&spm=a21bo.50862.201856-taobao-item.1&ie=utf8&initiative_id=tbindexz_20170717
第二页
https://s.taobao.com/search?q=书包&imgfile=&commend=all&ssid=s5-e&search_type=item&sourceId=tb.index&spm=a21bo.50862.201856-taobao-item.1&ie=utf8&initiative_id=tbindexz_20170717&bcoffset=4&ntoffset=4&p4ppushleft=1%2C48&s=44
第三页
https://s.taobao.com/search?q=书包&imgfile=&commend=all&ssid=s5-e&search_type=item&sourceId=tb.index&spm=a21bo.50862.201856-taobao-item.1&ie=utf8&initiative_id=tbindexz_20170717&bcoffset=4&ntoffset=4&p4ppushleft=1%2C48&s=88 Continue reading “Python 爬虫学习笔记 – 第三周/单元8/淘宝商品比价定向爬虫”
