工业技术与职业教育

计算机网络的发展促使了信息的采集、传播的速度和规模达到空前的水平。如何在大数据时代,高效便捷的获取自身需要的个性化数据,则变成一个迫切需要解决的问题。Python语言具备简单易学的特点,其已经成为开发网络爬虫的热门语言。尝试使用Python语言设计网络爬虫,实现对网络图片的自动批量下载,从而为提高个性化数据的获取进行有意义的尝试。

The development of computer network has promoted the speed and scale of information collection and dissemination to an unprecedented level. How to acquire the personalized data efficiently and conveniently becomes an urgent problem in the big data era. Python language is simple and easy to learn. It has become a popular language for developing web crawlers. This paper attempts to use Python language to design web crawler, so as to realize the automatic batch download of network pictures, so as to improve the acquisition of personalized data for a meaningful attempt.