blocks|key|4446286|text|这在某种程度上取决于你喜欢什么，或者想要构建什么。既然你还没说，我就推荐一些我喜欢的吧。Toby+Segaran的Programming+Collective+Intelligence是一本有趣的书，示例都是用Python语言编写的。你可能会对它更感兴趣--如果没有别的，它会给你的网络爬虫提供一些与它收集的页面相关的东西。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|4446287|编辑:如果你不想再读更多的书，只是想“潜入”某件事，那么Fusspawn关于PyGame的建议非常好。|4446288|entityMap|0|LINK|mutability|MUTABLE|url|https://rads.stackoverflow.com/amzn/click/com/0596529325^0|1L|Z|0|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]]|C|$]]|$1|D|3|E|5|6|7|R|8|@]|9|@]|C|$]]|$1|F|3|-4|5|6|7|S|8|@]|9|@]|C|$]]]|G|$H|$5|I|J|K|C|$L|M]]]]

That really kind of depends on what you enjoy, or would like to build. Since you haven't said, I'll recommend something I enjoyed instead. <a href="https://rads.stackoverflow.com/amzn/click/com/0596529325" rel="noreferrer" rel="nofollow noreferrer" title="Programming Collective Intelligence">Programming Collective Intelligence</a> by Toby Segaran is a fun book, and the examples are all in Python. It might be more interesting to you -- if nothing else, it would give your web crawler something to do with the pages it gathers.

Edit: Fusspawn's suggestion of PyGame is very good, if don't want any more books and just want to "dive in" to something.

blocks|key|2978394|text|你可以试试我的Building+Skills+in+OO+Design。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|2978395|http://homepage.mac.com/s_lott/books/oodesign.html|2978396|entityMap|0|LINK|mutability|MUTABLE|url|1^0|7|S|0|0|0|1E|1|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]]|C|$]]|$1|D|3|E|5|6|7|R|8|@]|9|@$A|S|B|T|1|U]]|C|$]]|$1|F|3|-4|5|6|7|V|8|@]|9|@]|C|$]]]|G|$H|$5|I|J|K|C|$L|E]]|M|$5|I|J|K|C|$L|E]]]]

You can try my <a href="http://homepage.mac.com/s_lott/books/oodesign.html" rel="nofollow noreferrer">Building Skills in OO Design</a>.

<a href="http://homepage.mac.com/s_lott/books/oodesign.html" rel="nofollow noreferrer">http://homepage.mac.com/s_lott/books/oodesign.html</a>

blocks|key|926204|text|如果您喜欢数学，请尝试使用python通过求解Project+Euler+problems来学习Python。每个问题都不是太多的代码，它帮助我提高了我的python技能。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|926205|entityMap|0|LINK|mutability|MUTABLE|url|http://projecteuler.net/^0|N|M|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

If you like math try learning Python by solving <a href="http://projecteuler.net/" rel="nofollow noreferrer">Project Euler problems</a> using python. Each problem is not too much code and it helped me increase my python skills.

blocks|key|932634|text|我总是发现做一个小游戏是学习一门语言的一种很好的方式，PyGame使它变得简单，并且可以帮助学习更多关于python的知识。如果你有这种倾向，我建议提前给你。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|932635|entityMap|0|LINK|mutability|MUTABLE|url|http://www.pygame.org/^0|R|6|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

I always find making a small game is a nice way to learn a language 
<a href="http://www.pygame.org/" rel="nofollow noreferrer">PyGame</a> makes it simple and could help learn more about python. I suggest giving it ago if your that way inclined.

blocks|key|2978577|text|要开始使用web爬行，请考虑Scrapy框架。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|2978578|http://scrapy.org/|offset|length|2978579|Scrapy是一种高级抓取和网络爬行框架，用于编写爬虫来抓取和解析各种目的的网页，从信息检索到监视或测试网站。|2978580|它仍在向第一个版本靠拢，但它是可用的，并且有像样的文档。|2978581|对于非常基本的web抓取，请查看Mechanize+(用于基本的web“浏览”)和BeautifulSoup+(用于解析"html+soup")：|2978582|http://wwwsearch.sourceforge.net/mechanize/|2978583|http://www.crummy.com/software/BeautifulSoup/|2978584|一件有趣的事情是将这些兴趣与一些自然语言处理项目结合起来。O‘’Reilly最近出版的NLTK书籍也可以在网上找到：|2978585|http://www.nltk.org/book|2978586|将这些兴趣结合在一起会有很多乐趣。:-)|2978587|entityMap|0|LINK|mutability|MUTABLE|url|1|2|3^0|0|0|I|0|0|0|0|0|0|17|1|0|0|19|2|0|0|0|O|3|0|0^^$0|@$1|2|3|4|5|6|7|15|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|16|8|@]|9|@$D|17|E|18|1|19]]|A|$]]|$1|F|3|G|5|6|7|1A|8|@]|9|@]|A|$]]|$1|H|3|I|5|6|7|1B|8|@]|9|@]|A|$]]|$1|J|3|K|5|6|7|1C|8|@]|9|@]|A|$]]|$1|L|3|M|5|6|7|1D|8|@]|9|@$D|1E|E|1F|1|1G]]|A|$]]|$1|N|3|O|5|6|7|1H|8|@]|9|@$D|1I|E|1J|1|1K]]|A|$]]|$1|P|3|Q|5|6|7|1L|8|@]|9|@]|A|$]]|$1|R|3|S|5|6|7|1M|8|@]|9|@$D|1N|E|1O|1|1P]]|A|$]]|$1|T|3|U|5|6|7|1Q|8|@]|9|@]|A|$]]|$1|V|3|-4|5|6|7|1R|8|@]|9|@]|A|$]]]|W|$X|$5|Y|Z|10|A|$11|C]]|12|$5|Y|Z|10|A|$11|M]]|13|$5|Y|Z|10|A|$11|O]]|14|$5|Y|Z|10|A|$11|S]]]]

To get started with web crawling, consider the Scrapy framework.

<a href="http://scrapy.org/" rel="nofollow noreferrer">http://scrapy.org/</a>

"Scrapy is a high level scraping and web crawling framework for writing spiders to crawl and parse web pages for all kinds of purposes, from information retrieval to monitoring or testing web sites."

It's still edging towards a first release, but is usable and has decent documentation. 

For very basic web scraping, check out Mechanize (for basic web "browsing") and BeautifulSoup (for parsing "html soup"):

<a href="http://wwwsearch.sourceforge.net/mechanize/" rel="nofollow noreferrer">http://wwwsearch.sourceforge.net/mechanize/</a>

<a href="http://www.crummy.com/software/BeautifulSoup/" rel="nofollow noreferrer">http://www.crummy.com/software/BeautifulSoup/</a>

One fun thing to do would be to combine these interests with some natural language processing projects. The NLTK book recently published by O'Reilly is available online as well:

<a href="http://www.nltk.org/book" rel="nofollow noreferrer">http://www.nltk.org/book</a>

Lots of fun to be had combining these interests. :-)

blocks|key|2978695|text|如果你想扩展到网页爬行以外的领域，并且不想开始自己的项目(或者不知道该怎么做)，请查看The+Python+Challenge。这是一款你必须用一些python代码来解决难题的游戏。我觉得很有意思。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|2978696|entityMap|0|LINK|mutability|MUTABLE|url|http://www.pythonchallenge.com/^0|17|K|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

If you want to expand beyond web crawling and don't want to start a your own project (or don't know what to do), check out <a href="http://www.pythonchallenge.com/" rel="nofollow noreferrer">The Python Challenge</a>. It's a game where you have to solve puzzles with a bit of python code. I really enjoyed it.

blocks|key|2978388|text|网络爬行是你想要做的事情，还是你认为你可以完成的事情？Python是一个很好的网络爬虫工具(参见here和here)，但如果你真的只是想让任何项目更熟悉这门语言/API，我建议你选择一个你普遍感兴趣的项目。这样就更容易坚持成果，因为除了对语言的兴趣之外，您已经对项目有了兴趣。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|2978389|entityMap|0|LINK|mutability|MUTABLE|url|http://www.drewconway.com/zia/?p=1037|1|http://www.drewconway.com/zia/?p=1096^0|1C|4|0|1H|4|1|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]|$A|R|B|S|1|T]]|C|$]]|$1|D|3|-4|5|6|7|U|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]|L|$5|G|H|I|C|$J|M]]]]

Is web crawling something you want to do or just something you think you can accomplish? Python is a good tool for web crawling(see <a href="http://www.drewconway.com/zia/?p=1037" rel="nofollow noreferrer">here</a> and <a href="http://www.drewconway.com/zia/?p=1096" rel="nofollow noreferrer">here</a>), but if you really just want ANY project to work on to get more familiar to the language/APIs I'd suggest you pick a project that you have a general interest in regardless. That way it'll be easier to stick with to fruition as you already have an interest in the project in addition to an interest in the language.

blocks|key|2978493|text|找到一个有趣的开源项目参与其中。你可以开始在pythonsource或sourceforge上寻找。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|2978494|entityMap|0|LINK|mutability|MUTABLE|url|http://pythonsource.com/|1|http://sourceforge.net/^0|M|C|0|Z|B|1|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]|$A|R|B|S|1|T]]|C|$]]|$1|D|3|-4|5|6|7|U|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]|L|$5|G|H|I|C|$J|M]]]]

Find an interesting open source project to participate in. You could start looking on <a href="http://pythonsource.com/" rel="nofollow noreferrer">pythonsource</a> or <a href="http://sourceforge.net/" rel="nofollow noreferrer">sourceforge</a>.

blocks|key|4446348|text|Tools/webchecker/目录应该在您的Python发行版中(否则您可以通过我给出的链接获得它)，它是一个起点--有很多限制(除了在wsgui.py中没有线程，没有异步操作，等等)，但是删除其中的一些将是一个很好的学习经验！|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|4446349|可以在Twisted之上构建一个非常优越的爬虫系统，例如，从this+mail底部的代码片段开始(它只有一个页面，但以适当的异步方式！)并添加你在webchecker中看到的其他功能(解析和尊重robots.txt，从页面获取链接等)。|4446350|entityMap|0|LINK|mutability|MUTABLE|url|http://svn.python.org/view/python/trunk/Tools/webchecker/|1|http://twistedmatrix.com/pipermail/twisted-python/2003-July/005063.html^0|1Y|8|0|H|0|0|U|9|1|0^^$0|@$1|2|3|4|5|6|7|R|8|@$9|S|A|T|B|C]]|D|@$9|U|A|V|1|W]]|E|$]]|$1|F|3|G|5|6|7|X|8|@]|D|@$9|Y|A|Z|1|10]]|E|$]]|$1|H|3|-4|5|6|7|11|8|@]|D|@]|E|$]]]|I|$J|$5|K|L|M|E|$N|O]]|P|$5|K|L|M|E|$N|Q]]]]

The <a href="http://svn.python.org/view/python/trunk/Tools/webchecker/" rel="nofollow noreferrer">Tools/webchecker/</a> directory, which should be in your Python distribution (otherwise you can get it via the link I gave), is a start -- with lots of limitations (no threading except in <code>wsgui.py</code>, no async operation, ...), but removing some of them would be a great learning experience!

A vastly superior spidering system could be built on top of Twisted, e.g. starting with the snippet at the bottom of <a href="http://twistedmatrix.com/pipermail/twisted-python/2003-July/005063.html" rel="nofollow noreferrer">this mail</a> (which only gets one page, but in the proper asynchronous way!) and adding the other functionality you see exemplified in webchecker (parse and respect robots.txt, get links from pages, etc, etc).

blocks|key|926210|text|如果你想要“高级书籍”，我推荐Alex的Python+in+a+Nutshell,+Second+Edition，从书中学到了很多，还有Tarek的Expert+Python+Programming，我们都知道这是一本高级的书，标题是：)。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|926211|要阅读一些开源项目，推荐使用SQLAlchemy和Django。|926212|也许尝试开始你自己的项目是最好的方式。|926213|entityMap|0|LINK|mutability|MUTABLE|url|http://oreilly.com/catalog/9780596100469/|1|http://www.packtpub.com/expert-python-programming/book|2|http://www.sqlalchemy.org/|3|http://www.djangoproject.com/^0|K|10|0|22|P|1|0|E|A|2|P|6|3|0|0^^$0|@$1|2|3|4|5|6|7|V|8|@]|9|@$A|W|B|X|1|Y]|$A|Z|B|10|1|11]]|C|$]]|$1|D|3|E|5|6|7|12|8|@]|9|@$A|13|B|14|1|15]|$A|16|B|17|1|18]]|C|$]]|$1|F|3|G|5|6|7|19|8|@]|9|@]|C|$]]|$1|H|3|-4|5|6|7|1A|8|@]|9|@]|C|$]]]|I|$J|$5|K|L|M|C|$N|O]]|P|$5|K|L|M|C|$N|Q]]|R|$5|K|L|M|C|$N|S]]|T|$5|K|L|M|C|$N|U]]]]

If you wanna "advanced book", I recommend Alex's <a href="http://oreilly.com/catalog/9780596100469/" rel="nofollow noreferrer">Python in a Nutshell, Second Edition</a>, learn quite a lot from the book, and Tarek's <a href="http://www.packtpub.com/expert-python-programming/book" rel="nofollow noreferrer">Expert Python Programming</a>,we all know it's a advanced book for it's title:) . 
For read some open source project, recommend <a href="http://www.sqlalchemy.org/" rel="nofollow noreferrer">SQLAlchemy</a> and <a href="http://www.djangoproject.com/" rel="nofollow noreferrer">Django</a>. 
Maybe try to start you own project is the best way.

blocks|key|663919|text|其他人已经说过了，但我要重复一遍:做你感兴趣的事情，否则就不会有趣。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|663920|如果你真的觉得爬虫很有趣，那就看看google-kongulo吧，这是一个谷歌桌面搜索的网络蜘蛛插件。代码很短，而且写得很好，所以这可能是你决定要抓取什么的一个很好的基础。|offset|length|style|CODE|663921|entityMap|0|LINK|mutability|MUTABLE|url|http://code.google.com/p/google-kongulo/^0|0|H|E|H|E|0|0^^$0|@$1|2|3|4|5|6|7|P|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|Q|8|@$D|R|E|S|F|G]]|9|@$D|T|E|U|1|V]]|A|$]]|$1|H|3|-4|5|6|7|W|8|@]|9|@]|A|$]]]|I|$J|$5|K|L|M|A|$N|O]]]]

Others have said it but I'll repeat: work on something you are interested in or it won't be fun. 

If you do decide that a crawler would be fun, take a look at <a href="http://code.google.com/p/google-kongulo/" rel="nofollow noreferrer"><code>google-kongulo</code></a>, web spider plugin for Google desktop search. The code is quite short and well-written, so this might make a good base for when you decide what you want to crawl.

blocks|key|926262|text|如果您对抓取网络特别感兴趣，请查看在PyCon+2009上发表的名为“抓取网络”的三部分演讲。它是这个RSS+feed的一部分。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|926263|entityMap|0|LINK|mutability|MUTABLE|url|http://advocacy.python.org/podcasts/pycon.rss^0|1F|8|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

If you're specifically interested in crawling the Web, check out the three-part talk called "Scrape the Web" given at PyCon 2009. It's part of this <a href="http://advocacy.python.org/podcasts/pycon.rss" rel="nofollow noreferrer">RSS feed</a>.

blocks|key|663968|text|再次阅读Dive+Into+Python，它在第8章和第11章讨论了HTML+processing和HTTP+web+services。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|663969|entityMap|0|LINK|mutability|MUTABLE|url|http://www.diveintopython.net/html_processing/index.html|1|http://www.diveintopython.net/http_web_services/index.html^0|Y|F|0|1E|H|1|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]|$A|R|B|S|1|T]]|C|$]]|$1|D|3|-4|5|6|7|U|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]|L|$5|G|H|I|C|$J|M]]]]

Read Dive Into Python again, it discusses <a href="http://www.diveintopython.net/html_processing/index.html" rel="nofollow">HTML processing</a> and <a href="http://www.diveintopython.net/http_web_services/index.html" rel="nofollow">HTTP web services</a> in chapters 8 and 11.

I've been meaning to learn another language than java. So I started to poke around with python. I've gone over 'dive into python' so I have a decent knowledge about python now. 

where do you suggest I go from here? I dont want to go through another advanced book again and would like to use the python knowledge towards building 'something'. 

I've heard that python is good for web crawling, however, I did not see that in dive into python. Can the community suggest how to use my pythong knowledge towards web crawlers or spiders?

what next after 'dive into python'

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

我一直想学一门比java更好的语言。所以我开始尝试使用python。我已经读过了“潜入python”，所以我现在对python有了一个不错的了解。你建议我从这里走到哪里？我不想再读另一本高级书籍了，我想用python的知识来构建“一些东西”。我听说python很适合网络爬行，但是我在dive into python中没有看到这一点。社区可以建议如何将我的pythong知识用于网络爬虫或蜘蛛吗？

问在“潜入python”之后会发生什么？
EN

回答 13

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问在“潜入python”之后会发生什么？EN

回答 13

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问在“潜入python”之后会发生什么？
EN