INTRODUCTION

one web spider. Fetures: 1, support simulated browser agents, 2, support cookies, 3, support multithreads. 4, spider urls and content are saved in mysql, 5, urllib2, request, mechanized are supported.