→ deh3215:每次search結果會略有不同 04/04 10:45
推 yingwan:我發現只要超過500筆就會開始慢了... 04/08 02:34
→ deh3215:正常...查詢的模組好像都會這樣.. 04/08 11:49
※ 引述《yingwan (yingwan)》之銘言：
: 不好意思，這問題也許有點基本，還請大家見諒
: 我用WWW::Mechanize 去抓網頁，可是一次只能抓一頁 (ex: get第一頁，get第二頁)
: 有沒有高手知道怎麼一次抓很多頁啊?
: 謝謝
之前是用
use Google::Search;
my $root='www.msn.com';
my
$key='';#----自己申請一個key來查詢
my $referer = "http://www.mysite.com/index.html";
my $search = Google::Search->Web(q => $root, key => $key, referer =>
$referer);
my $result = $search->first;
while ($result) {
my $no = $result->number;
my $url = $result->uri;
print $no,"\t",$url, "\n"; #---一次印出60筆
$result = $result->next;
}
把結果存下來,再餵給WWW::Mechanize應該就可以了吧
#------------------結果-----------------
0 http://www.msn.com/
1 http://www.hotmail.com/
2 http://weather.msn.com/
3 http://webmessenger.msn.com/
4 http://realestate.msn.com/
5 http://malaysia.msn.com/
6 http://www.live.com/
7 http://www.msn.com/Worldwide.aspx
8 http://ninemsn.com.au/
9 http://entertainment.in.msn.com/
10 http://www.greetings.msn.com/
11 http://cars.uk.msn.com/
12 http://messenger.live.com/
13 http://www.mapblast.com/
14 http://news.uk.msn.com/
15 http://games.msn.com/
16 http://moneycentral.msn.com/
17 http://tech.uk.msn.com/
18 http://news.moneycentral.msn.com/
19 http://style.uk.msn.com/
20 http://uk.msn.com/
21 http://weather.msn.com/region.aspx?wealocations=asia
22 http://in.msn.com/
23 http://en.wikipedia.org/wiki/MSN
24 http://calendar.msn.com/
25 http://sg.msn.com/
26 http://msn.foxsports.com/
27 http://homepage.msn.com/MSNMakeYourHP.htm
28 http://homepage.msn.com/MSNMakeYourHP.htm
29 http://za.msn.com/
30 http://sympatico.msn.ca/
31 http://entertainment.msn.com/
32 http://lifestyle.msn.com/
33 http://advertising.microsoft.com/
34 http://ie.msn.com/
35 http://health.msn.com/
36 http://entertainment.uk.msn.com/music/
37 http://info.mobile.msn.com/en-us/default.aspx
38 http://shopping.msn.com/
39 http://lifestyle.msn.com/your-life/bigger-picture/staticslideshowoprah.aspx?cp-documentid=8318097
40 http://ph.msn.com/
41 http://music.msn.com/
42 http://mobile.msn.com/
43 http://election.msn.com/
44 http://autos.msn.com/
45 https://accountservices.msn.com/
46 http://latino.msn.com/
47 http://id.msn.com/
48 http://encarta.msn.com/
49 http://encarta.msn.com/encnet/features/mapcenter/map.aspx
50 http://music.msn.com/music/artist/madonna.2/
51 http://resor.se.msn.com/
52 http://msn.careerbuilder.com/Article/MSN-1809-Job-Search-The-Full-Time-Job-of-Finding-a-Job/
53 http://astrocenter.astrology.msn.com/msn/DeptHoroscope.aspx
54 http://3c.msn.com.tw/mobile/
55 http://ve.msn.com/
56 http://toolbar.msn.com/
57 http://cityguides.msn.com/
58 http://careers.msn.com/
59 http://moneycentral.msn.com/investor/research/welcome.asp
--
※ 發信站: 批踢踢實業坊(ptt.cc)
◆ From: 59.116.3.235