竟然是用Get,
不愧是公家機關.
不過就算是POST也是可以用request的.
通常會需要用到按鈕事件的是非同步的.

用 get 沒什麼問題吧

一般除非是沒辦法直接用 requests 爬

如選項或按鈕是 js render的

才會考慮用 selenium 那類的lib

只要能解決問題的就是好招...

請問我加這樣的計算日期迴圈 , 出現錯誤 , 要怎麼除錯

  File "D:/大數據專案/2 (1).py", line 29, in <module>
    print("Download: "+datestring+"_"+location_arr[0]+".htm")

TypeError: can only concatenate str (not "datetime.date") to str

import requests
import datetime as dt  #載入網頁需求與時間

location_arr=['466910_鞍部','466920_臺北','466930_竹子湖','C0A980_社子','C0A9A0_大直','C0A9B0_石牌','C0A9C0_天母','C0A9E0_士林','C0A9F0_內湖','C0AC40_大屯山','C0AC70_信義','C0AC80_文山','C0AH40_平等','C0AH70_松山','C1AC50_關渡','C1A730_公館','C0A9G0_南港','C0A990_大崙尾山']
#將地點存為陣列

#計算半年日期
startdate = dt.datetime(2019, 2,1)
enddate = dt.datetime(2019, 8,1)
totaldate = (enddate - startdate).days + 1

#在for迴圈內作業。
for daynumber in range(totaldate):
    datestring = (startdate + dt.timedelta(days = daynumber)).date()
       

#取得單日_單一地點.htm
url="https://e-service.cwb.gov.tw/HistoryDataQuery/DayDataController.do?command=viewMain&station=%s&stname=&datepicker=%s" % (location_arr[0].split("_")[0],date_str)
#設定網址變數及 split() 通过指定分隔符对字符串进行切片
print(url) # 列印網址
r=requests.get(url) #設定 R 變數為需求網頁
print("Download: "+datestring+"_"+location_arr[0]+".htm")
#列印時間 地點 網頁
with open(datestring+"_"+location_arr[0]+".htm",'w',encoding='utf-8') as f:
#開啟時間地點變更變為 utf-8
	f.write(r.text)
#寫入到為 r.text 檔案
f.close()
#關閉檔案

#取得單日_全部地點.htm
for i in location_arr:
	url="https://e-service.cwb.gov.tw/HistoryDataQuery/DayDataController.do?command=viewMain&station=%s&stname=&datepicker=%s" %(i.split("_")[0],date_str)
	print(url) #列印網頁
	r=requests.get(url) #設定需求網頁變數
	print("Download: "+datestring+"_"+i+".htm") #列印日期迴圈
	with open(datestring+"_"+i+".htm",'w',encoding='utf-8') as f:  
		f.write(r.text)
	f.close()
	time.sleep(5)

會出錯是因為datestring不是字串格式，所以要用str()把它轉成字串，例如:

datestring = (startdate + dt.timedelta(days = daynumber)).date()

改成

datestring = str((startdate + dt.timedelta(days = daynumber)).date())

完整的範例如下:

import datetime as dt  #載入網頁需求與時間
import requests,time

location_arr=['466910_鞍部','466920_臺北','466930_竹子湖','C0A980_社子','C0A9A0_大直','C0A9B0_石牌','C0A9C0_天母','C0A9E0_士林','C0A9F0_內湖','C0AC40_大屯山','C0AC70_信義','C0AC80_文山','C0AH40_平等','C0AH70_松山','C1AC50_關渡','C1A730_公館','C0A9G0_南港','C0A990_大崙尾山']


startdate = dt.datetime(2019, 2,1)
enddate = dt.datetime(2019, 8,1)
totaldate = (enddate - startdate).days + 1

#在for迴圈內作業。
for daynumber in range(totaldate):
	datestring = str((startdate + dt.timedelta(days = daynumber)).date())
	print(datestring)
	#取得單日_全部地點.htm
	for i in location_arr:
		url="https://e-service.cwb.gov.tw/HistoryDataQuery/DayDataController.do?command=viewMain&station=%s&stname=&datepicker=%s" %(i.split("_")[0],datestring)
		print(url)
		r=requests.get(url)
		print("Download: "+datestring+"_"+i+".htm")
		with open(datestring+"_"+i+".htm",'w',encoding='utf-8') as f:
			f.write(r.text)
		f.close()
		time.sleep(5)

上列的範例開始跑的話會跑很久(180”天”x18”地點”x5”秒”＝16200"秒"/60/60==大約要４個半小時)才能抓完全部資料。
請小心使用...

感謝你這麼熱心協助 , 請問下面這串網址是怎麼取得的

"https://e-service.cwb.gov.tw/HistoryDataQuery/DayDataController.do?command=viewMain&station=%s&stname=&datepicker=%s"

錯誤訊息 , 是因為網站防爬嗎 ?

ConnectionError: HTTPSConnectionPool(host='e-service.cwb.gov.tw', port=443): Max retries exceeded with url: /HistoryDataQuery/DayDataController.do?command=viewMain&station=466920&stname=&datepicker=2018-01-03 (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x00000180FB5E6278>: Failed to establish a new connection: [WinError 10060] 連線嘗試失敗，因為連線對象有一段時間並未正確回應，或是連線建立失敗，因為連線的主機無法回應。'))

我加這段看看

while 1:
    try:
        page = requests.get(url)
    except:
        print("Connection refused by the server..")
        print("Let me sleep for 5 seconds")
        print("ZZzzzz...")
        time.sleep(5)
        print("Was a nice sleep, now let me continue...")
        continue