構(gòu)建基于山西招生網(wǎng)的數(shù)據(jù)采集與分析系統(tǒng)
pip install requests beautifulsoup4
import requests
url = 'https://www.sxzs.com/'
response = requests.get(url)
html_content = response.text
print(html_content[:500]) # 打印前500個(gè)字符
from bs4 import BeautifulSoup
soup = BeautifulSoup(html_content, 'html.parser')
school_names = [a.text for a in soup.find_all('a') if 'school' in a.get('href', '')]
print(school_names)
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36'
}
response = requests.get(url, headers=headers)
import time
time.sleep(2) # 每次請(qǐng)求后等待2秒
import csv
with open('schools.csv', mode='w', newline='', encoding='utf-8') as file:
writer = csv.writer(file)
writer.writerow(['School Name'])
writer.writerows([[name] for name in school_names])
本站知識(shí)庫(kù)部分內(nèi)容及素材來(lái)源于互聯(lián)網(wǎng)，如有侵權(quán)，聯(lián)系必刪！
讀過(guò)這篇文章的讀者還喜歡：
手把手教你如何用Python爬取招生網(wǎng)數(shù)據(jù)并分析金華地區(qū)信息招生管理系統(tǒng)融入人工智能應(yīng)用的創(chuàng)新實(shí)踐鄭州招生網(wǎng)：教育信息的便捷窗口基于常州招生網(wǎng)的數(shù)據(jù)挖掘與分析系統(tǒng)設(shè)計(jì)淄博的招生管理系統(tǒng)，讓教育更有趣！基于招生系統(tǒng)的廊坊高校信息化建設(shè)探討基于招生網(wǎng)的數(shù)據(jù)挖掘與浙江高校分析構(gòu)建基于重慶招生網(wǎng)的數(shù)據(jù)分析平臺(tái)手把手教你用代碼實(shí)現(xiàn)招生網(wǎng)與用戶手冊(cè)天津視角下的武漢招生系統(tǒng)觀察基于招生服務(wù)平臺(tái)與廠家合作的技術(shù)實(shí)現(xiàn)