我們遇到一些自己喜歡內容，想保存下來，手動復制粘貼很麻煩，我們使用 python 來爬取這些內容。

一、代碼

downlod.py

import os
import requests
from bs4 import BeautifulSoup
from urllib.parse import urljoin# 目標網頁（可以更改）
url = "https://www.baidu.com"# 指定保存的文件夾和 Markdown 文件名
save_folder = "web_md"
os.makedirs(save_folder, exist_ok=True)
md_filename = os.path.join(save_folder, "page.md")
images_folder = os.path.join(save_folder, "images")
os.makedirs(images_folder, exist_ok=True)# 獲取網頁內容
response = requests.get(url)
response.encoding = response.apparent_encoding
soup = BeautifulSoup(response.text, "html.parser")# 打開 Markdown 文件
with open(md_filename, "w", encoding="utf-8") as md_file:md_file.write(f"# {soup.title.string.strip()}\n\n")for element in soup.body.find_all(["p", "a", "code", "img", "h1", "h2", "h3", "h4", "h5", "h6", "pre"], recursive=True):if element.name == "h1":md_file.write(f"\n# {element.get_text(strip=True)}\n\n")elif element.name == "h2":md_file.write(f"\n## {element.get_text(strip=True)}\n\n")elif element.name == "h3":md_file.write(f"\n### {element.get_text(strip=True)}\n\n")elif element.name == "h4":md_file.write(f"\n#### {element.get_text(strip=True)}\n\n")elif element.name == "p":md_file.write(f"{element.get_text(strip=True)}\n\n")elif element.name == "a":link_text = element.get_text(strip=True)href = urljoin(url, element["href"])md_file.write(f"[{link_text}]({href})\n\n")elif element.name == "code":md_file.write(f"```\n{element.get_text(strip=True)}\n```\n\n")elif element.name == "pre":md_file.write(f"```\n{element.get_text()}\n```\n\n")elif element.name == "img":img_url = urljoin(url, element["src"])img_name = os.path.basename(img_url).split("?")[0]img_path = os.path.join(images_folder, img_name)try:img_data = requests.get(img_url).contentwith open(img_path, "wb") as img_file:img_file.write(img_data)md_file.write(f"![{img_name}](images/{img_name})\n\n")except Exception as e:print(f"下載 {img_url} 失敗: {e}")print(f"Markdown 文件已保存至 {md_filename}")

二、安裝環境

1. 安裝 python
2. 管理員運行 cmd，最好掛梯子

pip install requests beautifulsoup4

3. 在 downlod.py 同級目錄下運行cmd

python download.py

三、vscode + markdown all in one

1. 安裝 vscode
2. vscode 的擴展安裝 markdown all in one
   
3. vscode 打開下載的 md 文件
4. 點擊右上角的 預覽 按鈕，即可預覽轉換后的 md 文件
   
5. ctrl + shift + p，打開命令模式
6. 輸入 markdown ，使用這個命令，可以將md轉為 html 格式