??? ??? ???? ??? ???? ? ????? ?????? ??? ???? ? ???? ??? ?????. ? ????? ? ????? ?? ? ?? ?? ?? Python ?????? Beautiful Soup? Scrapy? ?????. ?? ??? ??? ????, ?? ???? ?? ??? ????, ??? ?? ? ????? ?? ?? ??? ?? ??? ????.

? ???? ??

? ????? ?????? ???? ???? ???? ???????. ??? ??, ????, ?? ?? ? ??? ???? ?? ???? ????. ??? ? ????? ???? ??? ?? ? ?? ??? ???? ?? ??? ?? ????? ???.

Beautiful Soup: ????? ??? ?????

Beautiful Soup? ??? ?? ? ???? ??? ?? ??? Python ????????. ?? HTML ? XML ??? ?? ???? ?? ???? ???? ???? ? ?? ?????. Beautiful Soup? ?? ?? ??? ??, ?? ? ??? ?? Python ???? ?????.

?? ??

• ?? ???: Beautiful Soup? ????? ???? ??? ????.
• ??? ?? ??: ??? ???? ??? HTML ? XML ??? ?? ??? ? ????.
• ??: ???? ???? ??? ?? ?? Python ?????? ? ?????.

?? ?

Beautiful Soup? ????? ?? ?????? ?? ???? ???.

pip install beautifulsoup4 requests

?? ?

?? ??? ????? ?? ??? ??? ?????.

import requests
from bs4 import BeautifulSoup

# Fetch the web page
url = 'https://example-blog.com'
response = requests.get(url)
# Check if the request was successful
if response.status_code == 200:
    # Parse the HTML content
    soup = BeautifulSoup(response.text, 'html.parser')
    # Extract article titles
    titles = soup.find_all('h1', class_='entry-title')
    # Check if titles were found
    if titles:
        for title in titles:
            # Extract and print the text of each title
            print(title.get_text(strip=True))
    else:
        print("No titles found. Please check the HTML structure and update the selector.")
else:
    print(f"Failed to retrieve the page. Status code: {response.status_code}")

??

• ???: ?? ?? ????? ?????.
• ???: ??? ??? HTML? ???? ?????.

Scrapy: ??? ? ???? ?????

Scrapy? ??? ??? ??? ?? ??? ???? ???? ? ???? ????????. ??? ???? ???? ???? ??? ????? ?????.

?? ??

• ?? ? ???: ??? ?? ?? ??? ???? ????.
• ???: ????? ?????? ?? ??? ???? ?????.
• ?? ??? ????: JSON, CSV, XML ? ??? ???? ??? ????? ?????.

?? ?

pip? ???? Scrapy ??:

pip install scrapy

?? ?

Scrapy? ???? ?? ?????? ???? ???? ????? ??? ?????.

• ???? ???? ???:

pip install beautifulsoup4 requests

• ???? ??: spiders ????? quote_spider.py ??? ????.

import requests
from bs4 import BeautifulSoup

# Fetch the web page
url = 'https://example-blog.com'
response = requests.get(url)
# Check if the request was successful
if response.status_code == 200:
    # Parse the HTML content
    soup = BeautifulSoup(response.text, 'html.parser')
    # Extract article titles
    titles = soup.find_all('h1', class_='entry-title')
    # Check if titles were found
    if titles:
        for title in titles:
            # Extract and print the text of each title
            print(title.get_text(strip=True))
    else:
        print("No titles found. Please check the HTML structure and update the selector.")
else:
    print(f"Failed to retrieve the page. Status code: {response.status_code}")

• ????? ?????: ????? ???? ???? ?????.

pip install scrapy

??

• ???: ??? ???? ????? ????? ?????.
• ?? ??: ?? ?? ? ??? ?????? ?? ??? ??? ?????.

?? ?? ? ???? ?? ??

? ????? ??? ????? ??? ?? ???? ?? ?????.

• Robots.txt ??: ?? ????? robots.txt ??? ???? ?? ???? ???? ? ??? ?????.
• ?? ??: ??? ???? ??? ??? ?? ??? ??? ?????.
• ??? ???? ??: ??? ??? ???? ???? ???? ?? ??? ??? ?????.
• ?? ??: ?? ?? ?? ? ???? ??? ??? ???? ???.

??

Beautiful Soup? Scrapy? ??? ??? ?? ??? ? ???? ?????. Beautiful Soup? ???? ??? ????? ???? ??, Scrapy? ???? ??? ???? ??? ?????. ?? ??? ??? ????? ??? ?? ???? ???? ??? ???? ?? ? ????

??: AI ?? ???

? ??? Beautiful Soup? Scrapy? ??? ? ????: ????? ??? ?? ??? ??? ?? ?????. ??? ??? PHP ??? ????? ?? ?? ??? ?????!