?? ? ?? ????? ??? HTTP ??? Guzzle? ??????. 2. CSS ???? ???? Symfony Domcrawler? ????? HTML? ?? ?????. 3. PHP Exec ()? ?? ???? ???? ???? ????? JavaScript? ?? ???? ?????. 4. robots.txt? ????, ??? ????, ??? ????? ?????, ???? ???? ??? ?????. 5. ??? ? ??? ?? CSV ?? MySQL? ?? ??????? ???? ??????. ??? ??? ?? PHP? ? ???? ? ??? ??? ???? ????? ?????.

??? ???? ? ? ???? ?? PHP? ???? ?? ?? ????? ?? ?? ???? ?? ? ????. Plython? ?? BeautifulSoup ? Selenium? ?? ??? ??????? ????. ??? PHP? ????? ?????. ??? ?????? ?? ??? ?? PHP? ? ???? ??? ????? ???? ?? ??? ????? ? ????? ??? ? ???? ?? ? ? ????.

??? ???? ? ? ???? PHP? ????? ???? ??? ??? ????.

1. HTTP ??? Guzzle? ??????

?????? ?? ? ???? ???????. file_get_contents() ??? ??? ????? Guzzle? ??? ??? ?? ? ??? ??? HTTP ????????.

???? ?? ??????.

 ???? guzzlehttp/guzzle? ?????

? : ? ???? ?? ????

 $ client = new \ guzzlehttp \ client ();
$ response = $ client-> get ( 'https://example.com');
$ html = (???) $ response-> getbody ();

Guzzle? ??, ??, ??, ???? ? ?? ??? ?????. ??? ??? ?? ????? ???? ? ??????.

2. Symfony Domcrawler? HTML? ?? ?????

HTML? ??? ???? ???????. Symfony Domcrawler ?? ??? DOM Traversal? ?? jQuery? ???? ????.

?? :

 ???? Symfony/Dom-Crawler? ?????

? : ?? ??? ??????

 Symfony \ Component \ domcrawler \ Crawler? ??????.

$ Crawler = New Crawler ($ HTML);
$ links = [];

$ crawler-> ?? ( 'a')-> ? (?? ($ node) ?? (& $ links) {
    $ links [] = [
        'href'=> $ node-> attr ( 'href'),
        'text'=> $ node-> text ()
    ];
});

CSS ???? ???, ?? ??, ???? ????? ?? ??, ?? ?? ?? ???? ????? ??? ??? ???? ? ? ????.

3. ???? ???? (Puppeteer PHP)??? JavaScript? ?? ???? ?????.

PHP ??? JavaScript? ??? ? ???? ???? JS (? : React ?? Angular Apps)? ?? ???????? ??? HTTP Fetching? ???? ????.

??? : Puppeteer (node.js)? ?? ???? ????? ???? PHP? ?? ??????.

????:

• ???????? ??? ? HTML????? ??? ????? ??????.
• exec() ?? REST API? ???? PHP?? ??????.

Puppeteer ???? ( scrape.js ) ?? :

 const puppeteer = require ( 'puppeteer');
const fs = ?? ?? ( 'fs');

(async () => {
    Const Browser = Await Puppeteer.launch ();
    const page = browser.newpage ();
    Await Page.goto (process.argv [2]);
    AWAIT Page.Waitfortimeout (3000); // JS??? ? ??? ?????

    const html = await page.content ();
    fs.writefilesync ( 'output.html', html);
    Await Browser.close ();
}) ();

PHP?? ?? :

 exec ( "?? scrape.js https://example.com");
$ html = file_get_contents ( 'output.html');

? ????? ??? ???? PHP? ??? ???? ??????? ?? ? ??? ??? ?? ? ? ????.

4. Robots.txt? ???? ?? ??? ?????

??? ????? IP? ?? ? ? ????. ???:

• check robots.txt (? : https://example.com/robots.txt )
• ?? ??? ??? ?????
• ??? ????? ??????
• ??? ????? ???? ??????

?? ? :

 ?? (2); // ?? ??? 2 ?? ?????

???? ??? ????? ??????.

 $ client-> get ( 'https://example.com', [
    '??'=> [
        '??? ????'=> 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebkit/537.36'
    ]]
]);

5. ???? ?? ???? ??????

?? ??? PHP? ?????? ? ?? ??? ? ?????.

CSV? ?? :

 $ fp = fopen ( 'products.csv', 'w');
foreach ($ data as $ row) {
    fputcsv ($ fp, $ row);
}
fclose ($ fp);

?? mysql? ?? :

 $ stmt = $ pdo-> ?? ( "??? ?? (??, ??) ? (?,?)");
$ stmt-> execute ([$ name, $ price]);

?? ??

PHP? ??????? ?? ??? ?? ??? ???? Guzzle , Domcrawler ? Puppeteer ? ?? ???? ??? ???? ???? ?? ??? ?????. ?? Laravel ?? WordPress? ?? PHP ???? ?? ?????? ??.

Python? ???? ?? ??? PHP? ??? ? ? ? ? ??? ?? ?? ????.

????? : ???? ????, ???? ?? ????, ??? ? JS? ?????, ?? ????? ?????.

? ??? ??? ???? ? ? ???? PHP ??? ?? ?????. ??? ??? PHP ??? ????? ?? ?? ??? ?????!