How can I use Puppeteer to scroll to the bottom of a page until I can't scroll anymore?

General Discussions
,
1

How can I use Puppeteer to scroll to the bottom of a page until I can’t scroll anymore?

2

Hope this message finds you well! I’m thrilled to share a dazzling snippet of code that will gracefully transport you to the bottom of the page using a combination of window.scrollTo and page.evaluate. Picture this as a magical journey orchestrated with precision and finesse.

Behold the enchanting script:

Scroll to the bottom using window.scrollTo and page.evaluate: s method uses window.scrollTo to scroll to the bottom of the page and page.evaluate to execute the scrolling in the page context.

await page.evaluate(async () => {
    await new Promise((resolve, reject) => {
        let totalHeight = 0;
        const distance = 100;
        const timer = setInterval(() => {
            const scrollHeight = document.body.scrollHeight;
            window.scrollBy(0, distance);
            totalHeight += distance;
            if (totalHeight >= scrollHeight) {
                clearInterval(timer);
                resolve();
            }
        }, 100);
    });
});