How to create a bot for scrape top reviews of amazon product
In this Blog Post we will make a bot with the help of Datakund Studio to scrape the top reviews of amazon product.
This bot will save the scraped data in Google Sheet.
Click DK extension and type “scrape_amazon_reviews” and then click “+ New Api” to create a new bot. Now click “record” to start training the bot.
In the browser, open amazon.com to add the URL event.
Now, search for a keyword(eg: mouse)
For the page to load, lets add wait event of 3 sec. To add wait event, right click anywhere on the screen and click Datakund=>wait=>static=>3.
Now lets add repeat event for the bot to go to all the products one by one. To add the repeat event, right click anywhere on the screen, click Datakund=>Start repeat..
Click on the first product.
Now, click back arrow and Stop the bot.
Now create a new bot by the name “scrape_reviews” and click record to start training the bot.
Now, lets add ‘scroll to end’ event, for the bot to scroll down to reviews. For that, right click anywhere on the screen and click Datakund=>more=>scroll to end.
Go the reviews section, and lets add repeat event to scrape reviews one by one. For that, right click anywhere on the screen and click Datakund=>start repeat, to add repeat event to the new bot.
Click the edit icon on the top left corner of the extension to add output variables and click save. Like as shown in the image below.
Lets scrape name, title and description of the reviews. To scrape right click on the name then click Datakund=>scrape =>text=>name, and vice versa for title and description of the review, as shown in the images below.
Now lets stop the training the bot(scrape_reviews) and open the first bot(scrape_amazon_reviews) and click the last event to start adding the events from there.
Now right click anywhere on the screen, then click Datakund=>bots=>scrape_reviews, to call the bot.
Now lets stop training the bot, and click run on the main menu, and type the keyword and then click the down button beside the run button and then click run google sheet and the click run google sheet again once the bot is loaded.