Robot.txt plays an important role when Google and other search engine crawlers index the website or store. Magento 2 noindex nofollow extension helps to control the search engines to make website content in search result pages. NoFollow control search engines to pass the link juice to other pages, which prevents the SEO score of the store.
