Welcome to SEO Unity!

SEO Unity is an active community of SEO members. We provide a unique platform for you to learn and share ideas about search engine optimization, marketing, and how to make money online. Signup today and start interacting with other SEO experts around the world and get free access to premium SEO tools.

Create a Free Account

WordPress robots.txt

Discussion in 'White Hat SEO' started by JakeJax, Aug 31, 2018.

  1. JakeJax

    JakeJax Regular Member

    Joined:
    Aug 23, 2018
    Messages:
    22
    Likes Received:
    3
    Are there any best practices for the robots.txt file on WordPress?
    I'm not sure if there are pages I should disallow Google from seeing. I guess the admin panel is one of them?

    Also, is there a good list of bad bots I can block?
     
    #1
  2. BLUE

    BLUE Regular Member

    Joined:
    Aug 26, 2018
    Messages:
    27
    Likes Received:
    2
    I would advice just working with a plug-in for this. Some sites specify which to block but the plug-in will take out all the guesswork and make it easier. I use this one: https://wordpress.org/plugins/stopbadbots/
     
    #2
  3. aspldelhi

    aspldelhi Regular Member

    Joined:
    Dec 6, 2016
    Messages:
    7
    Likes Received:
    0
    very important
     
    #3

Share This Page