![]() Here are some examples.Īny advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. ![]() ![]() I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. Thanks for being a customer and please feel free to reach out to me in the future if you have any issues, If you want to use Dotbot on your site, please fill out a ticket in the user portal and our support and tech ops teams will look into for you. Normally bots get blocked for being resource intensive, but we can take an internal look at allowing Dotbot for users who need to use it. At least as far back as 2012, probably earlier. However, I can confirm that Dotbot has been blocked by WP Engine for some time. So, the best thing to do is to submit a ticket through our user portal and we can look into the 403 issue for you. However, that doesn't mean everything is resolved - we want you to get the most out of Moz and have a great experience using WP Engine Thanks for posting your question, I'm John-Henry Scherck, Web Strategist for WP Engine.Īfter some testing on our end, we are seeing Rogerbot getting status 200s when it/he crawls sites on WP Engine, I even tested it on my personal site that also runs on WP Engine and was able to crawl it successfully.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |