New to the community? Start here

[SmartCrawl Pro] Issue with running Smart Crawl Pro on my website

For some reason, I am unable to do an SEO Checkup with my website. The error shows – There was an error crawling https://bit.ly/2F5n4uj, we weren't able to get meaningful results

Please advise.

Thanks!

Fri, 10 May 2019 8:18:42
More SmartCrawl Pro discussions
SmartCrawl Pro
  • Adam
    • Support Gorilla

    Hi Eugene

    I hope you’re well today and thank you for your question!

    When I visited your site I noticed some “mixed content” errors and that suggests that the site may not be properly configured for SSL (though that’s one of the options only as I can’t see site configuration) so could you please start with checking one thing:

    go to “Settings -> General” page in site’s back-end and see if both “WordPress Address (URL)” and “Site Address (URL)” options are using “https://” prefix instead of “http://”.

    If not, update them to use “https://” (as your site is redirected to https:// anyway), clear all caches on site and server and give it another try.

    If that doesn’t help, I would like to take a closer look at the setup so in such case could you please enable support access to the site for me? To do so, please go to the “WPMU DEV -> Support -> Support Access” page in site’s back-end, click on “Grant support access” button there and let me know once it’s done.

    I’ll then access the site and investigate the issue further.

    Best regards,

    Adam

  • Adam
    • Support Gorilla

    Hi Eugene

    Thank you for checking this and for enabling support access.

    I checked the site and we’ll need to go in “steps” through this. The checkup scan does start, site doesn’t respond with any unexpected HTTP status and there’s no errors whatsoever in the browser console – not even any timeouts. This does suggest some things but we’ll need to test them.

    Below are 3 steps that I’d like to ask you to try then:

    1) Site’s currently powered by PHP 5.6.40 which is a bit out of date. Would it be possible to switch it up to 7.x (7.2.x or 7.3.x possibly but 7.1.x – if no higher release is available – should also be good)?

    Usually this can be done via cPanel or similar hosting management panel. If you could give it a go, it would be great. 7.x is faster and more secure than 5.x but also puts “less stress on server resources” and both checkup and crawl scans are quite resource-intensive.

    2) Try increasing WP memory limit. Currently your server allows up to 256M of memory to be used by PHP scripts while WordPress is still limiting it to default 40M for front-end. That’s an amount good for a really basic site so it’s worth increasing.

    To do this, please edit the “wp-config.php” file and add following line right above the “/* That’s all, stop editing! */” one:

    define( 'WP_MEMORY_LIMIT', '256M' );

    After both changes are made, clear cache on server if there is any and check again. If the checkup still doesn’t work:

    3) Please get in touch with your host and make sure with them if they are not blocking or in any way “rate-limiting” these IPs (it would be good to make sure that they are white-listed in any security/limiting tools on server):

    35.171.56.101

    45.55.78.242

    If that doesn’t help either, let me know and we’ll investigate it further.

    Best regards,

    Adam